Jun 03 16:17:02.363044 ip-10-0-133-169 systemd[1]: Starting Kubernetes Kubelet... Jun 03 16:17:02.806908 ip-10-0-133-169 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:17:02.806908 ip-10-0-133-169 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 16:17:02.806908 ip-10-0-133-169 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:17:02.806908 ip-10-0-133-169 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 16:17:02.806908 ip-10-0-133-169 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:17:02.809953 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.809861 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 16:17:02.813342 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813325 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:17:02.813342 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813342 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813346 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813349 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813352 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813355 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813358 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813361 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813363 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813366 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813368 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813372 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813375 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813377 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813380 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813382 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813387 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813390 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813393 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813396 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813398 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:17:02.813411 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813401 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813404 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813407 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813409 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813412 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813414 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813417 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813421 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813423 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813426 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813428 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813431 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813433 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813436 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813439 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813441 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813444 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813446 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813451 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813454 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:17:02.813902 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813458 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813461 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813464 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813467 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813469 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813472 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813474 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813477 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813480 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813482 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813485 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813487 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813490 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813492 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813496 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813499 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813501 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813504 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813507 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813510 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:17:02.814401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813512 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813515 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813518 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813520 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813523 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813525 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813527 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813530 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813532 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813535 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813537 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813540 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813542 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813545 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813547 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813550 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813553 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813555 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813558 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:17:02.814947 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813560 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813563 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813565 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813567 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813570 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813572 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813974 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813981 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813983 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813986 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813989 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813991 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813994 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.813998 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814002 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814005 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814008 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814011 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814013 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:17:02.815408 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814016 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814018 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814021 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814023 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814026 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814028 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814031 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814033 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814036 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814038 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814041 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814044 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814047 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814050 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814053 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814055 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814057 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814060 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814063 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814065 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814068 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:17:02.815880 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814071 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814073 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814076 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814080 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814082 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814085 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814087 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814090 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814092 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814095 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814097 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814100 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814102 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814105 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814107 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814109 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814112 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814114 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814117 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814119 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:17:02.816401 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814122 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814125 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814128 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814131 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814134 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814136 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814139 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814141 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814145 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814149 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814152 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814155 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814158 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814160 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814163 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814166 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814170 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814174 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814177 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:17:02.816912 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814181 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814183 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814186 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814188 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814190 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814193 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814196 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814199 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814202 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814204 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814207 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814210 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.814212 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815435 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815445 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815451 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815458 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815462 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815465 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815470 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815474 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 16:17:02.817375 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815478 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815481 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815484 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815487 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815491 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815494 2559 flags.go:64] FLAG: --cgroup-root="" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815497 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815499 2559 flags.go:64] FLAG: --client-ca-file="" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815502 2559 flags.go:64] FLAG: --cloud-config="" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815505 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815508 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815513 2559 flags.go:64] FLAG: --cluster-domain="" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815516 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815519 2559 flags.go:64] FLAG: --config-dir="" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815522 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815525 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815529 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815532 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815535 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815539 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815542 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815544 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815547 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815550 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815553 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 16:17:02.818150 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815558 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815561 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815563 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815568 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815571 2559 flags.go:64] FLAG: --enable-server="true" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815574 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815578 2559 flags.go:64] FLAG: --event-burst="100" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815581 2559 flags.go:64] FLAG: --event-qps="50" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815584 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815587 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815590 2559 flags.go:64] FLAG: --eviction-hard="" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815593 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815596 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815599 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815602 2559 flags.go:64] FLAG: --eviction-soft="" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815604 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815607 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815610 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815613 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815616 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815619 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815622 2559 flags.go:64] FLAG: --feature-gates="" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815631 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815634 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815638 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 16:17:02.818875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815641 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815644 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815647 2559 flags.go:64] FLAG: --help="false" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815650 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-133-169.ec2.internal" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815653 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815656 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815658 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815662 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815665 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815668 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815671 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815674 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815677 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815680 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815684 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815686 2559 flags.go:64] FLAG: --kube-reserved="" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815689 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815692 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815695 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815697 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815700 2559 flags.go:64] FLAG: --lock-file="" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815703 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815706 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815708 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 16:17:02.819482 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815714 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815717 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815719 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815722 2559 flags.go:64] FLAG: --logging-format="text" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815726 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815729 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815732 2559 flags.go:64] FLAG: --manifest-url="" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815735 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815739 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815742 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815759 2559 flags.go:64] FLAG: --max-pods="110" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815763 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815766 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815768 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815771 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815784 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815788 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815791 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815798 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815802 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815805 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815809 2559 flags.go:64] FLAG: --pod-cidr="" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815812 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 16:17:02.820120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815817 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815820 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815823 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815826 2559 flags.go:64] FLAG: --port="10250" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815830 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815833 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d38ebd3f2100dd16" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815836 2559 flags.go:64] FLAG: --qos-reserved="" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815839 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815842 2559 flags.go:64] FLAG: --register-node="true" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815845 2559 flags.go:64] FLAG: --register-schedulable="true" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815848 2559 flags.go:64] FLAG: --register-with-taints="" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815851 2559 flags.go:64] FLAG: --registry-burst="10" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815854 2559 flags.go:64] FLAG: --registry-qps="5" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815857 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815860 2559 flags.go:64] FLAG: --reserved-memory="" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815864 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815867 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815870 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815873 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815876 2559 flags.go:64] FLAG: --runonce="false" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815879 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815882 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815885 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815888 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815891 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815894 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 16:17:02.820677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815898 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815901 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815904 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815907 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815910 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815913 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815916 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815919 2559 flags.go:64] FLAG: --system-cgroups="" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815922 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815927 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815930 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815934 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815938 2559 flags.go:64] FLAG: --tls-min-version="" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815941 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815943 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815946 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815949 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815952 2559 flags.go:64] FLAG: --v="2" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815957 2559 flags.go:64] FLAG: --version="false" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815961 2559 flags.go:64] FLAG: --vmodule="" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815968 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.815971 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816062 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816066 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816070 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:17:02.821315 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816073 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816076 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816078 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816081 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816084 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816086 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816093 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816096 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816100 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816102 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816105 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816107 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816111 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816114 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816117 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816119 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816122 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816124 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816127 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:17:02.821926 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816129 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816133 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816137 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816140 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816143 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816146 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816148 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816151 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816155 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816157 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816160 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816162 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816165 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816168 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816170 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816173 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816176 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816178 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816181 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:17:02.822437 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816185 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816188 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816190 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816193 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816195 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816198 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816200 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816203 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816206 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816209 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816211 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816214 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816216 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816219 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816221 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816224 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816227 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816229 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816231 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816234 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:17:02.822916 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816236 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816241 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816244 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816246 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816249 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816251 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816254 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816256 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816259 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816261 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816264 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816267 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816273 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816276 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816279 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816282 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816284 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816286 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816289 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816292 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:17:02.823404 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816295 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:17:02.823946 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816297 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:17:02.823946 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816300 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:17:02.823946 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816302 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:17:02.823946 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.816305 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:17:02.823946 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.816882 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:17:02.825476 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.825457 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 16:17:02.825508 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.825477 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 16:17:02.825541 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825526 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:17:02.825541 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825532 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:17:02.825541 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825535 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:17:02.825541 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825539 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:17:02.825541 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825542 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825545 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825547 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825551 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825553 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825556 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825558 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825561 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825563 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825566 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825568 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825571 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825573 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825576 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825578 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825581 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825584 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825587 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825589 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:17:02.825668 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825592 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825595 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825598 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825600 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825604 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825606 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825609 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825611 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825614 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825616 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825619 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825622 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825627 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825630 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825633 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825637 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825640 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825643 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825646 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825649 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:17:02.826147 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825652 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825654 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825657 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825660 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825663 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825665 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825668 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825670 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825674 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825676 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825679 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825682 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825684 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825687 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825689 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825692 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825694 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825697 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825701 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825704 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:17:02.826638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825707 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825710 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825712 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825715 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825718 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825720 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825723 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825726 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825729 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825731 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825734 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825736 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825739 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825742 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825745 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825763 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825766 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825769 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825771 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825774 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:17:02.827220 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825776 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825779 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825782 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.825787 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825912 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825917 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825920 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825923 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825926 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825929 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825932 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825935 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825937 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825940 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825942 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:17:02.827715 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825945 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825948 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825950 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825953 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825956 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825959 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825961 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825963 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825966 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825969 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825971 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825975 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825978 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825980 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825983 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825986 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825988 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825990 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825993 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825995 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:17:02.828109 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.825998 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826000 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826003 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826005 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826008 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826010 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826013 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826015 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826017 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826020 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826022 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826025 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826027 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826030 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826032 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826035 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826038 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826040 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826043 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:17:02.828628 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826045 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826048 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826051 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826053 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826055 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826058 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826061 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826063 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826066 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826068 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826071 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826073 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826076 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826078 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826081 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826083 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826086 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826088 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826091 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:17:02.829090 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826095 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826098 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826102 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826104 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826107 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826110 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826112 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826116 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826119 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826123 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826125 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826128 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826130 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826133 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826135 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826138 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:17:02.829546 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:02.826140 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:17:02.829948 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.826145 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:17:02.829948 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.827301 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 16:17:02.832556 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.832542 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 16:17:02.833517 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.833506 2559 server.go:1019] "Starting client certificate rotation" Jun 03 16:17:02.833623 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.833605 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 16:17:02.833656 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.833650 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 16:17:02.859032 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.859006 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 16:17:02.864260 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.864241 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 16:17:02.881356 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.881332 2559 log.go:25] "Validated CRI v1 runtime API" Jun 03 16:17:02.887686 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.887661 2559 log.go:25] "Validated CRI v1 image API" Jun 03 16:17:02.888923 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.888896 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 16:17:02.891349 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.891327 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b256b538-f386-4e41-bdc7-d2f20f413f30:/dev/nvme0n1p4 e698f8d2-41e8-4ae4-b43e-a8c9f6ac9a8b:/dev/nvme0n1p3] Jun 03 16:17:02.891409 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.891349 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 16:17:02.893876 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.893859 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 16:17:02.895642 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.895537 2559 manager.go:217] Machine: {Timestamp:2026-06-03 16:17:02.895035793 +0000 UTC m=+0.412032435 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101772 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24c4f77be9b36a14130e875676775a SystemUUID:ec24c4f7-7be9-b36a-1413-0e875676775a BootID:f53e842a-838c-4c21-ae88-a7a3413f8da4 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:67:4d:01:90:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:67:4d:01:90:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:64:8d:37:66:cf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 16:17:02.896450 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.896438 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 16:17:02.896536 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.896524 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 16:17:02.899782 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.899760 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 16:17:02.899927 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.899785 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-169.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 16:17:02.899977 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.899937 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 16:17:02.899977 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.899946 2559 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 16:17:02.899977 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.899954 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 16:17:02.899977 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.899967 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 16:17:02.901401 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.901391 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 03 16:17:02.901516 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.901507 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 16:17:02.903877 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.903867 2559 kubelet.go:491] "Attempting to sync node with API server" Jun 03 16:17:02.903920 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.903886 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 16:17:02.903920 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.903897 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 16:17:02.903920 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.903909 2559 kubelet.go:397] "Adding apiserver pod source" Jun 03 16:17:02.903920 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.903918 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 16:17:02.905044 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.905030 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 16:17:02.905109 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.905049 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 16:17:02.908378 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.908354 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 16:17:02.910206 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.910192 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 16:17:02.912453 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912439 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 16:17:02.912453 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912456 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 16:17:02.912571 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912465 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 16:17:02.912571 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912471 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 16:17:02.912571 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912479 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 16:17:02.912571 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912486 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 16:17:02.912571 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912492 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 16:17:02.912571 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912498 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 16:17:02.912571 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912505 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 16:17:02.912571 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912511 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 16:17:02.912571 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912527 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 16:17:02.912571 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.912535 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 16:17:02.913357 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.913346 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 16:17:02.913357 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.913357 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 16:17:02.916546 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.916531 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 16:17:02.916707 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.916570 2559 server.go:1295] "Started kubelet" Jun 03 16:17:02.917241 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.917117 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 16:17:02.917241 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.917191 2559 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 16:17:02.917337 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.917246 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 16:17:02.917379 ip-10-0-133-169 systemd[1]: Started Kubernetes Kubelet. Jun 03 16:17:02.918391 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.918367 2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-169.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 16:17:02.918504 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.918396 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 16:17:02.918504 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.918399 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-169.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 16:17:02.918603 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.918549 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 16:17:02.919720 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.919705 2559 server.go:317] "Adding debug handlers to kubelet server" Jun 03 16:17:02.925717 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.925697 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 16:17:02.925846 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.925811 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 16:17:02.926236 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.926210 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 16:17:02.926409 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.926395 2559 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 16:17:02.926479 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.926411 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 16:17:02.926479 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.926454 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 16:17:02.926577 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.926494 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 03 16:17:02.926577 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.926501 2559 reconciler.go:26] "Reconciler: start to sync state" Jun 03 16:17:02.926896 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.926881 2559 factory.go:55] Registering systemd factory Jun 03 16:17:02.926969 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.926900 2559 factory.go:223] Registration of the systemd container factory successfully Jun 03 16:17:02.927058 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.927036 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-169.ec2.internal\" not found" Jun 03 16:17:02.927161 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.927109 2559 factory.go:153] Registering CRI-O factory Jun 03 16:17:02.927161 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.927121 2559 factory.go:223] Registration of the crio container factory successfully Jun 03 16:17:02.927246 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.927171 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 16:17:02.927246 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.927191 2559 factory.go:103] Registering Raw factory Jun 03 16:17:02.927246 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.927202 2559 manager.go:1196] Started watching for new ooms in manager Jun 03 16:17:02.927631 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.927616 2559 manager.go:319] Starting recovery of all containers Jun 03 16:17:02.927777 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.926738 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-169.ec2.internal.18b59e6dfc4ec15b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-169.ec2.internal,UID:ip-10-0-133-169.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-169.ec2.internal,},FirstTimestamp:2026-06-03 16:17:02.916542811 +0000 UTC m=+0.433539454,LastTimestamp:2026-06-03 16:17:02.916542811 +0000 UTC m=+0.433539454,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-169.ec2.internal,}" Jun 03 16:17:02.930796 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.930738 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-169.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 16:17:02.930897 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.930881 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 16:17:02.938196 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.938085 2559 manager.go:324] Recovery completed Jun 03 16:17:02.942554 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.942541 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:17:02.944411 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.944394 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:17:02.944487 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.944423 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:17:02.944487 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.944434 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:17:02.945059 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.945043 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 16:17:02.945059 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.945056 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 16:17:02.945177 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.945074 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 03 16:17:02.946057 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.945995 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-169.ec2.internal.18b59e6dfdf7fab5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-169.ec2.internal,UID:ip-10-0-133-169.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-169.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-169.ec2.internal,},FirstTimestamp:2026-06-03 16:17:02.944410293 +0000 UTC m=+0.461406933,LastTimestamp:2026-06-03 16:17:02.944410293 +0000 UTC m=+0.461406933,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-169.ec2.internal,}" Jun 03 16:17:02.947378 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.947365 2559 policy_none.go:49] "None policy: Start" Jun 03 16:17:02.947422 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.947382 2559 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 16:17:02.947422 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.947393 2559 state_mem.go:35] "Initializing new in-memory state store" Jun 03 16:17:02.950306 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.950288 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dsm6h" Jun 03 16:17:02.955415 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.955350 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-169.ec2.internal.18b59e6dfdf83f96 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-169.ec2.internal,UID:ip-10-0-133-169.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-169.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-169.ec2.internal,},FirstTimestamp:2026-06-03 16:17:02.944427926 +0000 UTC m=+0.461424567,LastTimestamp:2026-06-03 16:17:02.944427926 +0000 UTC m=+0.461424567,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-169.ec2.internal,}" Jun 03 16:17:02.959046 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.959027 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dsm6h" Jun 03 16:17:02.989342 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.989328 2559 manager.go:341] "Starting Device Plugin manager" Jun 03 16:17:02.990467 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.989357 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 16:17:02.990467 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.989368 2559 server.go:85] "Starting device plugin registration server" Jun 03 16:17:02.990467 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.989565 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 16:17:02.990467 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.989576 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 16:17:02.990467 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.989654 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 16:17:02.990467 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.989727 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 16:17:02.990467 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:02.989735 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 16:17:02.990467 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.990340 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 16:17:02.990467 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:02.990382 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-169.ec2.internal\" not found" Jun 03 16:17:03.054144 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.054110 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 16:17:03.055320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.055302 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 16:17:03.055421 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.055328 2559 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 16:17:03.055421 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.055348 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 16:17:03.055421 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.055356 2559 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 16:17:03.055421 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.055389 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 16:17:03.058179 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.058129 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:17:03.090546 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.090520 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:17:03.091395 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.091380 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:17:03.091501 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.091414 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:17:03.091501 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.091431 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:17:03.091501 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.091461 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.102654 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.102635 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.102714 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.102658 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-169.ec2.internal\": node \"ip-10-0-133-169.ec2.internal\" not found" Jun 03 16:17:03.116035 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.116014 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-169.ec2.internal\" not found" Jun 03 16:17:03.155868 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.155845 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-169.ec2.internal"] Jun 03 16:17:03.155976 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.155905 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:17:03.156736 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.156720 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:17:03.156820 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.156768 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:17:03.156820 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.156782 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:17:03.157867 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.157856 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:17:03.158019 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.158006 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.158065 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.158035 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:17:03.158557 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.158539 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:17:03.158626 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.158545 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:17:03.158626 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.158597 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:17:03.158626 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.158610 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:17:03.158626 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.158570 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:17:03.158790 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.158638 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:17:03.159624 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.159610 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.159679 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.159633 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:17:03.160287 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.160274 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:17:03.160351 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.160296 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:17:03.160351 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.160304 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:17:03.175293 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.175277 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-169.ec2.internal\" not found" node="ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.180101 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.180086 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-169.ec2.internal\" not found" node="ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.216531 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.216507 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-169.ec2.internal\" not found" Jun 03 16:17:03.229143 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.229120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ef07b2a1294412403570bdfa95343bd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-169.ec2.internal\" (UID: \"3ef07b2a1294412403570bdfa95343bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.229234 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.229150 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/651ec5e8de9f45a766663148fead78cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal\" (UID: \"651ec5e8de9f45a766663148fead78cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.229234 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.229169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/651ec5e8de9f45a766663148fead78cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal\" (UID: \"651ec5e8de9f45a766663148fead78cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.317344 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.317268 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-169.ec2.internal\" not found" Jun 03 16:17:03.329657 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.329634 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/651ec5e8de9f45a766663148fead78cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal\" (UID: \"651ec5e8de9f45a766663148fead78cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.329713 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.329666 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/651ec5e8de9f45a766663148fead78cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal\" (UID: \"651ec5e8de9f45a766663148fead78cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.329713 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.329689 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ef07b2a1294412403570bdfa95343bd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-169.ec2.internal\" (UID: \"3ef07b2a1294412403570bdfa95343bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.329808 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.329742 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/651ec5e8de9f45a766663148fead78cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal\" (UID: \"651ec5e8de9f45a766663148fead78cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.329808 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.329765 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/651ec5e8de9f45a766663148fead78cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal\" (UID: \"651ec5e8de9f45a766663148fead78cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.329808 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.329742 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3ef07b2a1294412403570bdfa95343bd-config\") pod \"kube-apiserver-proxy-ip-10-0-133-169.ec2.internal\" (UID: \"3ef07b2a1294412403570bdfa95343bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.418062 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.418022 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-169.ec2.internal\" not found" Jun 03 16:17:03.477507 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.477469 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.482868 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.482840 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.518329 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.518299 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-169.ec2.internal\" not found" Jun 03 16:17:03.618817 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.618790 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-169.ec2.internal\" not found" Jun 03 16:17:03.719303 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.719268 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-169.ec2.internal\" not found" Jun 03 16:17:03.726084 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.726065 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:17:03.727014 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.727000 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.737332 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.737310 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 16:17:03.739259 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.739243 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" Jun 03 16:17:03.750053 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.750030 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 16:17:03.834468 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.834444 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 16:17:03.835045 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.834564 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 16:17:03.835045 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.834564 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 16:17:03.904796 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.904722 2559 apiserver.go:52] "Watching apiserver" Jun 03 16:17:03.916318 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.916293 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 16:17:03.916669 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.916650 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7","openshift-cluster-node-tuning-operator/tuned-s7xhr","openshift-dns/node-resolver-l2gc6","openshift-image-registry/node-ca-68nhq","openshift-multus/multus-7tfm8","openshift-multus/multus-additional-cni-plugins-mdldd","openshift-network-diagnostics/network-check-target-mbtmg","openshift-ovn-kubernetes/ovnkube-node-ztm65","kube-system/konnectivity-agent-khlfs","kube-system/kube-apiserver-proxy-ip-10-0-133-169.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal","openshift-multus/network-metrics-daemon-ks9qp","openshift-network-operator/iptables-alerter-2kpnr"] Jun 03 16:17:03.918950 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.918934 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:03.920984 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.920963 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 16:17:03.921092 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.920991 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 16:17:03.921155 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.921136 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 16:17:03.921206 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.921192 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.921255 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.921146 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bqxrb\"" Jun 03 16:17:03.921315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.921297 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l2gc6" Jun 03 16:17:03.922435 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.922419 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-68nhq" Jun 03 16:17:03.923442 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.923414 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.923931 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.923909 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7lkwj\"" Jun 03 16:17:03.923931 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.923925 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 16:17:03.925009 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.924309 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 16:17:03.925009 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.924372 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 16:17:03.925009 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.924400 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:17:03.925009 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.924524 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g7t87\"" Jun 03 16:17:03.925009 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.924566 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 16:17:03.925009 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.924596 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 16:17:03.925009 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.924926 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 16:17:03.925374 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.925044 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zjwzg\"" Jun 03 16:17:03.925374 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.925262 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 16:17:03.925460 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.925384 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:03.927508 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.926379 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 16:17:03.927508 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.926414 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xvgj4\"" Jun 03 16:17:03.927508 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.926426 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 16:17:03.927508 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.926487 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 16:17:03.927508 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.926685 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 16:17:03.927824 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.927666 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:03.928639 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.928613 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:03.928807 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.928791 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 16:17:03.928862 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.928839 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qtxqj\"" Jun 03 16:17:03.930173 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.930158 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 16:17:03.930994 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.930977 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:03.931939 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.931921 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:03.932456 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932440 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-sysctl-d\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.932514 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66a3af12-9718-4e7f-b6e3-ef4b33be72c5-serviceca\") pod \"node-ca-68nhq\" (UID: \"66a3af12-9718-4e7f-b6e3-ef4b33be72c5\") " pod="openshift-image-registry/node-ca-68nhq" Jun 03 16:17:03.932514 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv6sb\" (UniqueName: \"kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb\") pod \"network-check-target-mbtmg\" (UID: \"3ac58c93-4c20-4957-ae6b-27c926ede940\") " pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:03.932514 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932503 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-kubernetes\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.932621 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96cca39a-4a66-4f5c-8406-5232b84ada64-tmp\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.932621 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx6v4\" (UniqueName: \"kubernetes.io/projected/38f3431f-3e93-4762-bb4e-41f7cdeb5c1e-kube-api-access-qx6v4\") pod \"node-resolver-l2gc6\" (UID: \"38f3431f-3e93-4762-bb4e-41f7cdeb5c1e\") " pod="openshift-dns/node-resolver-l2gc6" Jun 03 16:17:03.932688 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66a3af12-9718-4e7f-b6e3-ef4b33be72c5-host\") pod \"node-ca-68nhq\" (UID: \"66a3af12-9718-4e7f-b6e3-ef4b33be72c5\") " pod="openshift-image-registry/node-ca-68nhq" Jun 03 16:17:03.932688 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-cni-dir\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.932795 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932690 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-cni-binary-copy\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.932795 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-var-lib-cni-multus\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.932795 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-daemon-config\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.932952 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932802 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-device-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:03.932952 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:03.932952 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-sys-fs\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:03.932952 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgnbl\" (UniqueName: \"kubernetes.io/projected/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-kube-api-access-xgnbl\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.932952 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932937 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfsv9\" (UniqueName: \"kubernetes.io/projected/f330e926-3979-4e50-b327-88e1b2a7e5ed-kube-api-access-rfsv9\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:03.933145 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932964 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-os-release\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:03.933145 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.932990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8b84af5-f720-4e50-8fda-b9ea46260bf4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:03.933145 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8b84af5-f720-4e50-8fda-b9ea46260bf4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:03.933145 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8b84af5-f720-4e50-8fda-b9ea46260bf4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:03.933145 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-sysconfig\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.933145 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933099 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:03.933355 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:03.933169 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:03.933355 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-run-netns\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.933355 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-var-lib-cni-bin\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.933355 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-etc-kubernetes\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.933355 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-modprobe-d\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.933355 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-sysctl-conf\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.933355 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933254 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 16:17:03.933355 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-lib-modules\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.933631 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933359 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-var-lib-kubelet\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.933631 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933416 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38f3431f-3e93-4762-bb4e-41f7cdeb5c1e-hosts-file\") pod \"node-resolver-l2gc6\" (UID: \"38f3431f-3e93-4762-bb4e-41f7cdeb5c1e\") " pod="openshift-dns/node-resolver-l2gc6" Jun 03 16:17:03.933631 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-run-k8s-cni-cncf-io\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.933631 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-hostroot\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.933631 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933524 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-registration-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:03.933631 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933550 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-system-cni-dir\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:03.933631 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933570 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-systemd\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.933631 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-host\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.933631 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-system-cni-dir\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933639 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-var-lib-kubelet\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-run-multus-certs\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-run\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-tuned\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4dp6\" (UniqueName: \"kubernetes.io/projected/96cca39a-4a66-4f5c-8406-5232b84ada64-kube-api-access-w4dp6\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933835 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-os-release\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-socket-dir-parent\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933881 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-sys\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38f3431f-3e93-4762-bb4e-41f7cdeb5c1e-tmp-dir\") pod \"node-resolver-l2gc6\" (UID: \"38f3431f-3e93-4762-bb4e-41f7cdeb5c1e\") " pod="openshift-dns/node-resolver-l2gc6" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933934 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2glq\" (UniqueName: \"kubernetes.io/projected/66a3af12-9718-4e7f-b6e3-ef4b33be72c5-kube-api-access-g2glq\") pod \"node-ca-68nhq\" (UID: \"66a3af12-9718-4e7f-b6e3-ef4b33be72c5\") " pod="openshift-image-registry/node-ca-68nhq" Jun 03 16:17:03.934025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.933982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-cnibin\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934032 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-conf-dir\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934037 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934126 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-socket-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-cnibin\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934175 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mx2mz\"" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtrk6\" (UniqueName: \"kubernetes.io/projected/f8b84af5-f720-4e50-8fda-b9ea46260bf4-kube-api-access-mtrk6\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934129 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kgx7b\"" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934272 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934035 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934386 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 16:17:03.934628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934466 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 16:17:03.935152 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.934869 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2kpnr" Jun 03 16:17:03.935299 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.935283 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 16:17:03.936606 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.936585 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:17:03.936894 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.936878 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-txncn\"" Jun 03 16:17:03.937232 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.937217 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 16:17:03.937396 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.937379 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 16:17:03.941870 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.941854 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 16:17:03.960510 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.960486 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 16:12:02 +0000 UTC" deadline="2028-02-01 11:20:57.282531505 +0000 UTC" Jun 03 16:17:03.960510 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:03.960507 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14587h3m53.322026573s" Jun 03 16:17:04.005775 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.005736 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gwlhz" Jun 03 16:17:04.013275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.013254 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gwlhz" Jun 03 16:17:04.028049 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.028028 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 16:17:04.031206 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:04.031157 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef07b2a1294412403570bdfa95343bd.slice/crio-90d8289f33e55fec4bd11f7e52c2122372bc1bd0e241bd416e516716aa78b15a WatchSource:0}: Error finding container 90d8289f33e55fec4bd11f7e52c2122372bc1bd0e241bd416e516716aa78b15a: Status 404 returned error can't find the container with id 90d8289f33e55fec4bd11f7e52c2122372bc1bd0e241bd416e516716aa78b15a Jun 03 16:17:04.031735 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:04.031715 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651ec5e8de9f45a766663148fead78cf.slice/crio-452c5163a1c8e281c4b8402f481e808866363105ea23d57855c7c296c14478ed WatchSource:0}: Error finding container 452c5163a1c8e281c4b8402f481e808866363105ea23d57855c7c296c14478ed: Status 404 returned error can't find the container with id 452c5163a1c8e281c4b8402f481e808866363105ea23d57855c7c296c14478ed Jun 03 16:17:04.034367 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034341 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-sys\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.034452 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-slash\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.034452 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.034580 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-sys\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.034580 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034563 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2glq\" (UniqueName: \"kubernetes.io/projected/66a3af12-9718-4e7f-b6e3-ef4b33be72c5-kube-api-access-g2glq\") pod \"node-ca-68nhq\" (UID: \"66a3af12-9718-4e7f-b6e3-ef4b33be72c5\") " pod="openshift-image-registry/node-ca-68nhq" Jun 03 16:17:04.034685 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034602 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-cnibin\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.034685 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034623 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-conf-dir\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.034685 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034668 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-conf-dir\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.034882 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034683 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-cnibin\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.034882 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034785 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.034882 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034822 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-cnibin\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.034882 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034850 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtrk6\" (UniqueName: \"kubernetes.io/projected/f8b84af5-f720-4e50-8fda-b9ea46260bf4-kube-api-access-mtrk6\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.034882 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034877 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-sysctl-d\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034888 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-cnibin\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-kubelet\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034890 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034929 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-kubernetes\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-systemd-units\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034975 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-etc-openvswitch\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.034994 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-sysctl-d\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035022 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-kubernetes\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-node-log\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-cni-bin\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-ovnkube-config\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-env-overrides\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e076f82b-d63c-4077-a194-2e9c142cce9a-host-slash\") pod \"iptables-alerter-2kpnr\" (UID: \"e076f82b-d63c-4077-a194-2e9c142cce9a\") " pod="openshift-network-operator/iptables-alerter-2kpnr" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035185 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38f3431f-3e93-4762-bb4e-41f7cdeb5c1e-hosts-file\") pod \"node-resolver-l2gc6\" (UID: \"38f3431f-3e93-4762-bb4e-41f7cdeb5c1e\") " pod="openshift-dns/node-resolver-l2gc6" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035229 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-host\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035232 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38f3431f-3e93-4762-bb4e-41f7cdeb5c1e-hosts-file\") pod \"node-resolver-l2gc6\" (UID: \"38f3431f-3e93-4762-bb4e-41f7cdeb5c1e\") " pod="openshift-dns/node-resolver-l2gc6" Jun 03 16:17:04.035392 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035252 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-cni-binary-copy\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035274 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-host\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035286 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035297 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-var-lib-cni-multus\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035315 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-sys-fs\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035330 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8b84af5-f720-4e50-8fda-b9ea46260bf4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035368 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgnbl\" (UniqueName: \"kubernetes.io/projected/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-kube-api-access-xgnbl\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035412 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-var-lib-cni-multus\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035441 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-sys-fs\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035462 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-sysconfig\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-run-systemd\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035508 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-sysconfig\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-log-socket\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035565 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-modprobe-d\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e076f82b-d63c-4077-a194-2e9c142cce9a-iptables-alerter-script\") pod \"iptables-alerter-2kpnr\" (UID: \"e076f82b-d63c-4077-a194-2e9c142cce9a\") " pod="openshift-network-operator/iptables-alerter-2kpnr" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035618 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-run-k8s-cni-cncf-io\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035640 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-hostroot\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035661 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-registration-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.036192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035675 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-modprobe-d\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035694 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035723 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-hostroot\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035721 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-run-k8s-cni-cncf-io\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kn6v\" (UniqueName: \"kubernetes.io/projected/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-kube-api-access-4kn6v\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035831 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-cni-binary-copy\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035865 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035920 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-registration-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035922 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-os-release\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035973 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-socket-dir-parent\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.035995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-os-release\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-run-openvswitch\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036056 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-socket-dir-parent\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036101 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-socket-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036127 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66a3af12-9718-4e7f-b6e3-ef4b33be72c5-serviceca\") pod \"node-ca-68nhq\" (UID: \"66a3af12-9718-4e7f-b6e3-ef4b33be72c5\") " pod="openshift-image-registry/node-ca-68nhq" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036134 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8b84af5-f720-4e50-8fda-b9ea46260bf4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036151 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv6sb\" (UniqueName: \"kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb\") pod \"network-check-target-mbtmg\" (UID: \"3ac58c93-4c20-4957-ae6b-27c926ede940\") " pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:04.037169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036176 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96cca39a-4a66-4f5c-8406-5232b84ada64-tmp\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036190 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-socket-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036256 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6v4\" (UniqueName: \"kubernetes.io/projected/38f3431f-3e93-4762-bb4e-41f7cdeb5c1e-kube-api-access-qx6v4\") pod \"node-resolver-l2gc6\" (UID: \"38f3431f-3e93-4762-bb4e-41f7cdeb5c1e\") " pod="openshift-dns/node-resolver-l2gc6" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-ovn-node-metrics-cert\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bklnr\" (UniqueName: \"kubernetes.io/projected/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-kube-api-access-bklnr\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53211488-be94-4a12-acc0-0d4064b9c740-konnectivity-ca\") pod \"konnectivity-agent-khlfs\" (UID: \"53211488-be94-4a12-acc0-0d4064b9c740\") " pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036369 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-systemd\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036408 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-systemd\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036443 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66a3af12-9718-4e7f-b6e3-ef4b33be72c5-host\") pod \"node-ca-68nhq\" (UID: \"66a3af12-9718-4e7f-b6e3-ef4b33be72c5\") " pod="openshift-image-registry/node-ca-68nhq" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036458 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036499 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-cni-dir\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036503 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66a3af12-9718-4e7f-b6e3-ef4b33be72c5-serviceca\") pod \"node-ca-68nhq\" (UID: \"66a3af12-9718-4e7f-b6e3-ef4b33be72c5\") " pod="openshift-image-registry/node-ca-68nhq" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036466 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-cni-dir\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036536 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66a3af12-9718-4e7f-b6e3-ef4b33be72c5-host\") pod \"node-ca-68nhq\" (UID: \"66a3af12-9718-4e7f-b6e3-ef4b33be72c5\") " pod="openshift-image-registry/node-ca-68nhq" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036554 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-daemon-config\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036583 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-device-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036611 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-device-dir\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.037944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036694 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-os-release\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f330e926-3979-4e50-b327-88e1b2a7e5ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036777 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8b84af5-f720-4e50-8fda-b9ea46260bf4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036813 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-os-release\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036825 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-lib-modules\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036877 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-var-lib-kubelet\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036905 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfsv9\" (UniqueName: \"kubernetes.io/projected/f330e926-3979-4e50-b327-88e1b2a7e5ed-kube-api-access-rfsv9\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036933 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8b84af5-f720-4e50-8fda-b9ea46260bf4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-run-netns\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.036987 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-var-lib-openvswitch\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037011 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-var-lib-kubelet\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037032 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-ovnkube-script-lib\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53211488-be94-4a12-acc0-0d4064b9c740-agent-certs\") pod \"konnectivity-agent-khlfs\" (UID: \"53211488-be94-4a12-acc0-0d4064b9c740\") " pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037099 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-run-netns\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037105 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-lib-modules\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037098 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-multus-daemon-config\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037156 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-var-lib-cni-bin\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.038634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037264 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-etc-kubernetes\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8b84af5-f720-4e50-8fda-b9ea46260bf4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037298 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-sysctl-conf\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037326 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38f3431f-3e93-4762-bb4e-41f7cdeb5c1e-tmp-dir\") pod \"node-resolver-l2gc6\" (UID: \"38f3431f-3e93-4762-bb4e-41f7cdeb5c1e\") " pod="openshift-dns/node-resolver-l2gc6" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037340 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-etc-kubernetes\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-run-ovn\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037376 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-var-lib-cni-bin\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037415 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-run-netns\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037414 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037452 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037526 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-system-cni-dir\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037555 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-sysctl-conf\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037543 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8b84af5-f720-4e50-8fda-b9ea46260bf4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037568 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4dp6\" (UniqueName: \"kubernetes.io/projected/96cca39a-4a66-4f5c-8406-5232b84ada64-kube-api-access-w4dp6\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037596 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8b84af5-f720-4e50-8fda-b9ea46260bf4-system-cni-dir\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqbph\" (UniqueName: \"kubernetes.io/projected/e076f82b-d63c-4077-a194-2e9c142cce9a-kube-api-access-fqbph\") pod \"iptables-alerter-2kpnr\" (UID: \"e076f82b-d63c-4077-a194-2e9c142cce9a\") " pod="openshift-network-operator/iptables-alerter-2kpnr" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037680 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38f3431f-3e93-4762-bb4e-41f7cdeb5c1e-tmp-dir\") pod \"node-resolver-l2gc6\" (UID: \"38f3431f-3e93-4762-bb4e-41f7cdeb5c1e\") " pod="openshift-dns/node-resolver-l2gc6" Jun 03 16:17:04.039130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037695 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-system-cni-dir\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.039655 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037713 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-var-lib-kubelet\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.039655 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037729 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-run-multus-certs\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.039655 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037743 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-run\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.039655 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037775 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-system-cni-dir\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.039655 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037799 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-tuned\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.039655 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-cni-netd\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.039655 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-var-lib-kubelet\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.039655 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037824 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96cca39a-4a66-4f5c-8406-5232b84ada64-run\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.039655 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.037881 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-host-run-multus-certs\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.039943 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.039680 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96cca39a-4a66-4f5c-8406-5232b84ada64-tmp\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.040016 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.039997 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96cca39a-4a66-4f5c-8406-5232b84ada64-etc-tuned\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.046258 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.046236 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2glq\" (UniqueName: \"kubernetes.io/projected/66a3af12-9718-4e7f-b6e3-ef4b33be72c5-kube-api-access-g2glq\") pod \"node-ca-68nhq\" (UID: \"66a3af12-9718-4e7f-b6e3-ef4b33be72c5\") " pod="openshift-image-registry/node-ca-68nhq" Jun 03 16:17:04.050895 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.050876 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:17:04.050895 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.050893 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:17:04.051041 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.050902 2559 projected.go:194] Error preparing data for projected volume kube-api-access-mv6sb for pod openshift-network-diagnostics/network-check-target-mbtmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:04.051041 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.050961 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb podName:3ac58c93-4c20-4957-ae6b-27c926ede940 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:04.550937117 +0000 UTC m=+2.067933761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mv6sb" (UniqueName: "kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb") pod "network-check-target-mbtmg" (UID: "3ac58c93-4c20-4957-ae6b-27c926ede940") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:04.053075 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.053049 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtrk6\" (UniqueName: \"kubernetes.io/projected/f8b84af5-f720-4e50-8fda-b9ea46260bf4-kube-api-access-mtrk6\") pod \"multus-additional-cni-plugins-mdldd\" (UID: \"f8b84af5-f720-4e50-8fda-b9ea46260bf4\") " pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.053635 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.053594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfsv9\" (UniqueName: \"kubernetes.io/projected/f330e926-3979-4e50-b327-88e1b2a7e5ed-kube-api-access-rfsv9\") pod \"aws-ebs-csi-driver-node-gg7t7\" (UID: \"f330e926-3979-4e50-b327-88e1b2a7e5ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.054596 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.054574 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4dp6\" (UniqueName: \"kubernetes.io/projected/96cca39a-4a66-4f5c-8406-5232b84ada64-kube-api-access-w4dp6\") pod \"tuned-s7xhr\" (UID: \"96cca39a-4a66-4f5c-8406-5232b84ada64\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.055661 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.055641 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx6v4\" (UniqueName: \"kubernetes.io/projected/38f3431f-3e93-4762-bb4e-41f7cdeb5c1e-kube-api-access-qx6v4\") pod \"node-resolver-l2gc6\" (UID: \"38f3431f-3e93-4762-bb4e-41f7cdeb5c1e\") " pod="openshift-dns/node-resolver-l2gc6" Jun 03 16:17:04.055946 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.055932 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgnbl\" (UniqueName: \"kubernetes.io/projected/162704e6-bff8-4d14-8295-9cb4fcc6d9d6-kube-api-access-xgnbl\") pod \"multus-7tfm8\" (UID: \"162704e6-bff8-4d14-8295-9cb4fcc6d9d6\") " pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.058169 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.058152 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:17:04.058483 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.058446 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-169.ec2.internal" event={"ID":"3ef07b2a1294412403570bdfa95343bd","Type":"ContainerStarted","Data":"90d8289f33e55fec4bd11f7e52c2122372bc1bd0e241bd416e516716aa78b15a"} Jun 03 16:17:04.059543 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.059521 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" event={"ID":"651ec5e8de9f45a766663148fead78cf","Type":"ContainerStarted","Data":"452c5163a1c8e281c4b8402f481e808866363105ea23d57855c7c296c14478ed"} Jun 03 16:17:04.078026 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.077998 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:17:04.138840 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.138811 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kn6v\" (UniqueName: \"kubernetes.io/projected/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-kube-api-access-4kn6v\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:04.138987 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.138844 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-run-openvswitch\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.138987 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.138881 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-ovn-node-metrics-cert\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.138987 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.138902 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bklnr\" (UniqueName: \"kubernetes.io/projected/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-kube-api-access-bklnr\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.138987 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.138926 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53211488-be94-4a12-acc0-0d4064b9c740-konnectivity-ca\") pod \"konnectivity-agent-khlfs\" (UID: \"53211488-be94-4a12-acc0-0d4064b9c740\") " pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:04.138987 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.138927 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-run-openvswitch\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.138987 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.138982 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-run-netns\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139005 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-var-lib-openvswitch\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-var-lib-openvswitch\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139071 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-run-netns\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139119 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-ovnkube-script-lib\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139160 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53211488-be94-4a12-acc0-0d4064b9c740-agent-certs\") pod \"konnectivity-agent-khlfs\" (UID: \"53211488-be94-4a12-acc0-0d4064b9c740\") " pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:04.139275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139193 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-run-ovn\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139221 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139248 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:04.139275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-run-ovn\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139276 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqbph\" (UniqueName: \"kubernetes.io/projected/e076f82b-d63c-4077-a194-2e9c142cce9a-kube-api-access-fqbph\") pod \"iptables-alerter-2kpnr\" (UID: \"e076f82b-d63c-4077-a194-2e9c142cce9a\") " pod="openshift-network-operator/iptables-alerter-2kpnr" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139288 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139318 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-cni-netd\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139347 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-slash\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.139361 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139382 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.139428 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs podName:525a53b8-7bcc-461b-89f0-cb054ce2ddfa nodeName:}" failed. No retries permitted until 2026-06-03 16:17:04.63941097 +0000 UTC m=+2.156407621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs") pod "network-metrics-daemon-ks9qp" (UID: "525a53b8-7bcc-461b-89f0-cb054ce2ddfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139458 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-kubelet\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139485 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-systemd-units\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139507 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-etc-openvswitch\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139532 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-node-log\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139542 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53211488-be94-4a12-acc0-0d4064b9c740-konnectivity-ca\") pod \"konnectivity-agent-khlfs\" (UID: \"53211488-be94-4a12-acc0-0d4064b9c740\") " pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139556 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-cni-bin\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139568 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-systemd-units\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139581 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-ovnkube-config\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139609 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-kubelet\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139616 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-node-log\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.139735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139646 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-etc-openvswitch\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139652 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-cni-bin\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139646 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-env-overrides\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139690 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e076f82b-d63c-4077-a194-2e9c142cce9a-host-slash\") pod \"iptables-alerter-2kpnr\" (UID: \"e076f82b-d63c-4077-a194-2e9c142cce9a\") " pod="openshift-network-operator/iptables-alerter-2kpnr" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-cni-netd\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139616 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139691 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-host-slash\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139715 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-ovnkube-script-lib\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139731 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e076f82b-d63c-4077-a194-2e9c142cce9a-host-slash\") pod \"iptables-alerter-2kpnr\" (UID: \"e076f82b-d63c-4077-a194-2e9c142cce9a\") " pod="openshift-network-operator/iptables-alerter-2kpnr" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139742 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-run-systemd\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139872 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-run-systemd\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139870 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-log-socket\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-log-socket\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.139919 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e076f82b-d63c-4077-a194-2e9c142cce9a-iptables-alerter-script\") pod \"iptables-alerter-2kpnr\" (UID: \"e076f82b-d63c-4077-a194-2e9c142cce9a\") " pod="openshift-network-operator/iptables-alerter-2kpnr" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.140034 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-ovnkube-config\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.140667 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.140037 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-env-overrides\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.141419 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.140715 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e076f82b-d63c-4077-a194-2e9c142cce9a-iptables-alerter-script\") pod \"iptables-alerter-2kpnr\" (UID: \"e076f82b-d63c-4077-a194-2e9c142cce9a\") " pod="openshift-network-operator/iptables-alerter-2kpnr" Jun 03 16:17:04.141419 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.141266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-ovn-node-metrics-cert\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.141978 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.141961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53211488-be94-4a12-acc0-0d4064b9c740-agent-certs\") pod \"konnectivity-agent-khlfs\" (UID: \"53211488-be94-4a12-acc0-0d4064b9c740\") " pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:04.146595 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.146577 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqbph\" (UniqueName: \"kubernetes.io/projected/e076f82b-d63c-4077-a194-2e9c142cce9a-kube-api-access-fqbph\") pod \"iptables-alerter-2kpnr\" (UID: \"e076f82b-d63c-4077-a194-2e9c142cce9a\") " pod="openshift-network-operator/iptables-alerter-2kpnr" Jun 03 16:17:04.146976 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.146960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bklnr\" (UniqueName: \"kubernetes.io/projected/7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1-kube-api-access-bklnr\") pod \"ovnkube-node-ztm65\" (UID: \"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.147036 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.147012 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kn6v\" (UniqueName: \"kubernetes.io/projected/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-kube-api-access-4kn6v\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:04.256325 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.256248 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" Jun 03 16:17:04.263138 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:04.263114 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf330e926_3979_4e50_b327_88e1b2a7e5ed.slice/crio-6d97aa5de80887f7c8b24fae68467481788e80ad7dafff81ffd31de0506c953e WatchSource:0}: Error finding container 6d97aa5de80887f7c8b24fae68467481788e80ad7dafff81ffd31de0506c953e: Status 404 returned error can't find the container with id 6d97aa5de80887f7c8b24fae68467481788e80ad7dafff81ffd31de0506c953e Jun 03 16:17:04.277506 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.277486 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" Jun 03 16:17:04.282929 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:04.282902 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96cca39a_4a66_4f5c_8406_5232b84ada64.slice/crio-4b40e754bab03b20487e444650d6e31bd4c2b21fdd9a106ac962144aef6705cd WatchSource:0}: Error finding container 4b40e754bab03b20487e444650d6e31bd4c2b21fdd9a106ac962144aef6705cd: Status 404 returned error can't find the container with id 4b40e754bab03b20487e444650d6e31bd4c2b21fdd9a106ac962144aef6705cd Jun 03 16:17:04.294820 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.294803 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l2gc6" Jun 03 16:17:04.300160 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.300144 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-68nhq" Jun 03 16:17:04.300462 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:04.300438 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f3431f_3e93_4762_bb4e_41f7cdeb5c1e.slice/crio-392d317f839b8a8902bca198678c6a727289d8239a13e3f896e4b93905aedd02 WatchSource:0}: Error finding container 392d317f839b8a8902bca198678c6a727289d8239a13e3f896e4b93905aedd02: Status 404 returned error can't find the container with id 392d317f839b8a8902bca198678c6a727289d8239a13e3f896e4b93905aedd02 Jun 03 16:17:04.305852 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:04.305832 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a3af12_9718_4e7f_b6e3_ef4b33be72c5.slice/crio-c6d7de701b51db7c545c823e7a636c1a0fcf336b7b334caa490e048ab1b3cc07 WatchSource:0}: Error finding container c6d7de701b51db7c545c823e7a636c1a0fcf336b7b334caa490e048ab1b3cc07: Status 404 returned error can't find the container with id c6d7de701b51db7c545c823e7a636c1a0fcf336b7b334caa490e048ab1b3cc07 Jun 03 16:17:04.317315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.317300 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7tfm8" Jun 03 16:17:04.324221 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:04.324204 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162704e6_bff8_4d14_8295_9cb4fcc6d9d6.slice/crio-6a52cfdc2cbdd8b0b516fa19aa37d031a7ea0c01c32143c1e6fcc5cb8767e02b WatchSource:0}: Error finding container 6a52cfdc2cbdd8b0b516fa19aa37d031a7ea0c01c32143c1e6fcc5cb8767e02b: Status 404 returned error can't find the container with id 6a52cfdc2cbdd8b0b516fa19aa37d031a7ea0c01c32143c1e6fcc5cb8767e02b Jun 03 16:17:04.344043 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.344019 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdldd" Jun 03 16:17:04.349657 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.349633 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:04.350296 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:04.350233 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b84af5_f720_4e50_8fda_b9ea46260bf4.slice/crio-2646890e27740f6420f2307279c35a2f7b9885f12ed6c53f3448ae86a4d3c67a WatchSource:0}: Error finding container 2646890e27740f6420f2307279c35a2f7b9885f12ed6c53f3448ae86a4d3c67a: Status 404 returned error can't find the container with id 2646890e27740f6420f2307279c35a2f7b9885f12ed6c53f3448ae86a4d3c67a Jun 03 16:17:04.356487 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.356243 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:04.356579 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:04.356492 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5e7ac5_c8d1_4c58_8bf3_32988a0d5ac1.slice/crio-509a9e219f085ed97e3706ad47466aadad11966d1d482884e311165a49a5bd8b WatchSource:0}: Error finding container 509a9e219f085ed97e3706ad47466aadad11966d1d482884e311165a49a5bd8b: Status 404 returned error can't find the container with id 509a9e219f085ed97e3706ad47466aadad11966d1d482884e311165a49a5bd8b Jun 03 16:17:04.361516 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.361494 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2kpnr" Jun 03 16:17:04.364595 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:04.364570 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53211488_be94_4a12_acc0_0d4064b9c740.slice/crio-b749bbe446596b3de9165530588ff1c0a9310a5798ce2fa00e14abdce531686a WatchSource:0}: Error finding container b749bbe446596b3de9165530588ff1c0a9310a5798ce2fa00e14abdce531686a: Status 404 returned error can't find the container with id b749bbe446596b3de9165530588ff1c0a9310a5798ce2fa00e14abdce531686a Jun 03 16:17:04.371843 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:04.371817 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode076f82b_d63c_4077_a194_2e9c142cce9a.slice/crio-1e4a89f3ae038c6d37d358f044bbe7418612946c2b2efdc9d02be9d662216a79 WatchSource:0}: Error finding container 1e4a89f3ae038c6d37d358f044bbe7418612946c2b2efdc9d02be9d662216a79: Status 404 returned error can't find the container with id 1e4a89f3ae038c6d37d358f044bbe7418612946c2b2efdc9d02be9d662216a79 Jun 03 16:17:04.644426 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.644390 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv6sb\" (UniqueName: \"kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb\") pod \"network-check-target-mbtmg\" (UID: \"3ac58c93-4c20-4957-ae6b-27c926ede940\") " pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:04.644609 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:04.644457 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:04.644609 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.644569 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:04.644725 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.644626 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs podName:525a53b8-7bcc-461b-89f0-cb054ce2ddfa nodeName:}" failed. No retries permitted until 2026-06-03 16:17:05.644605771 +0000 UTC m=+3.161602416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs") pod "network-metrics-daemon-ks9qp" (UID: "525a53b8-7bcc-461b-89f0-cb054ce2ddfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:04.644725 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.644692 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:17:04.644725 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.644717 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:17:04.644916 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.644729 2559 projected.go:194] Error preparing data for projected volume kube-api-access-mv6sb for pod openshift-network-diagnostics/network-check-target-mbtmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:04.644916 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:04.644800 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb podName:3ac58c93-4c20-4957-ae6b-27c926ede940 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:05.644781642 +0000 UTC m=+3.161778271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv6sb" (UniqueName: "kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb") pod "network-check-target-mbtmg" (UID: "3ac58c93-4c20-4957-ae6b-27c926ede940") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:05.014764 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.014660 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:12:04 +0000 UTC" deadline="2028-02-01 02:29:35.115032764 +0000 UTC" Jun 03 16:17:05.014764 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.014703 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14578h12m30.100334578s" Jun 03 16:17:05.078954 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.078912 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdldd" event={"ID":"f8b84af5-f720-4e50-8fda-b9ea46260bf4","Type":"ContainerStarted","Data":"2646890e27740f6420f2307279c35a2f7b9885f12ed6c53f3448ae86a4d3c67a"} Jun 03 16:17:05.084972 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.084939 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l2gc6" event={"ID":"38f3431f-3e93-4762-bb4e-41f7cdeb5c1e","Type":"ContainerStarted","Data":"392d317f839b8a8902bca198678c6a727289d8239a13e3f896e4b93905aedd02"} Jun 03 16:17:05.091503 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.091446 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" event={"ID":"f330e926-3979-4e50-b327-88e1b2a7e5ed","Type":"ContainerStarted","Data":"6d97aa5de80887f7c8b24fae68467481788e80ad7dafff81ffd31de0506c953e"} Jun 03 16:17:05.112092 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.112028 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2kpnr" event={"ID":"e076f82b-d63c-4077-a194-2e9c142cce9a","Type":"ContainerStarted","Data":"1e4a89f3ae038c6d37d358f044bbe7418612946c2b2efdc9d02be9d662216a79"} Jun 03 16:17:05.122192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.122129 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" event={"ID":"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1","Type":"ContainerStarted","Data":"509a9e219f085ed97e3706ad47466aadad11966d1d482884e311165a49a5bd8b"} Jun 03 16:17:05.133989 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.133956 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7tfm8" event={"ID":"162704e6-bff8-4d14-8295-9cb4fcc6d9d6","Type":"ContainerStarted","Data":"6a52cfdc2cbdd8b0b516fa19aa37d031a7ea0c01c32143c1e6fcc5cb8767e02b"} Jun 03 16:17:05.149766 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.149406 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-68nhq" event={"ID":"66a3af12-9718-4e7f-b6e3-ef4b33be72c5","Type":"ContainerStarted","Data":"c6d7de701b51db7c545c823e7a636c1a0fcf336b7b334caa490e048ab1b3cc07"} Jun 03 16:17:05.153663 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.153636 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" event={"ID":"96cca39a-4a66-4f5c-8406-5232b84ada64","Type":"ContainerStarted","Data":"4b40e754bab03b20487e444650d6e31bd4c2b21fdd9a106ac962144aef6705cd"} Jun 03 16:17:05.158468 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.158445 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-khlfs" event={"ID":"53211488-be94-4a12-acc0-0d4064b9c740","Type":"ContainerStarted","Data":"b749bbe446596b3de9165530588ff1c0a9310a5798ce2fa00e14abdce531686a"} Jun 03 16:17:05.242763 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.242718 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:17:05.653708 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.653666 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv6sb\" (UniqueName: \"kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb\") pod \"network-check-target-mbtmg\" (UID: \"3ac58c93-4c20-4957-ae6b-27c926ede940\") " pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:05.653909 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:05.653733 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:05.653909 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:05.653891 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:05.654033 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:05.654019 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs podName:525a53b8-7bcc-461b-89f0-cb054ce2ddfa nodeName:}" failed. No retries permitted until 2026-06-03 16:17:07.653994435 +0000 UTC m=+5.170991067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs") pod "network-metrics-daemon-ks9qp" (UID: "525a53b8-7bcc-461b-89f0-cb054ce2ddfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:05.654126 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:05.654111 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:17:05.654185 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:05.654131 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:17:05.654185 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:05.654144 2559 projected.go:194] Error preparing data for projected volume kube-api-access-mv6sb for pod openshift-network-diagnostics/network-check-target-mbtmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:05.654185 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:05.654182 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb podName:3ac58c93-4c20-4957-ae6b-27c926ede940 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:07.654170075 +0000 UTC m=+5.171166705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv6sb" (UniqueName: "kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb") pod "network-check-target-mbtmg" (UID: "3ac58c93-4c20-4957-ae6b-27c926ede940") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:06.016022 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:06.015939 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:12:04 +0000 UTC" deadline="2028-03-15 08:34:57.842688286 +0000 UTC" Jun 03 16:17:06.016022 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:06.015971 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15616h17m51.826720135s" Jun 03 16:17:06.016517 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:06.016404 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:17:06.059808 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:06.059775 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:06.059984 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:06.059899 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:06.060388 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:06.060365 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:06.060488 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:06.060467 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:07.673587 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:07.672930 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv6sb\" (UniqueName: \"kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb\") pod \"network-check-target-mbtmg\" (UID: \"3ac58c93-4c20-4957-ae6b-27c926ede940\") " pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:07.673587 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:07.673007 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:07.673587 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:07.673179 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:07.673587 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:07.673188 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:17:07.673587 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:07.673219 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:17:07.673587 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:07.673231 2559 projected.go:194] Error preparing data for projected volume kube-api-access-mv6sb for pod openshift-network-diagnostics/network-check-target-mbtmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:07.673587 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:07.673247 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs podName:525a53b8-7bcc-461b-89f0-cb054ce2ddfa nodeName:}" failed. No retries permitted until 2026-06-03 16:17:11.673227519 +0000 UTC m=+9.190224161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs") pod "network-metrics-daemon-ks9qp" (UID: "525a53b8-7bcc-461b-89f0-cb054ce2ddfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:07.673587 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:07.673275 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb podName:3ac58c93-4c20-4957-ae6b-27c926ede940 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:11.673262942 +0000 UTC m=+9.190259570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv6sb" (UniqueName: "kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb") pod "network-check-target-mbtmg" (UID: "3ac58c93-4c20-4957-ae6b-27c926ede940") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:08.056144 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:08.056069 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:08.056314 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:08.056069 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:08.056314 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:08.056220 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:08.056314 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:08.056263 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:09.759789 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:09.759735 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zkx42"] Jun 03 16:17:09.762650 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:09.762625 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:09.762799 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:09.762703 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:09.792810 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:09.792778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:09.792984 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:09.792829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1f85abe-3593-4155-99a9-696dde6fb845-dbus\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:09.792984 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:09.792856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1f85abe-3593-4155-99a9-696dde6fb845-kubelet-config\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:09.893342 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:09.893309 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:09.893493 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:09.893352 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1f85abe-3593-4155-99a9-696dde6fb845-dbus\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:09.893493 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:09.893372 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1f85abe-3593-4155-99a9-696dde6fb845-kubelet-config\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:09.893493 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:09.893468 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1f85abe-3593-4155-99a9-696dde6fb845-kubelet-config\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:09.893493 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:09.893464 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:09.893632 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:09.893525 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1f85abe-3593-4155-99a9-696dde6fb845-dbus\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:09.893632 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:09.893548 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret podName:c1f85abe-3593-4155-99a9-696dde6fb845 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:10.393533517 +0000 UTC m=+7.910530145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret") pod "global-pull-secret-syncer-zkx42" (UID: "c1f85abe-3593-4155-99a9-696dde6fb845") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:10.056404 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:10.056318 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:10.056404 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:10.056341 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:10.056598 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:10.056482 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:10.056598 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:10.056569 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:10.397506 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:10.397469 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:10.397709 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:10.397638 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:10.397788 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:10.397717 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret podName:c1f85abe-3593-4155-99a9-696dde6fb845 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:11.397696041 +0000 UTC m=+8.914692672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret") pod "global-pull-secret-syncer-zkx42" (UID: "c1f85abe-3593-4155-99a9-696dde6fb845") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:11.405989 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:11.405951 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:11.406452 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:11.406124 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:11.406452 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:11.406207 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret podName:c1f85abe-3593-4155-99a9-696dde6fb845 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:13.406183924 +0000 UTC m=+10.923180557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret") pod "global-pull-secret-syncer-zkx42" (UID: "c1f85abe-3593-4155-99a9-696dde6fb845") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:11.708102 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:11.708023 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:11.708243 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:11.708124 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv6sb\" (UniqueName: \"kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb\") pod \"network-check-target-mbtmg\" (UID: \"3ac58c93-4c20-4957-ae6b-27c926ede940\") " pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:11.708243 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:11.708185 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:11.708350 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:11.708254 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs podName:525a53b8-7bcc-461b-89f0-cb054ce2ddfa nodeName:}" failed. No retries permitted until 2026-06-03 16:17:19.708237036 +0000 UTC m=+17.225233675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs") pod "network-metrics-daemon-ks9qp" (UID: "525a53b8-7bcc-461b-89f0-cb054ce2ddfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:11.708350 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:11.708257 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:17:11.708350 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:11.708276 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:17:11.708350 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:11.708290 2559 projected.go:194] Error preparing data for projected volume kube-api-access-mv6sb for pod openshift-network-diagnostics/network-check-target-mbtmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:11.708350 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:11.708337 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb podName:3ac58c93-4c20-4957-ae6b-27c926ede940 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:19.708322124 +0000 UTC m=+17.225318754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv6sb" (UniqueName: "kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb") pod "network-check-target-mbtmg" (UID: "3ac58c93-4c20-4957-ae6b-27c926ede940") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:12.056065 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:12.055980 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:12.056065 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:12.056012 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:12.056282 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:12.055993 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:12.056282 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:12.056121 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:12.056282 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:12.056247 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:12.056431 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:12.056314 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:13.423432 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:13.423391 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:13.423931 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:13.423532 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:13.423931 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:13.423601 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret podName:c1f85abe-3593-4155-99a9-696dde6fb845 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:17.423581858 +0000 UTC m=+14.940578506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret") pod "global-pull-secret-syncer-zkx42" (UID: "c1f85abe-3593-4155-99a9-696dde6fb845") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:14.056477 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:14.056450 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:14.056668 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:14.056450 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:14.056668 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:14.056563 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:14.056821 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:14.056665 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:14.056821 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:14.056458 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:14.056821 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:14.056803 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:16.055831 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:16.055799 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:16.056283 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:16.055799 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:16.056283 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:16.055930 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:16.056283 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:16.056019 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:16.056283 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:16.055813 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:16.056283 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:16.056115 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:17.455112 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:17.455074 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:17.455575 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:17.455195 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:17.455575 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:17.455272 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret podName:c1f85abe-3593-4155-99a9-696dde6fb845 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:25.455252192 +0000 UTC m=+22.972248820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret") pod "global-pull-secret-syncer-zkx42" (UID: "c1f85abe-3593-4155-99a9-696dde6fb845") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:18.055795 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:18.055745 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:18.056029 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:18.055811 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:18.056029 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:18.055763 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:18.056029 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:18.055874 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:18.056029 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:18.055970 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:18.056188 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:18.056031 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:19.773920 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:19.773665 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv6sb\" (UniqueName: \"kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb\") pod \"network-check-target-mbtmg\" (UID: \"3ac58c93-4c20-4957-ae6b-27c926ede940\") " pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:19.774427 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:19.773966 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:19.774427 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:19.773869 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:17:19.774427 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:19.774016 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:17:19.774427 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:19.774031 2559 projected.go:194] Error preparing data for projected volume kube-api-access-mv6sb for pod openshift-network-diagnostics/network-check-target-mbtmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:19.774427 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:19.774086 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:19.774427 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:19.774089 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb podName:3ac58c93-4c20-4957-ae6b-27c926ede940 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:35.774068923 +0000 UTC m=+33.291065553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv6sb" (UniqueName: "kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb") pod "network-check-target-mbtmg" (UID: "3ac58c93-4c20-4957-ae6b-27c926ede940") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:19.774427 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:19.774144 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs podName:525a53b8-7bcc-461b-89f0-cb054ce2ddfa nodeName:}" failed. No retries permitted until 2026-06-03 16:17:35.774127755 +0000 UTC m=+33.291124383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs") pod "network-metrics-daemon-ks9qp" (UID: "525a53b8-7bcc-461b-89f0-cb054ce2ddfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:20.055979 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:20.055885 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:20.056129 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:20.055885 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:20.056129 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:20.056028 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:20.056129 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:20.055894 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:20.056328 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:20.056122 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:20.056328 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:20.056238 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:22.055995 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:22.055946 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:22.056437 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:22.055946 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:22.056437 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:22.056072 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:22.056437 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:22.055946 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:22.056437 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:22.056143 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:22.056437 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:22.056261 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:23.207588 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:23.207492 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-169.ec2.internal" event={"ID":"3ef07b2a1294412403570bdfa95343bd","Type":"ContainerStarted","Data":"7f722ee342e40b290b213cba06d4d5dac7a431c2ec7ae30686f65ce3b4bb5e68"} Jun 03 16:17:23.219294 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:23.219256 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-169.ec2.internal" podStartSLOduration=20.219241807 podStartE2EDuration="20.219241807s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:17:23.218563297 +0000 UTC m=+20.735559949" watchObservedRunningTime="2026-06-03 16:17:23.219241807 +0000 UTC m=+20.736238458" Jun 03 16:17:24.056103 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.055715 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:24.056258 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.055770 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:24.056258 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:24.056144 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:24.056258 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.055800 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:24.056258 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:24.056182 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:24.056258 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:24.056252 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:24.210948 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.210916 2559 generic.go:358] "Generic (PLEG): container finished" podID="651ec5e8de9f45a766663148fead78cf" containerID="a60b9d0d825659abea97a5347be6df7ca068d75fe7fb1c6f906d7f557eb7bc5c" exitCode=0 Jun 03 16:17:24.211786 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.211001 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" event={"ID":"651ec5e8de9f45a766663148fead78cf","Type":"ContainerDied","Data":"a60b9d0d825659abea97a5347be6df7ca068d75fe7fb1c6f906d7f557eb7bc5c"} Jun 03 16:17:24.212708 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.212683 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-khlfs" event={"ID":"53211488-be94-4a12-acc0-0d4064b9c740","Type":"ContainerStarted","Data":"c905cc58ca94cf713c1657c5e2dad1c0f242650854d748d5a5f8d293c3739b06"} Jun 03 16:17:24.214120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.214093 2559 generic.go:358] "Generic (PLEG): container finished" podID="f8b84af5-f720-4e50-8fda-b9ea46260bf4" containerID="9bda0284b4cac413e2755e2849c0c2004ad9cb2ddb4883f8d073121cc925fad7" exitCode=0 Jun 03 16:17:24.214228 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.214178 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdldd" event={"ID":"f8b84af5-f720-4e50-8fda-b9ea46260bf4","Type":"ContainerDied","Data":"9bda0284b4cac413e2755e2849c0c2004ad9cb2ddb4883f8d073121cc925fad7"} Jun 03 16:17:24.215892 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.215856 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l2gc6" event={"ID":"38f3431f-3e93-4762-bb4e-41f7cdeb5c1e","Type":"ContainerStarted","Data":"23e17bb8159b7698ff9909bc35f7ee68022239087ef361bf5bcdf976ed40308f"} Jun 03 16:17:24.217334 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.217311 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" event={"ID":"f330e926-3979-4e50-b327-88e1b2a7e5ed","Type":"ContainerStarted","Data":"a0f96cd9de685edf9b4f4f8b6e7fcade45d3b0fca4161eb840f0f213eb577b94"} Jun 03 16:17:24.220427 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.220407 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztm65_7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1/ovn-acl-logging/0.log" Jun 03 16:17:24.220774 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.220729 2559 generic.go:358] "Generic (PLEG): container finished" podID="7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1" containerID="783ee2ac49f465545c973a1eda8fc84cd8e49c264036fd57a6e666b66ac723de" exitCode=1 Jun 03 16:17:24.220879 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.220779 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" event={"ID":"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1","Type":"ContainerStarted","Data":"c37f908954fcd41d69d67f371909a19eda64e533a129f06a7a73e59da90c8e43"} Jun 03 16:17:24.220949 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.220881 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" event={"ID":"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1","Type":"ContainerStarted","Data":"51b7cdc216f849f7f40b1eb79fa1c86fbc9c7d1f8220502ca7a552a154ac79f1"} Jun 03 16:17:24.220949 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.220900 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" event={"ID":"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1","Type":"ContainerStarted","Data":"012bc8d3258cf2d3767010e7d0b457a42e48d9c2ecee53cf59889f4b486c0bb6"} Jun 03 16:17:24.220949 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.220912 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" event={"ID":"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1","Type":"ContainerStarted","Data":"0358c4e3221a76a570b48b83bdbad340b1202e24659f501e556bd7056501509c"} Jun 03 16:17:24.221149 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.220960 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" event={"ID":"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1","Type":"ContainerDied","Data":"783ee2ac49f465545c973a1eda8fc84cd8e49c264036fd57a6e666b66ac723de"} Jun 03 16:17:24.221149 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.220975 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" event={"ID":"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1","Type":"ContainerStarted","Data":"87c3e7ad39830b91977cddc459c664bfce0e8c25f3c2ebf4c37abf326d91f86b"} Jun 03 16:17:24.222410 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.222388 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7tfm8" event={"ID":"162704e6-bff8-4d14-8295-9cb4fcc6d9d6","Type":"ContainerStarted","Data":"0b31eac2722bc75f2c12c1fc78cb869e4a02c3bba486b15fc689d80889135d00"} Jun 03 16:17:24.224143 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.224120 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-68nhq" event={"ID":"66a3af12-9718-4e7f-b6e3-ef4b33be72c5","Type":"ContainerStarted","Data":"4f31765f7b2d51db8acf7b9d888e5a61b093435b920cc3f50085450b9999bd2a"} Jun 03 16:17:24.225512 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.225491 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" event={"ID":"96cca39a-4a66-4f5c-8406-5232b84ada64","Type":"ContainerStarted","Data":"16f0f7aab5edf6ccc512386a5fe8dcaa7ee93354628e293ab4bf8c18c1fa6e11"} Jun 03 16:17:24.285525 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.285479 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-khlfs" podStartSLOduration=11.025657989 podStartE2EDuration="21.285463426s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="2026-06-03 16:17:04.368926108 +0000 UTC m=+1.885922747" lastFinishedPulling="2026-06-03 16:17:14.62873154 +0000 UTC m=+12.145728184" observedRunningTime="2026-06-03 16:17:24.259052455 +0000 UTC m=+21.776049107" watchObservedRunningTime="2026-06-03 16:17:24.285463426 +0000 UTC m=+21.802460077" Jun 03 16:17:24.285869 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.285840 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-l2gc6" podStartSLOduration=2.5196442340000003 podStartE2EDuration="21.285831764s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="2026-06-03 16:17:04.303065033 +0000 UTC m=+1.820061661" lastFinishedPulling="2026-06-03 16:17:23.069252557 +0000 UTC m=+20.586249191" observedRunningTime="2026-06-03 16:17:24.285342191 +0000 UTC m=+21.802338841" watchObservedRunningTime="2026-06-03 16:17:24.285831764 +0000 UTC m=+21.802828413" Jun 03 16:17:24.305607 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.305571 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-7tfm8" podStartSLOduration=2.4569364670000002 podStartE2EDuration="21.305556917s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="2026-06-03 16:17:04.325786526 +0000 UTC m=+1.842783154" lastFinishedPulling="2026-06-03 16:17:23.174406959 +0000 UTC m=+20.691403604" observedRunningTime="2026-06-03 16:17:24.305143518 +0000 UTC m=+21.822140168" watchObservedRunningTime="2026-06-03 16:17:24.305556917 +0000 UTC m=+21.822553567" Jun 03 16:17:24.321132 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.321093 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s7xhr" podStartSLOduration=2.535970586 podStartE2EDuration="21.321077744s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="2026-06-03 16:17:04.284425836 +0000 UTC m=+1.801422464" lastFinishedPulling="2026-06-03 16:17:23.069532989 +0000 UTC m=+20.586529622" observedRunningTime="2026-06-03 16:17:24.320986219 +0000 UTC m=+21.837982869" watchObservedRunningTime="2026-06-03 16:17:24.321077744 +0000 UTC m=+21.838074394" Jun 03 16:17:24.336412 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.335990 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-68nhq" podStartSLOduration=11.014593848 podStartE2EDuration="21.335966013s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="2026-06-03 16:17:04.307300001 +0000 UTC m=+1.824296629" lastFinishedPulling="2026-06-03 16:17:14.628672162 +0000 UTC m=+12.145668794" observedRunningTime="2026-06-03 16:17:24.335836882 +0000 UTC m=+21.852833530" watchObservedRunningTime="2026-06-03 16:17:24.335966013 +0000 UTC m=+21.852962664" Jun 03 16:17:24.671192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.671169 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 16:17:24.758713 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.758686 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:24.759878 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:24.759851 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:25.001638 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:25.001550 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T16:17:24.671187832Z","UUID":"45e652cc-3a7b-4a35-87ea-459d1a83b2e3","Handler":null,"Name":"","Endpoint":""} Jun 03 16:17:25.003788 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:25.003766 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 16:17:25.003788 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:25.003791 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 16:17:25.229999 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:25.229967 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" event={"ID":"651ec5e8de9f45a766663148fead78cf","Type":"ContainerStarted","Data":"75b6b06b983dd384266b509154fb81ec9aaac25aae90eaaacc60ae14fc5a7c1f"} Jun 03 16:17:25.233493 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:25.232891 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" event={"ID":"f330e926-3979-4e50-b327-88e1b2a7e5ed","Type":"ContainerStarted","Data":"8306b779abcd73aeba75891f154ff727cbb58bafb004e21607ad791f5008924e"} Jun 03 16:17:25.234547 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:25.234519 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2kpnr" event={"ID":"e076f82b-d63c-4077-a194-2e9c142cce9a","Type":"ContainerStarted","Data":"284a4dfc179f9071c71416770c9c5462e8ef6949795eae24b2d77ba8508e13fb"} Jun 03 16:17:25.235326 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:25.235307 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:25.235687 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:25.235669 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-khlfs" Jun 03 16:17:25.251352 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:25.251278 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-169.ec2.internal" podStartSLOduration=22.251261427 podStartE2EDuration="22.251261427s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:17:25.250384918 +0000 UTC m=+22.767381569" watchObservedRunningTime="2026-06-03 16:17:25.251261427 +0000 UTC m=+22.768258078" Jun 03 16:17:25.265281 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:25.264861 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2kpnr" podStartSLOduration=3.568977736 podStartE2EDuration="22.264845656s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="2026-06-03 16:17:04.373805127 +0000 UTC m=+1.890801758" lastFinishedPulling="2026-06-03 16:17:23.06967305 +0000 UTC m=+20.586669678" observedRunningTime="2026-06-03 16:17:25.264610584 +0000 UTC m=+22.781607235" watchObservedRunningTime="2026-06-03 16:17:25.264845656 +0000 UTC m=+22.781842308" Jun 03 16:17:25.519026 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:25.518946 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:25.519201 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:25.519082 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:25.519201 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:25.519145 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret podName:c1f85abe-3593-4155-99a9-696dde6fb845 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:41.519126462 +0000 UTC m=+39.036123093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret") pod "global-pull-secret-syncer-zkx42" (UID: "c1f85abe-3593-4155-99a9-696dde6fb845") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:17:26.056521 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:26.056442 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:26.056683 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:26.056442 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:26.056683 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:26.056550 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:26.056683 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:26.056441 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:26.056873 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:26.056624 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:26.056873 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:26.056735 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:26.238632 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:26.238605 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztm65_7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1/ovn-acl-logging/0.log" Jun 03 16:17:26.239045 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:26.238956 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" event={"ID":"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1","Type":"ContainerStarted","Data":"e2d0ef1bbc283420d513f14d938c0e2f3bec56aa09beb3bdebb9999c7777dacc"} Jun 03 16:17:26.240616 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:26.240588 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" event={"ID":"f330e926-3979-4e50-b327-88e1b2a7e5ed","Type":"ContainerStarted","Data":"edd87e1ab8f623c799243cc4304782d28d0c3dad372aaba92415d5baf67e72ac"} Jun 03 16:17:26.257067 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:26.257013 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gg7t7" podStartSLOduration=1.964253048 podStartE2EDuration="23.256998262s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="2026-06-03 16:17:04.264632062 +0000 UTC m=+1.781628689" lastFinishedPulling="2026-06-03 16:17:25.557377262 +0000 UTC m=+23.074373903" observedRunningTime="2026-06-03 16:17:26.256796023 +0000 UTC m=+23.773792675" watchObservedRunningTime="2026-06-03 16:17:26.256998262 +0000 UTC m=+23.773995116" Jun 03 16:17:28.055851 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:28.055682 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:28.056433 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:28.055743 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:28.056433 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:28.055941 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:28.056433 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:28.055769 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:28.056433 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:28.056023 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:28.056433 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:28.056141 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:28.248361 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:28.248291 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztm65_7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1/ovn-acl-logging/0.log" Jun 03 16:17:28.248705 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:28.248671 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" event={"ID":"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1","Type":"ContainerStarted","Data":"f832e81eef80673fe108ece497ce5fc8b8137a3a354d5fda5e4306fa48d30da7"} Jun 03 16:17:28.249064 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:28.249043 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:28.249236 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:28.249213 2559 scope.go:117] "RemoveContainer" containerID="783ee2ac49f465545c973a1eda8fc84cd8e49c264036fd57a6e666b66ac723de" Jun 03 16:17:28.266919 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:28.266901 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:29.876023 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:29.875994 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zkx42"] Jun 03 16:17:29.876636 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:29.876106 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:29.876636 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:29.876182 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:29.878605 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:29.878580 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ks9qp"] Jun 03 16:17:29.878703 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:29.878674 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:29.878800 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:29.878778 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:29.889928 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:29.889902 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mbtmg"] Jun 03 16:17:29.890022 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:29.889996 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:29.890101 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:29.890083 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:30.254808 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:30.254782 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztm65_7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1/ovn-acl-logging/0.log" Jun 03 16:17:30.255177 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:30.255141 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" event={"ID":"7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1","Type":"ContainerStarted","Data":"1c5c66fabc6e55b538344a90754023057c3f8979c0a89787dce372d1661f26a8"} Jun 03 16:17:30.255476 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:30.255457 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:30.255585 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:30.255549 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:30.256809 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:30.256788 2559 generic.go:358] "Generic (PLEG): container finished" podID="f8b84af5-f720-4e50-8fda-b9ea46260bf4" containerID="d394868aca3b2e631a0cb0ac2e5998d12bebc2fd40095c4f0ebcff571ce07980" exitCode=0 Jun 03 16:17:30.256903 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:30.256823 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdldd" event={"ID":"f8b84af5-f720-4e50-8fda-b9ea46260bf4","Type":"ContainerDied","Data":"d394868aca3b2e631a0cb0ac2e5998d12bebc2fd40095c4f0ebcff571ce07980"} Jun 03 16:17:30.269951 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:30.269932 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:17:30.286626 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:30.286548 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" podStartSLOduration=8.536465846 podStartE2EDuration="27.286536396s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="2026-06-03 16:17:04.35999674 +0000 UTC m=+1.876993368" lastFinishedPulling="2026-06-03 16:17:23.110067285 +0000 UTC m=+20.627063918" observedRunningTime="2026-06-03 16:17:30.285972434 +0000 UTC m=+27.802969083" watchObservedRunningTime="2026-06-03 16:17:30.286536396 +0000 UTC m=+27.803533067" Jun 03 16:17:31.056390 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:31.056135 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:31.056777 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:31.056160 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:31.056777 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:31.056505 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:31.056777 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:31.056530 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:32.055908 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:32.055874 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:32.056070 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:32.055992 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:32.262369 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:32.262261 2559 generic.go:358] "Generic (PLEG): container finished" podID="f8b84af5-f720-4e50-8fda-b9ea46260bf4" containerID="4ea88a54ca420e84f05d4c69a8b5a9ac4dac3f52ac7d1e18d1cc78299c81024a" exitCode=0 Jun 03 16:17:32.262369 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:32.262349 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdldd" event={"ID":"f8b84af5-f720-4e50-8fda-b9ea46260bf4","Type":"ContainerDied","Data":"4ea88a54ca420e84f05d4c69a8b5a9ac4dac3f52ac7d1e18d1cc78299c81024a"} Jun 03 16:17:32.277921 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:32.277882 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" podUID="7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1" containerName="ovnkube-controller" probeResult="failure" output="" Jun 03 16:17:33.057139 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:33.057106 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:33.057246 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:33.057221 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:33.057336 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:33.057308 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:33.057509 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:33.057483 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:33.265878 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:33.265835 2559 generic.go:358] "Generic (PLEG): container finished" podID="f8b84af5-f720-4e50-8fda-b9ea46260bf4" containerID="e006f762a20d5575a7dcaed98742a76e02d6cf32d4bdd5d818007357fff6c8e7" exitCode=0 Jun 03 16:17:33.266292 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:33.265895 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdldd" event={"ID":"f8b84af5-f720-4e50-8fda-b9ea46260bf4","Type":"ContainerDied","Data":"e006f762a20d5575a7dcaed98742a76e02d6cf32d4bdd5d818007357fff6c8e7"} Jun 03 16:17:34.055894 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:34.055861 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:34.056063 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:34.055960 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:35.055642 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:35.055562 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:35.055642 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:35.055598 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:35.056147 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:35.055929 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ks9qp" podUID="525a53b8-7bcc-461b-89f0-cb054ce2ddfa" Jun 03 16:17:35.056147 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:35.055985 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zkx42" podUID="c1f85abe-3593-4155-99a9-696dde6fb845" Jun 03 16:17:35.798843 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:35.798810 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv6sb\" (UniqueName: \"kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb\") pod \"network-check-target-mbtmg\" (UID: \"3ac58c93-4c20-4957-ae6b-27c926ede940\") " pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:35.799000 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:35.798856 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:35.799000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:35.798962 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:35.799000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:35.798966 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:17:35.799000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:35.798984 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:17:35.799000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:35.798997 2559 projected.go:194] Error preparing data for projected volume kube-api-access-mv6sb for pod openshift-network-diagnostics/network-check-target-mbtmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:35.799159 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:35.799025 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs podName:525a53b8-7bcc-461b-89f0-cb054ce2ddfa nodeName:}" failed. No retries permitted until 2026-06-03 16:18:07.799006435 +0000 UTC m=+65.316003079 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs") pod "network-metrics-daemon-ks9qp" (UID: "525a53b8-7bcc-461b-89f0-cb054ce2ddfa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:17:35.799159 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:35.799040 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb podName:3ac58c93-4c20-4957-ae6b-27c926ede940 nodeName:}" failed. No retries permitted until 2026-06-03 16:18:07.799033031 +0000 UTC m=+65.316029662 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mv6sb" (UniqueName: "kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb") pod "network-check-target-mbtmg" (UID: "3ac58c93-4c20-4957-ae6b-27c926ede940") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:17:36.056592 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.056513 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:36.057043 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:36.056615 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbtmg" podUID="3ac58c93-4c20-4957-ae6b-27c926ede940" Jun 03 16:17:36.860572 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.860543 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-169.ec2.internal" event="NodeReady" Jun 03 16:17:36.860728 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.860669 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 16:17:36.899511 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.899432 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55db599d8c-tx7kf"] Jun 03 16:17:36.903813 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.903232 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:36.903813 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.903261 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-mz5lt"] Jun 03 16:17:36.905118 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.905099 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 16:17:36.905567 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.905551 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 16:17:36.905639 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.905620 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 16:17:36.907464 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.907365 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9hn4z\"" Jun 03 16:17:36.907601 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.907580 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-r8gml"] Jun 03 16:17:36.907745 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.907723 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:36.909977 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.909957 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 16:17:36.910831 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.910811 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 16:17:36.910922 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.910905 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 16:17:36.910975 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.910927 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mk974\"" Jun 03 16:17:36.911185 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.911169 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 16:17:36.911666 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.911648 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr"] Jun 03 16:17:36.911865 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.911843 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-r8gml" Jun 03 16:17:36.914236 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.914211 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:17:36.914362 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.914348 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 16:17:36.914362 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.914360 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vgpt5\"" Jun 03 16:17:36.915515 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.915498 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl"] Jun 03 16:17:36.915657 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.915639 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" Jun 03 16:17:36.919254 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.919236 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc"] Jun 03 16:17:36.919375 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.919353 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:36.922524 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.921263 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:17:36.922524 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.921281 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 16:17:36.922524 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.922301 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 16:17:36.922717 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.922661 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fwhb9\"" Jun 03 16:17:36.923943 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.923905 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 16:17:36.924025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.923944 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 16:17:36.924025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.923956 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 16:17:36.924745 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.924728 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 16:17:36.925191 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.925175 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6868b4f58f-cq6sd"] Jun 03 16:17:36.925326 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.925312 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:17:36.928372 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.928352 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 16:17:36.928478 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.928400 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 16:17:36.928478 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.928409 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-55rlw\"" Jun 03 16:17:36.928478 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.928356 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 16:17:36.928601 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.928538 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:17:36.928601 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.928562 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs"] Jun 03 16:17:36.928704 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.928690 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:36.929563 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.929537 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 16:17:36.929662 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.929591 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 16:17:36.929662 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.929629 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tnl2d\"" Jun 03 16:17:36.932037 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.932018 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-lq5m4"] Jun 03 16:17:36.932132 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.932121 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" Jun 03 16:17:36.932327 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.932248 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 16:17:36.932432 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.932336 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mr4n2\"" Jun 03 16:17:36.932728 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.932670 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 16:17:36.932865 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.932775 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 16:17:36.932954 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.932873 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 16:17:36.932954 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.932916 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 16:17:36.933059 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.932953 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 16:17:36.936328 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.936309 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55db599d8c-tx7kf"] Jun 03 16:17:36.936420 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.936401 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:36.936731 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.936694 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-mz5lt"] Jun 03 16:17:36.938118 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.938101 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 16:17:36.938495 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.938475 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 16:17:36.938587 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.938516 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 16:17:36.939447 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.939425 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:17:36.939789 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.939732 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr"] Jun 03 16:17:36.941623 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.941040 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld"] Jun 03 16:17:36.941942 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.941923 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wqpcd\"" Jun 03 16:17:36.942129 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.942048 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 16:17:36.944401 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.944380 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vkf5q\"" Jun 03 16:17:36.944497 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.944422 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 16:17:36.944779 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.944728 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 16:17:36.945058 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.945038 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:17:36.945256 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.945238 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl"] Jun 03 16:17:36.945353 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.945265 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-r8gml"] Jun 03 16:17:36.945353 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.945282 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9wbh7"] Jun 03 16:17:36.945353 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.945336 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:17:36.948700 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.948675 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 16:17:36.950404 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.950374 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 16:17:36.951611 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.951591 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hbrzz\"" Jun 03 16:17:36.951985 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.951969 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-skggv"] Jun 03 16:17:36.952324 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.952303 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 16:17:36.952820 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.952800 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:17:36.954738 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.954635 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 16:17:36.955044 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.955026 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 16:17:36.955355 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.955068 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nmtcn\"" Jun 03 16:17:36.955542 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.955346 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 16:17:36.956068 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.956049 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs"] Jun 03 16:17:36.956068 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.956068 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-lq5m4"] Jun 03 16:17:36.956245 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.956079 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-84vdh"] Jun 03 16:17:36.956245 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.956207 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-skggv" Jun 03 16:17:36.958298 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.958249 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 16:17:36.960902 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.960879 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bwzrb\"" Jun 03 16:17:36.961603 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.961095 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6868b4f58f-cq6sd"] Jun 03 16:17:36.961603 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.961141 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-skggv"] Jun 03 16:17:36.961603 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.961166 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 16:17:36.961603 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.961232 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:36.962201 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.962175 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9wbh7"] Jun 03 16:17:36.963223 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.963202 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld"] Jun 03 16:17:36.963538 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.963521 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 16:17:36.963907 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.963806 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 16:17:36.963907 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.963886 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h928k\"" Jun 03 16:17:36.964806 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.964787 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc"] Jun 03 16:17:36.970717 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:36.970700 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-84vdh"] Jun 03 16:17:37.005274 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005250 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-trusted-ca\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.005377 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-installation-pull-secrets\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.005377 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005331 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-bound-sa-token\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.005377 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-snapshots\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.005560 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbq6v\" (UniqueName: \"kubernetes.io/projected/27ef8f31-95e5-4c5b-b582-6fa848db3a16-kube-api-access-vbq6v\") pod \"volume-data-source-validator-7598fd5bd-r8gml\" (UID: \"27ef8f31-95e5-4c5b-b582-6fa848db3a16\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-r8gml" Jun 03 16:17:37.005560 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-image-registry-private-configuration\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.005560 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-service-ca-bundle\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.005560 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005503 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-tmp\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.005560 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005532 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.005796 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brwx5\" (UniqueName: \"kubernetes.io/projected/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-kube-api-access-brwx5\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.005796 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-serving-cert\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.005796 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.005796 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-662cz\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-kube-api-access-662cz\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.005796 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54f07651-da39-4175-8afe-63fe1a871264-ca-trust-extracted\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.005796 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.005721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-registry-certificates\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.055704 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.055679 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:17:37.055867 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.055844 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:37.057663 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.057636 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 16:17:37.057663 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.057663 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 16:17:37.058059 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.057698 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cchx6\"" Jun 03 16:17:37.106606 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106583 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.106606 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106609 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-serving-cert\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.106773 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8211b5cc-90d3-4d03-9b66-7327113954c8-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:37.106773 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106649 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brwx5\" (UniqueName: \"kubernetes.io/projected/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-kube-api-access-brwx5\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.106773 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:17:37.106773 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106707 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-default-certificate\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.106773 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106760 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8f45027-664c-47e2-a385-7c4fe95993f0-config\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.106997 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106792 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-662cz\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-kube-api-access-662cz\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.106997 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106820 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54f07651-da39-4175-8afe-63fe1a871264-ca-trust-extracted\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.106997 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-stats-auth\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.106997 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57ec466a-4a66-4dd3-b11a-22798042ffdb-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-4wctr\" (UID: \"57ec466a-4a66-4dd3-b11a-22798042ffdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" Jun 03 16:17:37.106997 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106898 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-registry-certificates\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.106997 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106938 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:17:37.106997 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.106958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2krm\" (UniqueName: \"kubernetes.io/projected/8211b5cc-90d3-4d03-9b66-7327113954c8-kube-api-access-q2krm\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:37.107304 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42x9t\" (UniqueName: \"kubernetes.io/projected/6234e9c7-9a83-4d91-847f-cd559b30aa96-kube-api-access-42x9t\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.107304 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz575\" (UniqueName: \"kubernetes.io/projected/8c6d76e3-79a7-412f-adb2-609947a1f7d5-kube-api-access-rz575\") pod \"network-check-source-56d84b9f44-skggv\" (UID: \"8c6d76e3-79a7-412f-adb2-609947a1f7d5\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-skggv" Jun 03 16:17:37.107304 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107104 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-snapshots\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.107304 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107286 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbq6v\" (UniqueName: \"kubernetes.io/projected/27ef8f31-95e5-4c5b-b582-6fa848db3a16-kube-api-access-vbq6v\") pod \"volume-data-source-validator-7598fd5bd-r8gml\" (UID: \"27ef8f31-95e5-4c5b-b582-6fa848db3a16\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-r8gml" Jun 03 16:17:37.107492 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8f45027-664c-47e2-a385-7c4fe95993f0-trusted-ca\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.107492 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107240 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54f07651-da39-4175-8afe-63fe1a871264-ca-trust-extracted\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.107492 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107326 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-service-ca-bundle\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.107492 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24dgp\" (UniqueName: \"kubernetes.io/projected/d8f45027-664c-47e2-a385-7c4fe95993f0-kube-api-access-24dgp\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.107492 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-tmp-dir\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.107701 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-registry-certificates\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.107701 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107554 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.107701 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107563 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-tmp\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.107701 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107596 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-snapshots\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.107701 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107600 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhwdd\" (UniqueName: \"kubernetes.io/projected/dee86b17-6167-42fc-a8ec-52db70989ee6-kube-api-access-vhwdd\") pod \"service-ca-operator-69877444c-5hcrs\" (UID: \"dee86b17-6167-42fc-a8ec-52db70989ee6\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" Jun 03 16:17:37.107701 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107632 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47986\" (UniqueName: \"kubernetes.io/projected/f9b5373c-8df0-4b3f-9901-732b7611db6f-kube-api-access-47986\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:17:37.107701 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107705 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dee86b17-6167-42fc-a8ec-52db70989ee6-serving-cert\") pod \"service-ca-operator-69877444c-5hcrs\" (UID: \"dee86b17-6167-42fc-a8ec-52db70989ee6\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107744 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107789 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whn6r\" (UniqueName: \"kubernetes.io/projected/57ec466a-4a66-4dd3-b11a-22798042ffdb-kube-api-access-whn6r\") pod \"kube-storage-version-migrator-operator-96ddc787c-4wctr\" (UID: \"57ec466a-4a66-4dd3-b11a-22798042ffdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107844 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqlkt\" (UniqueName: \"kubernetes.io/projected/dd27ea7c-d1de-4ba7-b04e-0e423252086f-kube-api-access-xqlkt\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.107851 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.107868 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55db599d8c-tx7kf: secret "image-registry-tls" not found Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107865 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-service-ca-bundle\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107875 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-tmp\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.107924 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls podName:54f07651-da39-4175-8afe-63fe1a871264 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:37.60790905 +0000 UTC m=+35.124905699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls") pod "image-registry-55db599d8c-tx7kf" (UID: "54f07651-da39-4175-8afe-63fe1a871264") : secret "image-registry-tls" not found Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.107999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-config-volume\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.108033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.108031 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-bound-sa-token\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.108706 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.108055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsgpg\" (UniqueName: \"kubernetes.io/projected/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-kube-api-access-hsgpg\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.108706 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.108662 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-trusted-ca\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.108825 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.108737 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-installation-pull-secrets\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.109129 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.109111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/57ec466a-4a66-4dd3-b11a-22798042ffdb-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-4wctr\" (UID: \"57ec466a-4a66-4dd3-b11a-22798042ffdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" Jun 03 16:17:37.109233 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.109153 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f45027-664c-47e2-a385-7c4fe95993f0-serving-cert\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.109233 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.109186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dee86b17-6167-42fc-a8ec-52db70989ee6-config\") pod \"service-ca-operator-69877444c-5hcrs\" (UID: \"dee86b17-6167-42fc-a8ec-52db70989ee6\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" Jun 03 16:17:37.109337 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.109250 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.109337 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.109291 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-image-registry-private-configuration\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.112491 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.110036 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-trusted-ca\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.112491 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.112004 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-serving-cert\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.112491 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.112176 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-image-registry-private-configuration\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.112491 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.112180 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-installation-pull-secrets\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.115320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.115289 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbq6v\" (UniqueName: \"kubernetes.io/projected/27ef8f31-95e5-4c5b-b582-6fa848db3a16-kube-api-access-vbq6v\") pod \"volume-data-source-validator-7598fd5bd-r8gml\" (UID: \"27ef8f31-95e5-4c5b-b582-6fa848db3a16\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-r8gml" Jun 03 16:17:37.115422 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.115344 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brwx5\" (UniqueName: \"kubernetes.io/projected/f327c6e2-8b7e-45e2-b773-7ccbf8badc30-kube-api-access-brwx5\") pod \"insights-operator-788bf58df5-mz5lt\" (UID: \"f327c6e2-8b7e-45e2-b773-7ccbf8badc30\") " pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.115534 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.115516 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-bound-sa-token\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.115664 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.115646 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-662cz\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-kube-api-access-662cz\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.209702 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.209630 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhwdd\" (UniqueName: \"kubernetes.io/projected/dee86b17-6167-42fc-a8ec-52db70989ee6-kube-api-access-vhwdd\") pod \"service-ca-operator-69877444c-5hcrs\" (UID: \"dee86b17-6167-42fc-a8ec-52db70989ee6\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" Jun 03 16:17:37.209702 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.209668 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47986\" (UniqueName: \"kubernetes.io/projected/f9b5373c-8df0-4b3f-9901-732b7611db6f-kube-api-access-47986\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:17:37.209702 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.209694 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:17:37.209953 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.209731 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dee86b17-6167-42fc-a8ec-52db70989ee6-serving-cert\") pod \"service-ca-operator-69877444c-5hcrs\" (UID: \"dee86b17-6167-42fc-a8ec-52db70989ee6\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" Jun 03 16:17:37.209953 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.209781 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:17:37.209953 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.209804 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whn6r\" (UniqueName: \"kubernetes.io/projected/57ec466a-4a66-4dd3-b11a-22798042ffdb-kube-api-access-whn6r\") pod \"kube-storage-version-migrator-operator-96ddc787c-4wctr\" (UID: \"57ec466a-4a66-4dd3-b11a-22798042ffdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" Jun 03 16:17:37.209953 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.209845 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqlkt\" (UniqueName: \"kubernetes.io/projected/dd27ea7c-d1de-4ba7-b04e-0e423252086f-kube-api-access-xqlkt\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:17:37.209953 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.209935 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 16:17:37.210223 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.209972 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.210223 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.210015 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert podName:7a9a71cc-0fa9-4cfc-a6cf-0311b8395784 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:37.709994167 +0000 UTC m=+35.226990815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-l67ld" (UID: "7a9a71cc-0fa9-4cfc-a6cf-0311b8395784") : secret "networking-console-plugin-cert" not found Jun 03 16:17:37.210334 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.210239 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:37.710221052 +0000 UTC m=+35.227217697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : configmap references non-existent config key: service-ca.crt Jun 03 16:17:37.210544 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.210521 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:17:37.210661 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.210643 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.210730 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.210688 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:37.210730 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.210719 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-config-volume\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.210847 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.210765 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:17:37.210847 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.210788 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsgpg\" (UniqueName: \"kubernetes.io/projected/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-kube-api-access-hsgpg\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.210847 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.210825 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:37.710810031 +0000 UTC m=+35.227806670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : secret "router-metrics-certs-default" not found Jun 03 16:17:37.210847 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.210841 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:37.211029 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.210860 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/57ec466a-4a66-4dd3-b11a-22798042ffdb-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-4wctr\" (UID: \"57ec466a-4a66-4dd3-b11a-22798042ffdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" Jun 03 16:17:37.211029 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.210888 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls podName:8211b5cc-90d3-4d03-9b66-7327113954c8 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:37.710872504 +0000 UTC m=+35.227869146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-wmldl" (UID: "8211b5cc-90d3-4d03-9b66-7327113954c8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:37.211029 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.210907 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f45027-664c-47e2-a385-7c4fe95993f0-serving-cert\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.211029 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.210934 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dee86b17-6167-42fc-a8ec-52db70989ee6-config\") pod \"service-ca-operator-69877444c-5hcrs\" (UID: \"dee86b17-6167-42fc-a8ec-52db70989ee6\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" Jun 03 16:17:37.211029 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.210964 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.211029 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211006 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8211b5cc-90d3-4d03-9b66-7327113954c8-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:37.211320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211036 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:17:37.211320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211061 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-default-certificate\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.211320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211089 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8f45027-664c-47e2-a385-7c4fe95993f0-config\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.211320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211117 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-stats-auth\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.211320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211143 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57ec466a-4a66-4dd3-b11a-22798042ffdb-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-4wctr\" (UID: \"57ec466a-4a66-4dd3-b11a-22798042ffdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" Jun 03 16:17:37.211320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211185 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:17:37.211320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211211 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2krm\" (UniqueName: \"kubernetes.io/projected/8211b5cc-90d3-4d03-9b66-7327113954c8-kube-api-access-q2krm\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:37.211320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211253 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42x9t\" (UniqueName: \"kubernetes.io/projected/6234e9c7-9a83-4d91-847f-cd559b30aa96-kube-api-access-42x9t\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.211320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211282 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rz575\" (UniqueName: \"kubernetes.io/projected/8c6d76e3-79a7-412f-adb2-609947a1f7d5-kube-api-access-rz575\") pod \"network-check-source-56d84b9f44-skggv\" (UID: \"8c6d76e3-79a7-412f-adb2-609947a1f7d5\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-skggv" Jun 03 16:17:37.211320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211315 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8f45027-664c-47e2-a385-7c4fe95993f0-trusted-ca\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.211836 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211346 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24dgp\" (UniqueName: \"kubernetes.io/projected/d8f45027-664c-47e2-a385-7c4fe95993f0-kube-api-access-24dgp\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.211836 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.211423 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:17:37.211836 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.211460 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert podName:dd27ea7c-d1de-4ba7-b04e-0e423252086f nodeName:}" failed. No retries permitted until 2026-06-03 16:17:37.711448086 +0000 UTC m=+35.228444728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert") pod "ingress-canary-9wbh7" (UID: "dd27ea7c-d1de-4ba7-b04e-0e423252086f") : secret "canary-serving-cert" not found Jun 03 16:17:37.211836 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211498 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-config-volume\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.211836 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211671 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/57ec466a-4a66-4dd3-b11a-22798042ffdb-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-4wctr\" (UID: \"57ec466a-4a66-4dd3-b11a-22798042ffdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" Jun 03 16:17:37.212084 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.211847 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8211b5cc-90d3-4d03-9b66-7327113954c8-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:37.212137 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.212096 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:17:37.212192 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.212159 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls podName:044b7d3d-10a9-4d90-aee0-da4ddcdf9132 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:37.71214257 +0000 UTC m=+35.229139200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls") pod "dns-default-84vdh" (UID: "044b7d3d-10a9-4d90-aee0-da4ddcdf9132") : secret "dns-default-metrics-tls" not found Jun 03 16:17:37.212643 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.212387 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dee86b17-6167-42fc-a8ec-52db70989ee6-config\") pod \"service-ca-operator-69877444c-5hcrs\" (UID: \"dee86b17-6167-42fc-a8ec-52db70989ee6\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" Jun 03 16:17:37.212643 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.212494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8f45027-664c-47e2-a385-7c4fe95993f0-config\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.212643 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.212584 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8f45027-664c-47e2-a385-7c4fe95993f0-trusted-ca\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.212643 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.212626 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-tmp-dir\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.212913 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.212671 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 16:17:37.212913 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.212725 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls podName:f9b5373c-8df0-4b3f-9901-732b7611db6f nodeName:}" failed. No retries permitted until 2026-06-03 16:17:37.712709315 +0000 UTC m=+35.229705956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gx4mc" (UID: "f9b5373c-8df0-4b3f-9901-732b7611db6f") : secret "samples-operator-tls" not found Jun 03 16:17:37.213018 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.212917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-tmp-dir\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.213018 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.212922 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dee86b17-6167-42fc-a8ec-52db70989ee6-serving-cert\") pod \"service-ca-operator-69877444c-5hcrs\" (UID: \"dee86b17-6167-42fc-a8ec-52db70989ee6\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" Jun 03 16:17:37.214140 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.214114 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/57ec466a-4a66-4dd3-b11a-22798042ffdb-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-4wctr\" (UID: \"57ec466a-4a66-4dd3-b11a-22798042ffdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" Jun 03 16:17:37.214936 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.214919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-stats-auth\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.215242 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.215204 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-default-certificate\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.215504 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.215488 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f45027-664c-47e2-a385-7c4fe95993f0-serving-cert\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.221192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.221165 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsgpg\" (UniqueName: \"kubernetes.io/projected/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-kube-api-access-hsgpg\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.221440 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.221385 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whn6r\" (UniqueName: \"kubernetes.io/projected/57ec466a-4a66-4dd3-b11a-22798042ffdb-kube-api-access-whn6r\") pod \"kube-storage-version-migrator-operator-96ddc787c-4wctr\" (UID: \"57ec466a-4a66-4dd3-b11a-22798042ffdb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" Jun 03 16:17:37.222102 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.222059 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47986\" (UniqueName: \"kubernetes.io/projected/f9b5373c-8df0-4b3f-9901-732b7611db6f-kube-api-access-47986\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:17:37.222195 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.222128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhwdd\" (UniqueName: \"kubernetes.io/projected/dee86b17-6167-42fc-a8ec-52db70989ee6-kube-api-access-vhwdd\") pod \"service-ca-operator-69877444c-5hcrs\" (UID: \"dee86b17-6167-42fc-a8ec-52db70989ee6\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" Jun 03 16:17:37.222252 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.222230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2krm\" (UniqueName: \"kubernetes.io/projected/8211b5cc-90d3-4d03-9b66-7327113954c8-kube-api-access-q2krm\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:37.223391 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.223366 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqlkt\" (UniqueName: \"kubernetes.io/projected/dd27ea7c-d1de-4ba7-b04e-0e423252086f-kube-api-access-xqlkt\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:17:37.223592 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.223576 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42x9t\" (UniqueName: \"kubernetes.io/projected/6234e9c7-9a83-4d91-847f-cd559b30aa96-kube-api-access-42x9t\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.223930 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.223915 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24dgp\" (UniqueName: \"kubernetes.io/projected/d8f45027-664c-47e2-a385-7c4fe95993f0-kube-api-access-24dgp\") pod \"console-operator-86d7c6cc77-lq5m4\" (UID: \"d8f45027-664c-47e2-a385-7c4fe95993f0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.224235 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.224216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz575\" (UniqueName: \"kubernetes.io/projected/8c6d76e3-79a7-412f-adb2-609947a1f7d5-kube-api-access-rz575\") pod \"network-check-source-56d84b9f44-skggv\" (UID: \"8c6d76e3-79a7-412f-adb2-609947a1f7d5\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-skggv" Jun 03 16:17:37.227052 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.227032 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-mz5lt" Jun 03 16:17:37.231795 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.231733 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-r8gml" Jun 03 16:17:37.237869 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.237718 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" Jun 03 16:17:37.276266 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.274347 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" Jun 03 16:17:37.279994 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.279612 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:37.303513 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.302676 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-skggv" Jun 03 16:17:37.477395 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.475734 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-r8gml"] Jun 03 16:17:37.483886 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:37.483838 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ef8f31_95e5_4c5b_b582_6fa848db3a16.slice/crio-4a9898a5f23f62ecbb028e8acbe5a51bbc55917135496161e933fa3f0ceb9cf5 WatchSource:0}: Error finding container 4a9898a5f23f62ecbb028e8acbe5a51bbc55917135496161e933fa3f0ceb9cf5: Status 404 returned error can't find the container with id 4a9898a5f23f62ecbb028e8acbe5a51bbc55917135496161e933fa3f0ceb9cf5 Jun 03 16:17:37.491403 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.490828 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr"] Jun 03 16:17:37.493516 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:37.493484 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ec466a_4a66_4dd3_b11a_22798042ffdb.slice/crio-960d00c42406c7264e5670837f5918b72ec422b614f0c3883ead2aad06a39aaa WatchSource:0}: Error finding container 960d00c42406c7264e5670837f5918b72ec422b614f0c3883ead2aad06a39aaa: Status 404 returned error can't find the container with id 960d00c42406c7264e5670837f5918b72ec422b614f0c3883ead2aad06a39aaa Jun 03 16:17:37.504382 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.504357 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-mz5lt"] Jun 03 16:17:37.506359 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:37.506334 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf327c6e2_8b7e_45e2_b773_7ccbf8badc30.slice/crio-01419f4f5a2e61e4f8d9bdcb2099f3d5f07b0782accd4dcebc956acdbaebeb85 WatchSource:0}: Error finding container 01419f4f5a2e61e4f8d9bdcb2099f3d5f07b0782accd4dcebc956acdbaebeb85: Status 404 returned error can't find the container with id 01419f4f5a2e61e4f8d9bdcb2099f3d5f07b0782accd4dcebc956acdbaebeb85 Jun 03 16:17:37.508914 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.508888 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs"] Jun 03 16:17:37.513737 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:37.513685 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee86b17_6167_42fc_a8ec_52db70989ee6.slice/crio-2e962538a258285785002e17b8aa798b5aa70bd01593d3e480aa4346f9b50412 WatchSource:0}: Error finding container 2e962538a258285785002e17b8aa798b5aa70bd01593d3e480aa4346f9b50412: Status 404 returned error can't find the container with id 2e962538a258285785002e17b8aa798b5aa70bd01593d3e480aa4346f9b50412 Jun 03 16:17:37.545081 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.545058 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-skggv"] Jun 03 16:17:37.547654 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:37.547633 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6d76e3_79a7_412f_adb2_609947a1f7d5.slice/crio-f2c287ef7193fdd4a26e9438627ae4c77107fffa7c99b8c59e5935b75cbf8425 WatchSource:0}: Error finding container f2c287ef7193fdd4a26e9438627ae4c77107fffa7c99b8c59e5935b75cbf8425: Status 404 returned error can't find the container with id f2c287ef7193fdd4a26e9438627ae4c77107fffa7c99b8c59e5935b75cbf8425 Jun 03 16:17:37.618807 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.618778 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:37.618939 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.618917 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:17:37.618939 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.618933 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55db599d8c-tx7kf: secret "image-registry-tls" not found Jun 03 16:17:37.619015 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.618984 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls podName:54f07651-da39-4175-8afe-63fe1a871264 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:38.618967604 +0000 UTC m=+36.135964246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls") pod "image-registry-55db599d8c-tx7kf" (UID: "54f07651-da39-4175-8afe-63fe1a871264") : secret "image-registry-tls" not found Jun 03 16:17:37.705316 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.705285 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-lq5m4"] Jun 03 16:17:37.708646 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:37.708619 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f45027_664c_47e2_a385_7c4fe95993f0.slice/crio-f6c33e9127a968c5d58fed649aeccc91e813ddf780c0a3a1dc487682b4a7d5ea WatchSource:0}: Error finding container f6c33e9127a968c5d58fed649aeccc91e813ddf780c0a3a1dc487682b4a7d5ea: Status 404 returned error can't find the container with id f6c33e9127a968c5d58fed649aeccc91e813ddf780c0a3a1dc487682b4a7d5ea Jun 03 16:17:37.719998 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.719976 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.720095 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.720024 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:37.720095 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.720058 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:37.720172 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.720108 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:37.720172 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720130 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:38.720109097 +0000 UTC m=+36.237105746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : configmap references non-existent config key: service-ca.crt Jun 03 16:17:37.720274 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720192 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:17:37.720274 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.720196 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:17:37.720274 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720208 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:37.720274 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720235 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls podName:044b7d3d-10a9-4d90-aee0-da4ddcdf9132 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:38.720224131 +0000 UTC m=+36.237220758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls") pod "dns-default-84vdh" (UID: "044b7d3d-10a9-4d90-aee0-da4ddcdf9132") : secret "dns-default-metrics-tls" not found Jun 03 16:17:37.720274 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720192 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:17:37.720274 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720260 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls podName:8211b5cc-90d3-4d03-9b66-7327113954c8 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:38.720245098 +0000 UTC m=+36.237241741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-wmldl" (UID: "8211b5cc-90d3-4d03-9b66-7327113954c8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:37.720572 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720280 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:38.720272227 +0000 UTC m=+36.237268862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : secret "router-metrics-certs-default" not found Jun 03 16:17:37.720572 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720284 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 16:17:37.720572 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.720310 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:17:37.720572 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720318 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls podName:f9b5373c-8df0-4b3f-9901-732b7611db6f nodeName:}" failed. No retries permitted until 2026-06-03 16:17:38.720307293 +0000 UTC m=+36.237303938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gx4mc" (UID: "f9b5373c-8df0-4b3f-9901-732b7611db6f") : secret "samples-operator-tls" not found Jun 03 16:17:37.720572 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720372 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:17:37.720572 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:37.720403 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:17:37.720572 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720439 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 16:17:37.720572 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720455 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert podName:dd27ea7c-d1de-4ba7-b04e-0e423252086f nodeName:}" failed. No retries permitted until 2026-06-03 16:17:38.720445357 +0000 UTC m=+36.237441987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert") pod "ingress-canary-9wbh7" (UID: "dd27ea7c-d1de-4ba7-b04e-0e423252086f") : secret "canary-serving-cert" not found Jun 03 16:17:37.720572 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:37.720472 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert podName:7a9a71cc-0fa9-4cfc-a6cf-0311b8395784 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:38.720461169 +0000 UTC m=+36.237457819 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-l67ld" (UID: "7a9a71cc-0fa9-4cfc-a6cf-0311b8395784") : secret "networking-console-plugin-cert" not found Jun 03 16:17:38.056596 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.056564 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:17:38.061218 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.059063 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9ccm\"" Jun 03 16:17:38.284266 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.284016 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" event={"ID":"dee86b17-6167-42fc-a8ec-52db70989ee6","Type":"ContainerStarted","Data":"2e962538a258285785002e17b8aa798b5aa70bd01593d3e480aa4346f9b50412"} Jun 03 16:17:38.287833 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.287775 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-r8gml" event={"ID":"27ef8f31-95e5-4c5b-b582-6fa848db3a16","Type":"ContainerStarted","Data":"4a9898a5f23f62ecbb028e8acbe5a51bbc55917135496161e933fa3f0ceb9cf5"} Jun 03 16:17:38.290045 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.289992 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" event={"ID":"57ec466a-4a66-4dd3-b11a-22798042ffdb","Type":"ContainerStarted","Data":"960d00c42406c7264e5670837f5918b72ec422b614f0c3883ead2aad06a39aaa"} Jun 03 16:17:38.294608 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.294555 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-mz5lt" event={"ID":"f327c6e2-8b7e-45e2-b773-7ccbf8badc30","Type":"ContainerStarted","Data":"01419f4f5a2e61e4f8d9bdcb2099f3d5f07b0782accd4dcebc956acdbaebeb85"} Jun 03 16:17:38.296030 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.295975 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-skggv" event={"ID":"8c6d76e3-79a7-412f-adb2-609947a1f7d5","Type":"ContainerStarted","Data":"f2c287ef7193fdd4a26e9438627ae4c77107fffa7c99b8c59e5935b75cbf8425"} Jun 03 16:17:38.297208 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.297163 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" event={"ID":"d8f45027-664c-47e2-a385-7c4fe95993f0","Type":"ContainerStarted","Data":"f6c33e9127a968c5d58fed649aeccc91e813ddf780c0a3a1dc487682b4a7d5ea"} Jun 03 16:17:38.630004 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.629936 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:38.630201 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.630107 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:17:38.630201 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.630131 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55db599d8c-tx7kf: secret "image-registry-tls" not found Jun 03 16:17:38.630317 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.630204 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls podName:54f07651-da39-4175-8afe-63fe1a871264 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:40.630172543 +0000 UTC m=+38.147169184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls") pod "image-registry-55db599d8c-tx7kf" (UID: "54f07651-da39-4175-8afe-63fe1a871264") : secret "image-registry-tls" not found Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.730568 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.730642 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.730716 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.730817 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.730847 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.730932 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:38.730991 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731132 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731192 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls podName:044b7d3d-10a9-4d90-aee0-da4ddcdf9132 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:40.731173783 +0000 UTC m=+38.248170420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls") pod "dns-default-84vdh" (UID: "044b7d3d-10a9-4d90-aee0-da4ddcdf9132") : secret "dns-default-metrics-tls" not found Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731252 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731284 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls podName:f9b5373c-8df0-4b3f-9901-732b7611db6f nodeName:}" failed. No retries permitted until 2026-06-03 16:17:40.731273589 +0000 UTC m=+38.248270224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gx4mc" (UID: "f9b5373c-8df0-4b3f-9901-732b7611db6f") : secret "samples-operator-tls" not found Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731332 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731360 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert podName:dd27ea7c-d1de-4ba7-b04e-0e423252086f nodeName:}" failed. No retries permitted until 2026-06-03 16:17:40.731349785 +0000 UTC m=+38.248346419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert") pod "ingress-canary-9wbh7" (UID: "dd27ea7c-d1de-4ba7-b04e-0e423252086f") : secret "canary-serving-cert" not found Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731406 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 16:17:38.732026 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731435 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert podName:7a9a71cc-0fa9-4cfc-a6cf-0311b8395784 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:40.731426127 +0000 UTC m=+38.248422761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-l67ld" (UID: "7a9a71cc-0fa9-4cfc-a6cf-0311b8395784") : secret "networking-console-plugin-cert" not found Jun 03 16:17:38.732913 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731494 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:40.731483702 +0000 UTC m=+38.248480334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : configmap references non-existent config key: service-ca.crt Jun 03 16:17:38.732913 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731541 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:17:38.732913 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731566 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:40.731557983 +0000 UTC m=+38.248554615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : secret "router-metrics-certs-default" not found Jun 03 16:17:38.732913 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731613 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:38.732913 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:38.731641 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls podName:8211b5cc-90d3-4d03-9b66-7327113954c8 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:40.731632776 +0000 UTC m=+38.248629410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-wmldl" (UID: "8211b5cc-90d3-4d03-9b66-7327113954c8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:40.650725 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:40.650691 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:40.651235 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.650879 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:17:40.651235 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.650901 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55db599d8c-tx7kf: secret "image-registry-tls" not found Jun 03 16:17:40.651235 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.650970 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls podName:54f07651-da39-4175-8afe-63fe1a871264 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:44.650949235 +0000 UTC m=+42.167945862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls") pod "image-registry-55db599d8c-tx7kf" (UID: "54f07651-da39-4175-8afe-63fe1a871264") : secret "image-registry-tls" not found Jun 03 16:17:40.751549 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:40.751504 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:17:40.751712 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:40.751594 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:17:40.751712 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:40.751626 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:40.751712 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:40.751643 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:40.751712 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:40.751664 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:40.751712 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.751692 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:17:40.752000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.751745 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:40.752000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.751766 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 16:17:40.752000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.751785 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert podName:dd27ea7c-d1de-4ba7-b04e-0e423252086f nodeName:}" failed. No retries permitted until 2026-06-03 16:17:44.751760574 +0000 UTC m=+42.268757217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert") pod "ingress-canary-9wbh7" (UID: "dd27ea7c-d1de-4ba7-b04e-0e423252086f") : secret "canary-serving-cert" not found Jun 03 16:17:40.752000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.751806 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls podName:8211b5cc-90d3-4d03-9b66-7327113954c8 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:44.751795788 +0000 UTC m=+42.268792420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-wmldl" (UID: "8211b5cc-90d3-4d03-9b66-7327113954c8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:40.752000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.751824 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:44.75181563 +0000 UTC m=+42.268812259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : configmap references non-existent config key: service-ca.crt Jun 03 16:17:40.752000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.751837 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:17:40.752000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.751839 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert podName:7a9a71cc-0fa9-4cfc-a6cf-0311b8395784 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:44.751831241 +0000 UTC m=+42.268827872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-l67ld" (UID: "7a9a71cc-0fa9-4cfc-a6cf-0311b8395784") : secret "networking-console-plugin-cert" not found Jun 03 16:17:40.752000 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.751868 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:44.751853248 +0000 UTC m=+42.268849879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : secret "router-metrics-certs-default" not found Jun 03 16:17:40.752000 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:40.751907 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:40.752000 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:40.751942 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:17:40.752400 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.752027 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 16:17:40.752400 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.752046 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:17:40.752400 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.752063 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls podName:f9b5373c-8df0-4b3f-9901-732b7611db6f nodeName:}" failed. No retries permitted until 2026-06-03 16:17:44.752050553 +0000 UTC m=+42.269047195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gx4mc" (UID: "f9b5373c-8df0-4b3f-9901-732b7611db6f") : secret "samples-operator-tls" not found Jun 03 16:17:40.752400 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:40.752082 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls podName:044b7d3d-10a9-4d90-aee0-da4ddcdf9132 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:44.752070855 +0000 UTC m=+42.269067488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls") pod "dns-default-84vdh" (UID: "044b7d3d-10a9-4d90-aee0-da4ddcdf9132") : secret "dns-default-metrics-tls" not found Jun 03 16:17:41.290573 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.290541 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p"] Jun 03 16:17:41.327061 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.327034 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p"] Jun 03 16:17:41.327061 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.327063 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq"] Jun 03 16:17:41.327243 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.327214 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p" Jun 03 16:17:41.329802 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.329612 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 16:17:41.329802 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.329678 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 16:17:41.330239 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.330226 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9ftrf\"" Jun 03 16:17:41.330315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.330273 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 16:17:41.330373 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.330307 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 16:17:41.341014 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.340981 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g"] Jun 03 16:17:41.341135 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.341119 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.344209 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.344188 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 16:17:41.344344 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.344322 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 16:17:41.344589 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.344262 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 16:17:41.345768 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.345731 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 16:17:41.357855 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.357746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxbz\" (UniqueName: \"kubernetes.io/projected/4b64896f-1e21-436e-8c9b-52dabfbf3576-kube-api-access-4mxbz\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.357944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.357887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-hub\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.357944 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.357916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c7cdf66-f08f-4731-a137-e11387753942-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68bd5b5758-bvn8p\" (UID: \"1c7cdf66-f08f-4731-a137-e11387753942\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p" Jun 03 16:17:41.358047 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.357941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4b64896f-1e21-436e-8c9b-52dabfbf3576-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.358047 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.358013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.358135 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.358089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-ca\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.358135 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.358119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.358227 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.358163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx5v8\" (UniqueName: \"kubernetes.io/projected/1c7cdf66-f08f-4731-a137-e11387753942-kube-api-access-xx5v8\") pod \"managed-serviceaccount-addon-agent-68bd5b5758-bvn8p\" (UID: \"1c7cdf66-f08f-4731-a137-e11387753942\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p" Jun 03 16:17:41.363226 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.363204 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq"] Jun 03 16:17:41.363536 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.363235 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g"] Jun 03 16:17:41.363536 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.363345 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:41.365386 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.365367 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 16:17:41.459179 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.459141 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-ca\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.459328 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.459192 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.459328 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.459255 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xx5v8\" (UniqueName: \"kubernetes.io/projected/1c7cdf66-f08f-4731-a137-e11387753942-kube-api-access-xx5v8\") pod \"managed-serviceaccount-addon-agent-68bd5b5758-bvn8p\" (UID: \"1c7cdf66-f08f-4731-a137-e11387753942\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p" Jun 03 16:17:41.459451 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.459342 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxbz\" (UniqueName: \"kubernetes.io/projected/4b64896f-1e21-436e-8c9b-52dabfbf3576-kube-api-access-4mxbz\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.459451 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.459388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a1e4ce7-bec0-4226-a92a-6454d031933e-klusterlet-config\") pod \"klusterlet-addon-workmgr-bb9fd67fd-pvd7g\" (UID: \"7a1e4ce7-bec0-4226-a92a-6454d031933e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:41.459451 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.459424 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-hub\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.459593 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.459463 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c7cdf66-f08f-4731-a137-e11387753942-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68bd5b5758-bvn8p\" (UID: \"1c7cdf66-f08f-4731-a137-e11387753942\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p" Jun 03 16:17:41.459593 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.459493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1e4ce7-bec0-4226-a92a-6454d031933e-tmp\") pod \"klusterlet-addon-workmgr-bb9fd67fd-pvd7g\" (UID: \"7a1e4ce7-bec0-4226-a92a-6454d031933e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:41.459593 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.459524 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4b64896f-1e21-436e-8c9b-52dabfbf3576-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.459593 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.459569 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.459810 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.459743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx8xm\" (UniqueName: \"kubernetes.io/projected/7a1e4ce7-bec0-4226-a92a-6454d031933e-kube-api-access-wx8xm\") pod \"klusterlet-addon-workmgr-bb9fd67fd-pvd7g\" (UID: \"7a1e4ce7-bec0-4226-a92a-6454d031933e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:41.460293 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.460237 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/4b64896f-1e21-436e-8c9b-52dabfbf3576-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.463287 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.463266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-ca\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.463386 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.463306 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.463386 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.463379 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.463548 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.463519 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4b64896f-1e21-436e-8c9b-52dabfbf3576-hub\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.463726 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.463711 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c7cdf66-f08f-4731-a137-e11387753942-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68bd5b5758-bvn8p\" (UID: \"1c7cdf66-f08f-4731-a137-e11387753942\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p" Jun 03 16:17:41.466715 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.466696 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx5v8\" (UniqueName: \"kubernetes.io/projected/1c7cdf66-f08f-4731-a137-e11387753942-kube-api-access-xx5v8\") pod \"managed-serviceaccount-addon-agent-68bd5b5758-bvn8p\" (UID: \"1c7cdf66-f08f-4731-a137-e11387753942\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p" Jun 03 16:17:41.466904 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.466879 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxbz\" (UniqueName: \"kubernetes.io/projected/4b64896f-1e21-436e-8c9b-52dabfbf3576-kube-api-access-4mxbz\") pod \"cluster-proxy-proxy-agent-695c868675-zrjqq\" (UID: \"4b64896f-1e21-436e-8c9b-52dabfbf3576\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.560462 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.560380 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a1e4ce7-bec0-4226-a92a-6454d031933e-klusterlet-config\") pod \"klusterlet-addon-workmgr-bb9fd67fd-pvd7g\" (UID: \"7a1e4ce7-bec0-4226-a92a-6454d031933e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:41.560462 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.560443 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1e4ce7-bec0-4226-a92a-6454d031933e-tmp\") pod \"klusterlet-addon-workmgr-bb9fd67fd-pvd7g\" (UID: \"7a1e4ce7-bec0-4226-a92a-6454d031933e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:41.560671 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.560505 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wx8xm\" (UniqueName: \"kubernetes.io/projected/7a1e4ce7-bec0-4226-a92a-6454d031933e-kube-api-access-wx8xm\") pod \"klusterlet-addon-workmgr-bb9fd67fd-pvd7g\" (UID: \"7a1e4ce7-bec0-4226-a92a-6454d031933e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:41.560671 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.560630 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:41.560975 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.560926 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1e4ce7-bec0-4226-a92a-6454d031933e-tmp\") pod \"klusterlet-addon-workmgr-bb9fd67fd-pvd7g\" (UID: \"7a1e4ce7-bec0-4226-a92a-6454d031933e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:41.563229 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.563204 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1f85abe-3593-4155-99a9-696dde6fb845-original-pull-secret\") pod \"global-pull-secret-syncer-zkx42\" (UID: \"c1f85abe-3593-4155-99a9-696dde6fb845\") " pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:41.563340 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.563323 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a1e4ce7-bec0-4226-a92a-6454d031933e-klusterlet-config\") pod \"klusterlet-addon-workmgr-bb9fd67fd-pvd7g\" (UID: \"7a1e4ce7-bec0-4226-a92a-6454d031933e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:41.568449 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.568420 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx8xm\" (UniqueName: \"kubernetes.io/projected/7a1e4ce7-bec0-4226-a92a-6454d031933e-kube-api-access-wx8xm\") pod \"klusterlet-addon-workmgr-bb9fd67fd-pvd7g\" (UID: \"7a1e4ce7-bec0-4226-a92a-6454d031933e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:41.570102 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.570081 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zkx42" Jun 03 16:17:41.645066 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.645036 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p" Jun 03 16:17:41.655918 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.655889 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:17:41.681217 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:41.681190 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:44.691223 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:44.691185 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:44.691635 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.691346 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:17:44.691635 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.691370 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55db599d8c-tx7kf: secret "image-registry-tls" not found Jun 03 16:17:44.691635 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.691452 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls podName:54f07651-da39-4175-8afe-63fe1a871264 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:52.691434885 +0000 UTC m=+50.208431531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls") pod "image-registry-55db599d8c-tx7kf" (UID: "54f07651-da39-4175-8afe-63fe1a871264") : secret "image-registry-tls" not found Jun 03 16:17:44.792451 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:44.792415 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:44.792609 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:44.792471 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:17:44.792609 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:44.792513 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:17:44.792609 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792587 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:17:44.792811 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:44.792612 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:17:44.792811 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792629 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:17:44.792811 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792648 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls podName:044b7d3d-10a9-4d90-aee0-da4ddcdf9132 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:52.79263295 +0000 UTC m=+50.309629578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls") pod "dns-default-84vdh" (UID: "044b7d3d-10a9-4d90-aee0-da4ddcdf9132") : secret "dns-default-metrics-tls" not found Jun 03 16:17:44.792811 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792678 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert podName:dd27ea7c-d1de-4ba7-b04e-0e423252086f nodeName:}" failed. No retries permitted until 2026-06-03 16:17:52.79266292 +0000 UTC m=+50.309659567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert") pod "ingress-canary-9wbh7" (UID: "dd27ea7c-d1de-4ba7-b04e-0e423252086f") : secret "canary-serving-cert" not found Jun 03 16:17:44.792811 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792682 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 16:17:44.792811 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:44.792716 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:44.792811 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792727 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert podName:7a9a71cc-0fa9-4cfc-a6cf-0311b8395784 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:52.792711634 +0000 UTC m=+50.309708263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-l67ld" (UID: "7a9a71cc-0fa9-4cfc-a6cf-0311b8395784") : secret "networking-console-plugin-cert" not found Jun 03 16:17:44.792811 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:44.792769 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:44.792811 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:44.792803 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:44.792811 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792806 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 16:17:44.793220 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792810 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:52.792799181 +0000 UTC m=+50.309795811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : configmap references non-existent config key: service-ca.crt Jun 03 16:17:44.793220 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792857 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:17:44.793220 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792873 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:44.793220 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792859 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls podName:f9b5373c-8df0-4b3f-9901-732b7611db6f nodeName:}" failed. No retries permitted until 2026-06-03 16:17:52.792847383 +0000 UTC m=+50.309844011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gx4mc" (UID: "f9b5373c-8df0-4b3f-9901-732b7611db6f") : secret "samples-operator-tls" not found Jun 03 16:17:44.793220 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792921 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:52.792909361 +0000 UTC m=+50.309905989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : secret "router-metrics-certs-default" not found Jun 03 16:17:44.793220 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:44.792946 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls podName:8211b5cc-90d3-4d03-9b66-7327113954c8 nodeName:}" failed. No retries permitted until 2026-06-03 16:17:52.792936508 +0000 UTC m=+50.309933146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-wmldl" (UID: "8211b5cc-90d3-4d03-9b66-7327113954c8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:46.802632 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:46.802002 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq"] Jun 03 16:17:46.816098 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:46.815948 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zkx42"] Jun 03 16:17:46.829024 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:46.828984 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f85abe_3593_4155_99a9_696dde6fb845.slice/crio-9b0c825a88ee9a09c4ddd9b6a877a5471d800911e19800eac3d7812c14d9a225 WatchSource:0}: Error finding container 9b0c825a88ee9a09c4ddd9b6a877a5471d800911e19800eac3d7812c14d9a225: Status 404 returned error can't find the container with id 9b0c825a88ee9a09c4ddd9b6a877a5471d800911e19800eac3d7812c14d9a225 Jun 03 16:17:46.853601 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:46.852033 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p"] Jun 03 16:17:46.862018 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:46.861954 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c7cdf66_f08f_4731_a137_e11387753942.slice/crio-a6be42cfd52e146ab90e302482e2920ef4382a3f0582b5cad39123619bdb300b WatchSource:0}: Error finding container a6be42cfd52e146ab90e302482e2920ef4382a3f0582b5cad39123619bdb300b: Status 404 returned error can't find the container with id a6be42cfd52e146ab90e302482e2920ef4382a3f0582b5cad39123619bdb300b Jun 03 16:17:47.046829 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.046796 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g"] Jun 03 16:17:47.052334 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:17:47.052301 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1e4ce7_bec0_4226_a92a_6454d031933e.slice/crio-2fffd14ac2f16cf08f6c58bff2f0150299d1b183b4f19f0f864275351f3ce308 WatchSource:0}: Error finding container 2fffd14ac2f16cf08f6c58bff2f0150299d1b183b4f19f0f864275351f3ce308: Status 404 returned error can't find the container with id 2fffd14ac2f16cf08f6c58bff2f0150299d1b183b4f19f0f864275351f3ce308 Jun 03 16:17:47.317135 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.317105 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/0.log" Jun 03 16:17:47.317306 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.317151 2559 generic.go:358] "Generic (PLEG): container finished" podID="d8f45027-664c-47e2-a385-7c4fe95993f0" containerID="880f9840ef05ddb638c346115184587b2f526bc02e6b7829847ec89265f2734e" exitCode=255 Jun 03 16:17:47.317306 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.317219 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" event={"ID":"d8f45027-664c-47e2-a385-7c4fe95993f0","Type":"ContainerDied","Data":"880f9840ef05ddb638c346115184587b2f526bc02e6b7829847ec89265f2734e"} Jun 03 16:17:47.317546 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.317519 2559 scope.go:117] "RemoveContainer" containerID="880f9840ef05ddb638c346115184587b2f526bc02e6b7829847ec89265f2734e" Jun 03 16:17:47.318525 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.318484 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" event={"ID":"4b64896f-1e21-436e-8c9b-52dabfbf3576","Type":"ContainerStarted","Data":"79241fd9b24d970848ad4800f51b34b3cf594a0f8b9e12ae9e8915b5585ef412"} Jun 03 16:17:47.319898 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.319874 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" event={"ID":"dee86b17-6167-42fc-a8ec-52db70989ee6","Type":"ContainerStarted","Data":"01bd2ab2919291271d31bafd1f326f7d891576262aec6843756e4eecda944be8"} Jun 03 16:17:47.321557 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.321537 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-r8gml" event={"ID":"27ef8f31-95e5-4c5b-b582-6fa848db3a16","Type":"ContainerStarted","Data":"c92e289c3050f840e0297492191bd82a0c35c77786b2f8a30d7d4c828e47cca4"} Jun 03 16:17:47.322828 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.322807 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zkx42" event={"ID":"c1f85abe-3593-4155-99a9-696dde6fb845","Type":"ContainerStarted","Data":"9b0c825a88ee9a09c4ddd9b6a877a5471d800911e19800eac3d7812c14d9a225"} Jun 03 16:17:47.323988 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.323967 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p" event={"ID":"1c7cdf66-f08f-4731-a137-e11387753942","Type":"ContainerStarted","Data":"a6be42cfd52e146ab90e302482e2920ef4382a3f0582b5cad39123619bdb300b"} Jun 03 16:17:47.330466 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.329815 2559 generic.go:358] "Generic (PLEG): container finished" podID="f8b84af5-f720-4e50-8fda-b9ea46260bf4" containerID="ced22cbea03e24d2185fbafbf5c0ff04d3ba582f1d9333797eb52aaa034d1d4c" exitCode=0 Jun 03 16:17:47.330466 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.329879 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdldd" event={"ID":"f8b84af5-f720-4e50-8fda-b9ea46260bf4","Type":"ContainerDied","Data":"ced22cbea03e24d2185fbafbf5c0ff04d3ba582f1d9333797eb52aaa034d1d4c"} Jun 03 16:17:47.331924 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.331894 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" event={"ID":"57ec466a-4a66-4dd3-b11a-22798042ffdb","Type":"ContainerStarted","Data":"080a791ebacccc6d656cc02fb3a6331882a32ebb0004f7c24daba23696406fed"} Jun 03 16:17:47.333430 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.333395 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-mz5lt" event={"ID":"f327c6e2-8b7e-45e2-b773-7ccbf8badc30","Type":"ContainerStarted","Data":"5539130051e9a47b00a84cf72f88fbc07f1e0b8b0397e422da877c63fb31716c"} Jun 03 16:17:47.339931 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.339458 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" event={"ID":"7a1e4ce7-bec0-4226-a92a-6454d031933e","Type":"ContainerStarted","Data":"2fffd14ac2f16cf08f6c58bff2f0150299d1b183b4f19f0f864275351f3ce308"} Jun 03 16:17:47.342740 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.342719 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-skggv" event={"ID":"8c6d76e3-79a7-412f-adb2-609947a1f7d5","Type":"ContainerStarted","Data":"5525cbd6e80288da52b52934489801fdcea0b68fb4b7920011a081b179cc987c"} Jun 03 16:17:47.353370 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.353324 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-r8gml" podStartSLOduration=30.342090381 podStartE2EDuration="39.353309692s" podCreationTimestamp="2026-06-03 16:17:08 +0000 UTC" firstStartedPulling="2026-06-03 16:17:37.486762045 +0000 UTC m=+35.003758687" lastFinishedPulling="2026-06-03 16:17:46.497981355 +0000 UTC m=+44.014977998" observedRunningTime="2026-06-03 16:17:47.352063873 +0000 UTC m=+44.869060522" watchObservedRunningTime="2026-06-03 16:17:47.353309692 +0000 UTC m=+44.870306333" Jun 03 16:17:47.392262 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.392209 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" podStartSLOduration=30.28606816 podStartE2EDuration="39.39219347s" podCreationTimestamp="2026-06-03 16:17:08 +0000 UTC" firstStartedPulling="2026-06-03 16:17:37.49692284 +0000 UTC m=+35.013919485" lastFinishedPulling="2026-06-03 16:17:46.603048153 +0000 UTC m=+44.120044795" observedRunningTime="2026-06-03 16:17:47.389911162 +0000 UTC m=+44.906907813" watchObservedRunningTime="2026-06-03 16:17:47.39219347 +0000 UTC m=+44.909190124" Jun 03 16:17:47.429575 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.428155 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-mz5lt" podStartSLOduration=30.331709641 podStartE2EDuration="39.428137591s" podCreationTimestamp="2026-06-03 16:17:08 +0000 UTC" firstStartedPulling="2026-06-03 16:17:37.509170718 +0000 UTC m=+35.026167361" lastFinishedPulling="2026-06-03 16:17:46.605598668 +0000 UTC m=+44.122595311" observedRunningTime="2026-06-03 16:17:47.409793094 +0000 UTC m=+44.926789747" watchObservedRunningTime="2026-06-03 16:17:47.428137591 +0000 UTC m=+44.945134241" Jun 03 16:17:47.429575 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:47.428916 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" podStartSLOduration=30.341843727 podStartE2EDuration="39.428904509s" podCreationTimestamp="2026-06-03 16:17:08 +0000 UTC" firstStartedPulling="2026-06-03 16:17:37.515990134 +0000 UTC m=+35.032986777" lastFinishedPulling="2026-06-03 16:17:46.603050926 +0000 UTC m=+44.120047559" observedRunningTime="2026-06-03 16:17:47.427498609 +0000 UTC m=+44.944495261" watchObservedRunningTime="2026-06-03 16:17:47.428904509 +0000 UTC m=+44.945901160" Jun 03 16:17:48.354032 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:48.353992 2559 generic.go:358] "Generic (PLEG): container finished" podID="f8b84af5-f720-4e50-8fda-b9ea46260bf4" containerID="079185f9b3a9a8b387f0060fc10a6a8752506b963f6a3f9124e6448e13563375" exitCode=0 Jun 03 16:17:48.354577 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:48.354097 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdldd" event={"ID":"f8b84af5-f720-4e50-8fda-b9ea46260bf4","Type":"ContainerDied","Data":"079185f9b3a9a8b387f0060fc10a6a8752506b963f6a3f9124e6448e13563375"} Jun 03 16:17:48.360145 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:48.359953 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/1.log" Jun 03 16:17:48.364233 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:48.363897 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/0.log" Jun 03 16:17:48.364233 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:48.363955 2559 generic.go:358] "Generic (PLEG): container finished" podID="d8f45027-664c-47e2-a385-7c4fe95993f0" containerID="a027aa1bd27c4877e33654d7af71532759e0ae0482b5e79e3530d57dca927f36" exitCode=255 Jun 03 16:17:48.364418 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:48.364350 2559 scope.go:117] "RemoveContainer" containerID="a027aa1bd27c4877e33654d7af71532759e0ae0482b5e79e3530d57dca927f36" Jun 03 16:17:48.364553 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:48.364529 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-lq5m4_openshift-console-operator(d8f45027-664c-47e2-a385-7c4fe95993f0)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" podUID="d8f45027-664c-47e2-a385-7c4fe95993f0" Jun 03 16:17:48.364738 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:48.364711 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" event={"ID":"d8f45027-664c-47e2-a385-7c4fe95993f0","Type":"ContainerDied","Data":"a027aa1bd27c4877e33654d7af71532759e0ae0482b5e79e3530d57dca927f36"} Jun 03 16:17:48.364838 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:48.364744 2559 scope.go:117] "RemoveContainer" containerID="880f9840ef05ddb638c346115184587b2f526bc02e6b7829847ec89265f2734e" Jun 03 16:17:48.381971 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:48.380799 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-skggv" podStartSLOduration=31.320797624 podStartE2EDuration="40.380782522s" podCreationTimestamp="2026-06-03 16:17:08 +0000 UTC" firstStartedPulling="2026-06-03 16:17:37.549613128 +0000 UTC m=+35.066609763" lastFinishedPulling="2026-06-03 16:17:46.609598027 +0000 UTC m=+44.126594661" observedRunningTime="2026-06-03 16:17:47.446557495 +0000 UTC m=+44.963554146" watchObservedRunningTime="2026-06-03 16:17:48.380782522 +0000 UTC m=+45.897779173" Jun 03 16:17:49.368765 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:49.368726 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/1.log" Jun 03 16:17:49.369213 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:49.369167 2559 scope.go:117] "RemoveContainer" containerID="a027aa1bd27c4877e33654d7af71532759e0ae0482b5e79e3530d57dca927f36" Jun 03 16:17:49.369423 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:49.369394 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-lq5m4_openshift-console-operator(d8f45027-664c-47e2-a385-7c4fe95993f0)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" podUID="d8f45027-664c-47e2-a385-7c4fe95993f0" Jun 03 16:17:49.373020 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:49.372979 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdldd" event={"ID":"f8b84af5-f720-4e50-8fda-b9ea46260bf4","Type":"ContainerStarted","Data":"1aed5a52f372b5353a23d26ad8e7f083731cf2770f614b9aaf95d6ff1816af73"} Jun 03 16:17:49.413572 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:49.413492 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mdldd" podStartSLOduration=4.152307834 podStartE2EDuration="46.413473359s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="2026-06-03 16:17:04.353076088 +0000 UTC m=+1.870072732" lastFinishedPulling="2026-06-03 16:17:46.614241626 +0000 UTC m=+44.131238257" observedRunningTime="2026-06-03 16:17:49.411818524 +0000 UTC m=+46.928815176" watchObservedRunningTime="2026-06-03 16:17:49.413473359 +0000 UTC m=+46.930470005" Jun 03 16:17:50.254792 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:50.254663 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l2gc6_38f3431f-3e93-4762-bb4e-41f7cdeb5c1e/dns-node-resolver/0.log" Jun 03 16:17:50.851292 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:50.851263 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-68nhq_66a3af12-9718-4e7f-b6e3-ef4b33be72c5/node-ca/0.log" Jun 03 16:17:52.699360 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:52.699320 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:17:52.699839 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.699624 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:17:52.699839 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.699644 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55db599d8c-tx7kf: secret "image-registry-tls" not found Jun 03 16:17:52.699839 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.699710 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls podName:54f07651-da39-4175-8afe-63fe1a871264 nodeName:}" failed. No retries permitted until 2026-06-03 16:18:08.699688262 +0000 UTC m=+66.216684890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls") pod "image-registry-55db599d8c-tx7kf" (UID: "54f07651-da39-4175-8afe-63fe1a871264") : secret "image-registry-tls" not found Jun 03 16:17:52.800601 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:52.800564 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:17:52.800805 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:52.800613 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:17:52.800805 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:52.800651 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:17:52.800805 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:52.800696 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:17:52.800805 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800715 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:17:52.800805 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:52.800726 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:52.800805 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:52.800763 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:17:52.800805 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800793 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 16:17:52.800805 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800804 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:17:52.801223 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800819 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls podName:044b7d3d-10a9-4d90-aee0-da4ddcdf9132 nodeName:}" failed. No retries permitted until 2026-06-03 16:18:08.800800781 +0000 UTC m=+66.317797411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls") pod "dns-default-84vdh" (UID: "044b7d3d-10a9-4d90-aee0-da4ddcdf9132") : secret "dns-default-metrics-tls" not found Jun 03 16:17:52.801223 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800836 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 16:17:52.801223 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:52.800793 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:17:52.801223 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800854 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls podName:f9b5373c-8df0-4b3f-9901-732b7611db6f nodeName:}" failed. No retries permitted until 2026-06-03 16:18:08.800836689 +0000 UTC m=+66.317833331 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gx4mc" (UID: "f9b5373c-8df0-4b3f-9901-732b7611db6f") : secret "samples-operator-tls" not found Jun 03 16:17:52.801223 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800877 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:17:52.801223 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800890 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert podName:dd27ea7c-d1de-4ba7-b04e-0e423252086f nodeName:}" failed. No retries permitted until 2026-06-03 16:18:08.800879864 +0000 UTC m=+66.317876496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert") pod "ingress-canary-9wbh7" (UID: "dd27ea7c-d1de-4ba7-b04e-0e423252086f") : secret "canary-serving-cert" not found Jun 03 16:17:52.801223 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800908 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:18:08.800899725 +0000 UTC m=+66.317896356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : configmap references non-existent config key: service-ca.crt Jun 03 16:17:52.801223 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800926 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert podName:7a9a71cc-0fa9-4cfc-a6cf-0311b8395784 nodeName:}" failed. No retries permitted until 2026-06-03 16:18:08.800917441 +0000 UTC m=+66.317914069 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-l67ld" (UID: "7a9a71cc-0fa9-4cfc-a6cf-0311b8395784") : secret "networking-console-plugin-cert" not found Jun 03 16:17:52.801223 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800932 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:52.801223 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.800945 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs podName:6234e9c7-9a83-4d91-847f-cd559b30aa96 nodeName:}" failed. No retries permitted until 2026-06-03 16:18:08.800937843 +0000 UTC m=+66.317934471 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs") pod "router-default-6868b4f58f-cq6sd" (UID: "6234e9c7-9a83-4d91-847f-cd559b30aa96") : secret "router-metrics-certs-default" not found Jun 03 16:17:52.801223 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:52.801019 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls podName:8211b5cc-90d3-4d03-9b66-7327113954c8 nodeName:}" failed. No retries permitted until 2026-06-03 16:18:08.801003157 +0000 UTC m=+66.317999798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-wmldl" (UID: "8211b5cc-90d3-4d03-9b66-7327113954c8") : secret "cluster-monitoring-operator-tls" not found Jun 03 16:17:55.389701 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:55.389669 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zkx42" event={"ID":"c1f85abe-3593-4155-99a9-696dde6fb845","Type":"ContainerStarted","Data":"c2b2f427e6d7f4ae484ea46102efcf1df8fe290028770e91ff8119968ee708f0"} Jun 03 16:17:55.391125 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:55.391101 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" event={"ID":"7a1e4ce7-bec0-4226-a92a-6454d031933e","Type":"ContainerStarted","Data":"91e258646a8375b5dcc4d9f45f463e231b7047d7411880bb251f796cc07ac3bb"} Jun 03 16:17:55.391296 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:55.391277 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:55.392405 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:55.392380 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" event={"ID":"4b64896f-1e21-436e-8c9b-52dabfbf3576","Type":"ContainerStarted","Data":"e73bc149cffd0636eed0cda0a69123d3fd091afc3bd49e718c4719fe41d59767"} Jun 03 16:17:55.393652 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:55.393621 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" Jun 03 16:17:55.415510 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:55.415375 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zkx42" podStartSLOduration=38.170601514 podStartE2EDuration="46.415362707s" podCreationTimestamp="2026-06-03 16:17:09 +0000 UTC" firstStartedPulling="2026-06-03 16:17:46.845775301 +0000 UTC m=+44.362771953" lastFinishedPulling="2026-06-03 16:17:55.090536504 +0000 UTC m=+52.607533146" observedRunningTime="2026-06-03 16:17:55.414774871 +0000 UTC m=+52.931771517" watchObservedRunningTime="2026-06-03 16:17:55.415362707 +0000 UTC m=+52.932359358" Jun 03 16:17:57.280972 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:57.280948 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:57.281285 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:57.280977 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:17:57.281376 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:57.281360 2559 scope.go:117] "RemoveContainer" containerID="a027aa1bd27c4877e33654d7af71532759e0ae0482b5e79e3530d57dca927f36" Jun 03 16:17:57.281597 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:17:57.281576 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-lq5m4_openshift-console-operator(d8f45027-664c-47e2-a385-7c4fe95993f0)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" podUID="d8f45027-664c-47e2-a385-7c4fe95993f0" Jun 03 16:17:57.398851 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:57.398813 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" event={"ID":"4b64896f-1e21-436e-8c9b-52dabfbf3576","Type":"ContainerStarted","Data":"f56e86159cc4f66c13772db8991a25e541fb1bef163a9f5574229ebaca02a527"} Jun 03 16:17:57.398851 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:57.398855 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" event={"ID":"4b64896f-1e21-436e-8c9b-52dabfbf3576","Type":"ContainerStarted","Data":"4c6f7f548b39138ebc880812d8c2eb439a5c60690c961d5f4c198c0461942740"} Jun 03 16:17:57.416184 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:57.416094 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" podStartSLOduration=6.071934311 podStartE2EDuration="16.416081539s" podCreationTimestamp="2026-06-03 16:17:41 +0000 UTC" firstStartedPulling="2026-06-03 16:17:46.811343758 +0000 UTC m=+44.328340399" lastFinishedPulling="2026-06-03 16:17:57.155490994 +0000 UTC m=+54.672487627" observedRunningTime="2026-06-03 16:17:57.414952499 +0000 UTC m=+54.931949173" watchObservedRunningTime="2026-06-03 16:17:57.416081539 +0000 UTC m=+54.933078188" Jun 03 16:17:57.416503 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:17:57.416480 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb9fd67fd-pvd7g" podStartSLOduration=8.363227569 podStartE2EDuration="16.416473403s" podCreationTimestamp="2026-06-03 16:17:41 +0000 UTC" firstStartedPulling="2026-06-03 16:17:47.054727945 +0000 UTC m=+44.571724579" lastFinishedPulling="2026-06-03 16:17:55.107973785 +0000 UTC m=+52.624970413" observedRunningTime="2026-06-03 16:17:55.464180327 +0000 UTC m=+52.981176977" watchObservedRunningTime="2026-06-03 16:17:57.416473403 +0000 UTC m=+54.933470078" Jun 03 16:18:00.407484 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:00.407444 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p" event={"ID":"1c7cdf66-f08f-4731-a137-e11387753942","Type":"ContainerStarted","Data":"6cab0a4dda6772e868876fe56dfdbcb82ed6fb72f174c9b00983a5ba81188d21"} Jun 03 16:18:00.422684 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:00.422621 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68bd5b5758-bvn8p" podStartSLOduration=6.874109097 podStartE2EDuration="19.422606742s" podCreationTimestamp="2026-06-03 16:17:41 +0000 UTC" firstStartedPulling="2026-06-03 16:17:46.865243789 +0000 UTC m=+44.382240433" lastFinishedPulling="2026-06-03 16:17:59.413741436 +0000 UTC m=+56.930738078" observedRunningTime="2026-06-03 16:18:00.421893243 +0000 UTC m=+57.938889893" watchObservedRunningTime="2026-06-03 16:18:00.422606742 +0000 UTC m=+57.939603392" Jun 03 16:18:01.658016 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:01.657966 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" podUID="4b64896f-1e21-436e-8c9b-52dabfbf3576" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 16:18:02.273192 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:02.273165 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztm65" Jun 03 16:18:07.844717 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:07.844672 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv6sb\" (UniqueName: \"kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb\") pod \"network-check-target-mbtmg\" (UID: \"3ac58c93-4c20-4957-ae6b-27c926ede940\") " pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:18:07.845213 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:07.844733 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:18:07.847283 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:07.847261 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 16:18:07.847438 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:07.847419 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv6sb\" (UniqueName: \"kubernetes.io/projected/3ac58c93-4c20-4957-ae6b-27c926ede940-kube-api-access-mv6sb\") pod \"network-check-target-mbtmg\" (UID: \"3ac58c93-4c20-4957-ae6b-27c926ede940\") " pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:18:07.857538 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:07.857519 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/525a53b8-7bcc-461b-89f0-cb054ce2ddfa-metrics-certs\") pod \"network-metrics-daemon-ks9qp\" (UID: \"525a53b8-7bcc-461b-89f0-cb054ce2ddfa\") " pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:18:07.968046 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:07.968020 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cchx6\"" Jun 03 16:18:07.976628 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:07.976606 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ks9qp" Jun 03 16:18:08.074264 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.074237 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9ccm\"" Jun 03 16:18:08.082743 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.082715 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:18:08.094161 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.094044 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ks9qp"] Jun 03 16:18:08.096501 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:18:08.096438 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525a53b8_7bcc_461b_89f0_cb054ce2ddfa.slice/crio-2af811037b57af7c208423a6e0de7df69d759efaed04ed4335af5b638b7bb2f9 WatchSource:0}: Error finding container 2af811037b57af7c208423a6e0de7df69d759efaed04ed4335af5b638b7bb2f9: Status 404 returned error can't find the container with id 2af811037b57af7c208423a6e0de7df69d759efaed04ed4335af5b638b7bb2f9 Jun 03 16:18:08.212908 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.212882 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mbtmg"] Jun 03 16:18:08.215292 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:18:08.215268 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac58c93_4c20_4957_ae6b_27c926ede940.slice/crio-5502ed1448f03ab464d0b764f9dc0988cb3706f77117a3ad022fde8597d08b5b WatchSource:0}: Error finding container 5502ed1448f03ab464d0b764f9dc0988cb3706f77117a3ad022fde8597d08b5b: Status 404 returned error can't find the container with id 5502ed1448f03ab464d0b764f9dc0988cb3706f77117a3ad022fde8597d08b5b Jun 03 16:18:08.426393 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.426356 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ks9qp" event={"ID":"525a53b8-7bcc-461b-89f0-cb054ce2ddfa","Type":"ContainerStarted","Data":"2af811037b57af7c208423a6e0de7df69d759efaed04ed4335af5b638b7bb2f9"} Jun 03 16:18:08.427581 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.427562 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mbtmg" event={"ID":"3ac58c93-4c20-4957-ae6b-27c926ede940","Type":"ContainerStarted","Data":"0a1690b56f91b8b012fd59714b8cda1a505152fd805471ab4a9836ad39d2c98b"} Jun 03 16:18:08.427654 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.427587 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mbtmg" event={"ID":"3ac58c93-4c20-4957-ae6b-27c926ede940","Type":"ContainerStarted","Data":"5502ed1448f03ab464d0b764f9dc0988cb3706f77117a3ad022fde8597d08b5b"} Jun 03 16:18:08.427796 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.427778 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:18:08.442931 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.442893 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mbtmg" podStartSLOduration=65.442881768 podStartE2EDuration="1m5.442881768s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:18:08.441621739 +0000 UTC m=+65.958618390" watchObservedRunningTime="2026-06-03 16:18:08.442881768 +0000 UTC m=+65.959878418" Jun 03 16:18:08.753291 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.753217 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:18:08.755492 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.755473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls\") pod \"image-registry-55db599d8c-tx7kf\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:18:08.854603 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.854530 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:18:08.854603 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.854590 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:18:08.855168 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.854621 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:18:08.855168 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.854651 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:18:08.855168 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.854694 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:18:08.855168 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.854733 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:18:08.855168 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.854787 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:18:08.855436 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.855320 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6234e9c7-9a83-4d91-847f-cd559b30aa96-service-ca-bundle\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:18:08.858510 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.858458 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6234e9c7-9a83-4d91-847f-cd559b30aa96-metrics-certs\") pod \"router-default-6868b4f58f-cq6sd\" (UID: \"6234e9c7-9a83-4d91-847f-cd559b30aa96\") " pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:18:08.858648 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.858578 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7a9a71cc-0fa9-4cfc-a6cf-0311b8395784-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-l67ld\" (UID: \"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:18:08.858992 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.858940 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/044b7d3d-10a9-4d90-aee0-da4ddcdf9132-metrics-tls\") pod \"dns-default-84vdh\" (UID: \"044b7d3d-10a9-4d90-aee0-da4ddcdf9132\") " pod="openshift-dns/dns-default-84vdh" Jun 03 16:18:08.859113 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.859094 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd27ea7c-d1de-4ba7-b04e-0e423252086f-cert\") pod \"ingress-canary-9wbh7\" (UID: \"dd27ea7c-d1de-4ba7-b04e-0e423252086f\") " pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:18:08.859174 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.859126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8211b5cc-90d3-4d03-9b66-7327113954c8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-wmldl\" (UID: \"8211b5cc-90d3-4d03-9b66-7327113954c8\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:18:08.859731 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:08.859708 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9b5373c-8df0-4b3f-9901-732b7611db6f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gx4mc\" (UID: \"f9b5373c-8df0-4b3f-9901-732b7611db6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:18:09.017795 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.017710 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9hn4z\"" Jun 03 16:18:09.026326 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.026306 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:18:09.051377 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.051350 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tnl2d\"" Jun 03 16:18:09.059477 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.059107 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" Jun 03 16:18:09.059477 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.059360 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-55rlw\"" Jun 03 16:18:09.067597 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.067575 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" Jun 03 16:18:09.067935 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.067912 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mr4n2\"" Jun 03 16:18:09.076567 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.076537 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:18:09.091485 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.091246 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hbrzz\"" Jun 03 16:18:09.095792 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.095560 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nmtcn\"" Jun 03 16:18:09.097744 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.097243 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" Jun 03 16:18:09.104474 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.104425 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9wbh7" Jun 03 16:18:09.109861 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.109020 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h928k\"" Jun 03 16:18:09.117539 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.117141 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-84vdh" Jun 03 16:18:09.208885 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.208395 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55db599d8c-tx7kf"] Jun 03 16:18:09.225621 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:18:09.225412 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f07651_da39_4175_8afe_63fe1a871264.slice/crio-a12ff5a463fcd3ba3c953720886a18902ae8894e7965c839f61e5a224ee58df1 WatchSource:0}: Error finding container a12ff5a463fcd3ba3c953720886a18902ae8894e7965c839f61e5a224ee58df1: Status 404 returned error can't find the container with id a12ff5a463fcd3ba3c953720886a18902ae8894e7965c839f61e5a224ee58df1 Jun 03 16:18:09.281823 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.280607 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl"] Jun 03 16:18:09.286567 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:18:09.286519 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8211b5cc_90d3_4d03_9b66_7327113954c8.slice/crio-2777c135256862f8e3b87c089ea0191f075f0f1aa93afa3a71e61d3c30ce7409 WatchSource:0}: Error finding container 2777c135256862f8e3b87c089ea0191f075f0f1aa93afa3a71e61d3c30ce7409: Status 404 returned error can't find the container with id 2777c135256862f8e3b87c089ea0191f075f0f1aa93afa3a71e61d3c30ce7409 Jun 03 16:18:09.313251 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.313226 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6868b4f58f-cq6sd"] Jun 03 16:18:09.316771 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:18:09.316729 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6234e9c7_9a83_4d91_847f_cd559b30aa96.slice/crio-90fd4e66cf5a471979172daf248c081014c42b4ebfba2f2cb4c90421849971fd WatchSource:0}: Error finding container 90fd4e66cf5a471979172daf248c081014c42b4ebfba2f2cb4c90421849971fd: Status 404 returned error can't find the container with id 90fd4e66cf5a471979172daf248c081014c42b4ebfba2f2cb4c90421849971fd Jun 03 16:18:09.320981 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.320959 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc"] Jun 03 16:18:09.345401 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.345373 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld"] Jun 03 16:18:09.348686 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:18:09.348657 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9a71cc_0fa9_4cfc_a6cf_0311b8395784.slice/crio-8a1edb90252d54b923d05bf37daf70d2d3eb37e458839aa575f4db6ed3e95406 WatchSource:0}: Error finding container 8a1edb90252d54b923d05bf37daf70d2d3eb37e458839aa575f4db6ed3e95406: Status 404 returned error can't find the container with id 8a1edb90252d54b923d05bf37daf70d2d3eb37e458839aa575f4db6ed3e95406 Jun 03 16:18:09.368633 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.368545 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9wbh7"] Jun 03 16:18:09.376718 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:18:09.376694 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd27ea7c_d1de_4ba7_b04e_0e423252086f.slice/crio-ef28e3331455114e0b77e4266433677a6bec643d73f7d7a6d9419d4853020a00 WatchSource:0}: Error finding container ef28e3331455114e0b77e4266433677a6bec643d73f7d7a6d9419d4853020a00: Status 404 returned error can't find the container with id ef28e3331455114e0b77e4266433677a6bec643d73f7d7a6d9419d4853020a00 Jun 03 16:18:09.388547 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.388517 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-84vdh"] Jun 03 16:18:09.393605 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:18:09.393581 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044b7d3d_10a9_4d90_aee0_da4ddcdf9132.slice/crio-bc1fa96cf0d61d9269a3a2e85d6e80c72f0fe41b512524870b5e5cf8d63bd97a WatchSource:0}: Error finding container bc1fa96cf0d61d9269a3a2e85d6e80c72f0fe41b512524870b5e5cf8d63bd97a: Status 404 returned error can't find the container with id bc1fa96cf0d61d9269a3a2e85d6e80c72f0fe41b512524870b5e5cf8d63bd97a Jun 03 16:18:09.431531 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.431496 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9wbh7" event={"ID":"dd27ea7c-d1de-4ba7-b04e-0e423252086f","Type":"ContainerStarted","Data":"ef28e3331455114e0b77e4266433677a6bec643d73f7d7a6d9419d4853020a00"} Jun 03 16:18:09.432622 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.432596 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" event={"ID":"f9b5373c-8df0-4b3f-9901-732b7611db6f","Type":"ContainerStarted","Data":"77a08e5a93aad70a9bdfe9ad8aea9f008efa5b4bcdde9e5a396301201afa9eb5"} Jun 03 16:18:09.434070 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.434047 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6868b4f58f-cq6sd" event={"ID":"6234e9c7-9a83-4d91-847f-cd559b30aa96","Type":"ContainerStarted","Data":"90fd4e66cf5a471979172daf248c081014c42b4ebfba2f2cb4c90421849971fd"} Jun 03 16:18:09.435172 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.435152 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" event={"ID":"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784","Type":"ContainerStarted","Data":"8a1edb90252d54b923d05bf37daf70d2d3eb37e458839aa575f4db6ed3e95406"} Jun 03 16:18:09.436469 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.436445 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" event={"ID":"54f07651-da39-4175-8afe-63fe1a871264","Type":"ContainerStarted","Data":"30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1"} Jun 03 16:18:09.436572 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.436475 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" event={"ID":"54f07651-da39-4175-8afe-63fe1a871264","Type":"ContainerStarted","Data":"a12ff5a463fcd3ba3c953720886a18902ae8894e7965c839f61e5a224ee58df1"} Jun 03 16:18:09.436572 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.436547 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:18:09.437419 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.437398 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-84vdh" event={"ID":"044b7d3d-10a9-4d90-aee0-da4ddcdf9132","Type":"ContainerStarted","Data":"bc1fa96cf0d61d9269a3a2e85d6e80c72f0fe41b512524870b5e5cf8d63bd97a"} Jun 03 16:18:09.438341 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.438320 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" event={"ID":"8211b5cc-90d3-4d03-9b66-7327113954c8","Type":"ContainerStarted","Data":"2777c135256862f8e3b87c089ea0191f075f0f1aa93afa3a71e61d3c30ce7409"} Jun 03 16:18:09.456196 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:09.456105 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" podStartSLOduration=66.456088464 podStartE2EDuration="1m6.456088464s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:18:09.454895624 +0000 UTC m=+66.971892309" watchObservedRunningTime="2026-06-03 16:18:09.456088464 +0000 UTC m=+66.973085115" Jun 03 16:18:10.056347 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:10.056311 2559 scope.go:117] "RemoveContainer" containerID="a027aa1bd27c4877e33654d7af71532759e0ae0482b5e79e3530d57dca927f36" Jun 03 16:18:10.446467 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:10.445704 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6868b4f58f-cq6sd" event={"ID":"6234e9c7-9a83-4d91-847f-cd559b30aa96","Type":"ContainerStarted","Data":"67ef2e1e0bc9dd076ae9954f1807ee1c44f504179bfca32ce78435a7d268ec42"} Jun 03 16:18:10.451425 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:10.449448 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/1.log" Jun 03 16:18:10.451425 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:10.449519 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" event={"ID":"d8f45027-664c-47e2-a385-7c4fe95993f0","Type":"ContainerStarted","Data":"b6445a0da1fac90fb1824227bb1527385c97e269ed9f8902a4f89d66e9fce2d8"} Jun 03 16:18:10.451425 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:10.450905 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:18:10.455197 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:10.455154 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ks9qp" event={"ID":"525a53b8-7bcc-461b-89f0-cb054ce2ddfa","Type":"ContainerStarted","Data":"259ef9f1e590e3c171ac01fd65704a310f0c8ba6008b9fe125f8becd7d3b6bc3"} Jun 03 16:18:10.491804 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:10.491268 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6868b4f58f-cq6sd" podStartSLOduration=62.491251442 podStartE2EDuration="1m2.491251442s" podCreationTimestamp="2026-06-03 16:17:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:18:10.471867339 +0000 UTC m=+67.988864016" watchObservedRunningTime="2026-06-03 16:18:10.491251442 +0000 UTC m=+68.008248094" Jun 03 16:18:10.491804 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:10.491547 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" podStartSLOduration=53.595459966 podStartE2EDuration="1m2.49153868s" podCreationTimestamp="2026-06-03 16:17:08 +0000 UTC" firstStartedPulling="2026-06-03 16:17:37.710426601 +0000 UTC m=+35.227423232" lastFinishedPulling="2026-06-03 16:17:46.606505318 +0000 UTC m=+44.123501946" observedRunningTime="2026-06-03 16:18:10.490074091 +0000 UTC m=+68.007070745" watchObservedRunningTime="2026-06-03 16:18:10.49153868 +0000 UTC m=+68.008535330" Jun 03 16:18:10.876275 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:10.876050 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-lq5m4" Jun 03 16:18:11.077636 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:11.077594 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:18:11.079952 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:11.079733 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:18:11.460485 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:11.460452 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ks9qp" event={"ID":"525a53b8-7bcc-461b-89f0-cb054ce2ddfa","Type":"ContainerStarted","Data":"8e93bb5e769e41e33e85a9be190a4d0039fdc23061caa005473981c05aac585b"} Jun 03 16:18:11.460954 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:11.460935 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:18:11.462120 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:11.462100 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6868b4f58f-cq6sd" Jun 03 16:18:11.475545 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:11.475500 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ks9qp" podStartSLOduration=66.432680689 podStartE2EDuration="1m8.475485414s" podCreationTimestamp="2026-06-03 16:17:03 +0000 UTC" firstStartedPulling="2026-06-03 16:18:08.098447084 +0000 UTC m=+65.615443730" lastFinishedPulling="2026-06-03 16:18:10.141251821 +0000 UTC m=+67.658248455" observedRunningTime="2026-06-03 16:18:11.474866834 +0000 UTC m=+68.991863484" watchObservedRunningTime="2026-06-03 16:18:11.475485414 +0000 UTC m=+68.992482061" Jun 03 16:18:11.658674 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:11.658623 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" podUID="4b64896f-1e21-436e-8c9b-52dabfbf3576" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 16:18:13.386534 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.386504 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5vrzx"] Jun 03 16:18:13.399859 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.399815 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.401885 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.401858 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5vrzx"] Jun 03 16:18:13.402017 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.401858 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hq6wm\"" Jun 03 16:18:13.402079 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.402044 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 16:18:13.402079 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.402061 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 16:18:13.497391 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.497316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89b44451-f3ad-4384-87f9-1e21fc07839d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.497542 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.497455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkgkf\" (UniqueName: \"kubernetes.io/projected/89b44451-f3ad-4384-87f9-1e21fc07839d-kube-api-access-hkgkf\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.497542 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.497514 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89b44451-f3ad-4384-87f9-1e21fc07839d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.497673 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.497619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89b44451-f3ad-4384-87f9-1e21fc07839d-crio-socket\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.497673 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.497657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89b44451-f3ad-4384-87f9-1e21fc07839d-data-volume\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.599063 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.599022 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89b44451-f3ad-4384-87f9-1e21fc07839d-crio-socket\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.599063 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.599059 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89b44451-f3ad-4384-87f9-1e21fc07839d-data-volume\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.599346 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.599139 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89b44451-f3ad-4384-87f9-1e21fc07839d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.599346 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.599143 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89b44451-f3ad-4384-87f9-1e21fc07839d-crio-socket\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.599346 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.599191 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkgkf\" (UniqueName: \"kubernetes.io/projected/89b44451-f3ad-4384-87f9-1e21fc07839d-kube-api-access-hkgkf\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.599346 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.599216 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89b44451-f3ad-4384-87f9-1e21fc07839d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.599555 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.599510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89b44451-f3ad-4384-87f9-1e21fc07839d-data-volume\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.600101 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.600072 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89b44451-f3ad-4384-87f9-1e21fc07839d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.601833 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.601810 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89b44451-f3ad-4384-87f9-1e21fc07839d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.609025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.608959 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkgkf\" (UniqueName: \"kubernetes.io/projected/89b44451-f3ad-4384-87f9-1e21fc07839d-kube-api-access-hkgkf\") pod \"insights-runtime-extractor-5vrzx\" (UID: \"89b44451-f3ad-4384-87f9-1e21fc07839d\") " pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:13.712218 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:13.712185 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5vrzx" Jun 03 16:18:14.578592 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:14.578563 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5vrzx"] Jun 03 16:18:15.479966 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.479927 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" event={"ID":"f9b5373c-8df0-4b3f-9901-732b7611db6f","Type":"ContainerStarted","Data":"3935e6fefbfe030a1e56879c86c7cc3bab3067a73cc30de790b6d12d89492985"} Jun 03 16:18:15.479966 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.479971 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" event={"ID":"f9b5373c-8df0-4b3f-9901-732b7611db6f","Type":"ContainerStarted","Data":"22ba01518d6bba0b2004e868f968d9ca7b6c640d6fa86282a4677d0f623b925f"} Jun 03 16:18:15.481223 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.481196 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vrzx" event={"ID":"89b44451-f3ad-4384-87f9-1e21fc07839d","Type":"ContainerStarted","Data":"ed3e8793f2053e1ccd67ee580c4c6eb0b458737d31fbd93732885a50e6cef809"} Jun 03 16:18:15.481342 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.481229 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vrzx" event={"ID":"89b44451-f3ad-4384-87f9-1e21fc07839d","Type":"ContainerStarted","Data":"11ef8fe47c2e1d7a76773daa006f95138bf66a8bc7ce60d27df218aefdf9ea02"} Jun 03 16:18:15.482437 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.482407 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" event={"ID":"7a9a71cc-0fa9-4cfc-a6cf-0311b8395784","Type":"ContainerStarted","Data":"e95f0d1f318795ae9c84785b0b03a62f4c4d6531d26c5ce43ba14e142c461c4c"} Jun 03 16:18:15.484041 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.484017 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-84vdh" event={"ID":"044b7d3d-10a9-4d90-aee0-da4ddcdf9132","Type":"ContainerStarted","Data":"abe57b83f1a106bd102215c9527cbb5e0230157f2508d6b772ee9946aff796e1"} Jun 03 16:18:15.484131 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.484043 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-84vdh" event={"ID":"044b7d3d-10a9-4d90-aee0-da4ddcdf9132","Type":"ContainerStarted","Data":"9fad24dc4451690dfbb029e72699d5bb6f28905a8ff9bab27de24a6fdf8a3142"} Jun 03 16:18:15.484191 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.484139 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-84vdh" Jun 03 16:18:15.485283 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.485265 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" event={"ID":"8211b5cc-90d3-4d03-9b66-7327113954c8","Type":"ContainerStarted","Data":"75d801936d79278ecbafd64b47b0f2a6f5a3d5ec0bd1ccd4fcb6d326ad3ac495"} Jun 03 16:18:15.486464 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.486445 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9wbh7" event={"ID":"dd27ea7c-d1de-4ba7-b04e-0e423252086f","Type":"ContainerStarted","Data":"d326722f9cff8c216889b6fcc80206ba72024dddcf888c869788359146274984"} Jun 03 16:18:15.495816 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.495781 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gx4mc" podStartSLOduration=62.463160552 podStartE2EDuration="1m7.495769238s" podCreationTimestamp="2026-06-03 16:17:08 +0000 UTC" firstStartedPulling="2026-06-03 16:18:09.400018642 +0000 UTC m=+66.917015282" lastFinishedPulling="2026-06-03 16:18:14.432627334 +0000 UTC m=+71.949623968" observedRunningTime="2026-06-03 16:18:15.495184899 +0000 UTC m=+73.012181549" watchObservedRunningTime="2026-06-03 16:18:15.495769238 +0000 UTC m=+73.012765883" Jun 03 16:18:15.520904 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.520867 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-84vdh" podStartSLOduration=34.484175329 podStartE2EDuration="39.52085559s" podCreationTimestamp="2026-06-03 16:17:36 +0000 UTC" firstStartedPulling="2026-06-03 16:18:09.395913741 +0000 UTC m=+66.912910372" lastFinishedPulling="2026-06-03 16:18:14.432593991 +0000 UTC m=+71.949590633" observedRunningTime="2026-06-03 16:18:15.519436772 +0000 UTC m=+73.036433421" watchObservedRunningTime="2026-06-03 16:18:15.52085559 +0000 UTC m=+73.037852240" Jun 03 16:18:15.541113 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.541075 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9wbh7" podStartSLOduration=34.484044654 podStartE2EDuration="39.541062102s" podCreationTimestamp="2026-06-03 16:17:36 +0000 UTC" firstStartedPulling="2026-06-03 16:18:09.378684263 +0000 UTC m=+66.895680895" lastFinishedPulling="2026-06-03 16:18:14.435701713 +0000 UTC m=+71.952698343" observedRunningTime="2026-06-03 16:18:15.54011255 +0000 UTC m=+73.057109202" watchObservedRunningTime="2026-06-03 16:18:15.541062102 +0000 UTC m=+73.058058752" Jun 03 16:18:15.561710 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.561662 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-wmldl" podStartSLOduration=62.418810675 podStartE2EDuration="1m7.561648889s" podCreationTimestamp="2026-06-03 16:17:08 +0000 UTC" firstStartedPulling="2026-06-03 16:18:09.289763993 +0000 UTC m=+66.806760634" lastFinishedPulling="2026-06-03 16:18:14.432602216 +0000 UTC m=+71.949598848" observedRunningTime="2026-06-03 16:18:15.560544299 +0000 UTC m=+73.077540948" watchObservedRunningTime="2026-06-03 16:18:15.561648889 +0000 UTC m=+73.078645539" Jun 03 16:18:15.576695 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:15.576649 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-l67ld" podStartSLOduration=38.495158202 podStartE2EDuration="43.576635942s" podCreationTimestamp="2026-06-03 16:17:32 +0000 UTC" firstStartedPulling="2026-06-03 16:18:09.351129335 +0000 UTC m=+66.868125967" lastFinishedPulling="2026-06-03 16:18:14.432607078 +0000 UTC m=+71.949603707" observedRunningTime="2026-06-03 16:18:15.575466659 +0000 UTC m=+73.092463308" watchObservedRunningTime="2026-06-03 16:18:15.576635942 +0000 UTC m=+73.093632593" Jun 03 16:18:16.490968 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:16.490928 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vrzx" event={"ID":"89b44451-f3ad-4384-87f9-1e21fc07839d","Type":"ContainerStarted","Data":"7fd1347c14ec5c196b3b4e8c44437550d65a7aad3d6368cd27e179da7a24c586"} Jun 03 16:18:18.498438 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:18.498399 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5vrzx" event={"ID":"89b44451-f3ad-4384-87f9-1e21fc07839d","Type":"ContainerStarted","Data":"4bdb624da2d118da63673101e803ad06be8418d45aee79e2f79fe282bde5e516"} Jun 03 16:18:18.517041 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:18.516999 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5vrzx" podStartSLOduration=2.779170005 podStartE2EDuration="5.516985775s" podCreationTimestamp="2026-06-03 16:18:13 +0000 UTC" firstStartedPulling="2026-06-03 16:18:14.722704008 +0000 UTC m=+72.239700653" lastFinishedPulling="2026-06-03 16:18:17.460519783 +0000 UTC m=+74.977516423" observedRunningTime="2026-06-03 16:18:18.51510091 +0000 UTC m=+76.032097561" watchObservedRunningTime="2026-06-03 16:18:18.516985775 +0000 UTC m=+76.033982425" Jun 03 16:18:21.657361 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:21.657323 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" podUID="4b64896f-1e21-436e-8c9b-52dabfbf3576" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 16:18:21.657716 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:21.657417 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" Jun 03 16:18:21.658011 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:21.657979 2559 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f56e86159cc4f66c13772db8991a25e541fb1bef163a9f5574229ebaca02a527"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 16:18:21.658067 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:21.658049 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" podUID="4b64896f-1e21-436e-8c9b-52dabfbf3576" containerName="service-proxy" containerID="cri-o://f56e86159cc4f66c13772db8991a25e541fb1bef163a9f5574229ebaca02a527" gracePeriod=30 Jun 03 16:18:22.512472 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:22.512440 2559 generic.go:358] "Generic (PLEG): container finished" podID="4b64896f-1e21-436e-8c9b-52dabfbf3576" containerID="f56e86159cc4f66c13772db8991a25e541fb1bef163a9f5574229ebaca02a527" exitCode=2 Jun 03 16:18:22.512647 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:22.512513 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" event={"ID":"4b64896f-1e21-436e-8c9b-52dabfbf3576","Type":"ContainerDied","Data":"f56e86159cc4f66c13772db8991a25e541fb1bef163a9f5574229ebaca02a527"} Jun 03 16:18:22.512647 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:22.512547 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-695c868675-zrjqq" event={"ID":"4b64896f-1e21-436e-8c9b-52dabfbf3576","Type":"ContainerStarted","Data":"afe43665a07a0ee3b50d16307a7e2e39658dd9fb4ad14403e884dbcfeabc784b"} Jun 03 16:18:25.493160 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:25.493124 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-84vdh" Jun 03 16:18:26.547766 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.547728 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d5wrv"] Jun 03 16:18:26.550572 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.550555 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.552799 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.552776 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 16:18:26.552964 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.552799 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 16:18:26.552964 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.552818 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 16:18:26.552964 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.552877 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 16:18:26.553307 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.553293 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8kl4l\"" Jun 03 16:18:26.605143 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.605106 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7161e58c-6398-4623-a685-71a8aca25673-metrics-client-ca\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.605282 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.605155 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7zzb\" (UniqueName: \"kubernetes.io/projected/7161e58c-6398-4623-a685-71a8aca25673-kube-api-access-h7zzb\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.605282 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.605186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-accelerators-collector-config\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.605282 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.605240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.605406 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.605279 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7161e58c-6398-4623-a685-71a8aca25673-sys\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.605406 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.605308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-tls\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.605406 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.605352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-textfile\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.605406 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.605403 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7161e58c-6398-4623-a685-71a8aca25673-root\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.605552 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.605422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-wtmp\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706400 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706371 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706555 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706417 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7161e58c-6398-4623-a685-71a8aca25673-sys\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706555 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706439 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-tls\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706555 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706459 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-textfile\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706555 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706494 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7161e58c-6398-4623-a685-71a8aca25673-root\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706555 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706498 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7161e58c-6398-4623-a685-71a8aca25673-sys\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706555 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706511 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-wtmp\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706555 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:18:26.706531 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 16:18:26.706555 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706543 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7161e58c-6398-4623-a685-71a8aca25673-metrics-client-ca\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706961 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706582 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7161e58c-6398-4623-a685-71a8aca25673-root\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706961 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:18:26.706590 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-tls podName:7161e58c-6398-4623-a685-71a8aca25673 nodeName:}" failed. No retries permitted until 2026-06-03 16:18:27.206568851 +0000 UTC m=+84.723565479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-tls") pod "node-exporter-d5wrv" (UID: "7161e58c-6398-4623-a685-71a8aca25673") : secret "node-exporter-tls" not found Jun 03 16:18:26.706961 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706623 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7zzb\" (UniqueName: \"kubernetes.io/projected/7161e58c-6398-4623-a685-71a8aca25673-kube-api-access-h7zzb\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706961 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706660 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-accelerators-collector-config\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706961 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-wtmp\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.706961 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.706909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-textfile\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.707216 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.707199 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7161e58c-6398-4623-a685-71a8aca25673-metrics-client-ca\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.707252 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.707203 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-accelerators-collector-config\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.708779 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.708743 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:26.718701 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:26.718672 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7zzb\" (UniqueName: \"kubernetes.io/projected/7161e58c-6398-4623-a685-71a8aca25673-kube-api-access-h7zzb\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:27.210123 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:27.210091 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-tls\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:27.212349 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:27.212327 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7161e58c-6398-4623-a685-71a8aca25673-node-exporter-tls\") pod \"node-exporter-d5wrv\" (UID: \"7161e58c-6398-4623-a685-71a8aca25673\") " pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:27.459630 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:27.459595 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d5wrv" Jun 03 16:18:27.469184 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:18:27.469150 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7161e58c_6398_4623_a685_71a8aca25673.slice/crio-e9154479f0bcc88d884fbcf75b22ecdea8bc9a6ec7c83675a8df43ddb975252f WatchSource:0}: Error finding container e9154479f0bcc88d884fbcf75b22ecdea8bc9a6ec7c83675a8df43ddb975252f: Status 404 returned error can't find the container with id e9154479f0bcc88d884fbcf75b22ecdea8bc9a6ec7c83675a8df43ddb975252f Jun 03 16:18:27.527678 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:27.527649 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d5wrv" event={"ID":"7161e58c-6398-4623-a685-71a8aca25673","Type":"ContainerStarted","Data":"e9154479f0bcc88d884fbcf75b22ecdea8bc9a6ec7c83675a8df43ddb975252f"} Jun 03 16:18:28.531994 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:28.531957 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d5wrv" event={"ID":"7161e58c-6398-4623-a685-71a8aca25673","Type":"ContainerStarted","Data":"5f126159ab1fc7252342cd59dba27afd562fe9fae0ba5963a0ed1483e57dd0a2"} Jun 03 16:18:29.535557 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:29.535527 2559 generic.go:358] "Generic (PLEG): container finished" podID="7161e58c-6398-4623-a685-71a8aca25673" containerID="5f126159ab1fc7252342cd59dba27afd562fe9fae0ba5963a0ed1483e57dd0a2" exitCode=0 Jun 03 16:18:29.535949 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:29.535583 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d5wrv" event={"ID":"7161e58c-6398-4623-a685-71a8aca25673","Type":"ContainerDied","Data":"5f126159ab1fc7252342cd59dba27afd562fe9fae0ba5963a0ed1483e57dd0a2"} Jun 03 16:18:30.458795 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:30.458767 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:18:30.540099 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:30.540069 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d5wrv" event={"ID":"7161e58c-6398-4623-a685-71a8aca25673","Type":"ContainerStarted","Data":"441490125e16ef6e9f1f6f80ea48c26f9cae40d15e198758d285c034f746d893"} Jun 03 16:18:30.540099 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:30.540101 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d5wrv" event={"ID":"7161e58c-6398-4623-a685-71a8aca25673","Type":"ContainerStarted","Data":"638515e58d977cefbffdc5464e720a2ade576cf4a02ab8c78e21c056b3638d63"} Jun 03 16:18:30.561992 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:30.561944 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d5wrv" podStartSLOduration=3.596923787 podStartE2EDuration="4.561929502s" podCreationTimestamp="2026-06-03 16:18:26 +0000 UTC" firstStartedPulling="2026-06-03 16:18:27.471106864 +0000 UTC m=+84.988103505" lastFinishedPulling="2026-06-03 16:18:28.436112588 +0000 UTC m=+85.953109220" observedRunningTime="2026-06-03 16:18:30.560403435 +0000 UTC m=+88.077400096" watchObservedRunningTime="2026-06-03 16:18:30.561929502 +0000 UTC m=+88.078926189" Jun 03 16:18:35.598523 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:35.598490 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55db599d8c-tx7kf"] Jun 03 16:18:39.441185 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:18:39.441153 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mbtmg" Jun 03 16:19:00.617999 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.617940 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" podUID="54f07651-da39-4175-8afe-63fe1a871264" containerName="registry" containerID="cri-o://30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1" gracePeriod=30 Jun 03 16:19:00.861385 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.861361 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:19:00.892353 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.892269 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-installation-pull-secrets\") pod \"54f07651-da39-4175-8afe-63fe1a871264\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " Jun 03 16:19:00.892353 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.892306 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-bound-sa-token\") pod \"54f07651-da39-4175-8afe-63fe1a871264\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " Jun 03 16:19:00.892579 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.892356 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-662cz\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-kube-api-access-662cz\") pod \"54f07651-da39-4175-8afe-63fe1a871264\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " Jun 03 16:19:00.892579 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.892453 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls\") pod \"54f07651-da39-4175-8afe-63fe1a871264\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " Jun 03 16:19:00.892579 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.892504 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-trusted-ca\") pod \"54f07651-da39-4175-8afe-63fe1a871264\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " Jun 03 16:19:00.892579 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.892539 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54f07651-da39-4175-8afe-63fe1a871264-ca-trust-extracted\") pod \"54f07651-da39-4175-8afe-63fe1a871264\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " Jun 03 16:19:00.892579 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.892567 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-registry-certificates\") pod \"54f07651-da39-4175-8afe-63fe1a871264\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " Jun 03 16:19:00.892852 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.892607 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-image-registry-private-configuration\") pod \"54f07651-da39-4175-8afe-63fe1a871264\" (UID: \"54f07651-da39-4175-8afe-63fe1a871264\") " Jun 03 16:19:00.893048 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.893018 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "54f07651-da39-4175-8afe-63fe1a871264" (UID: "54f07651-da39-4175-8afe-63fe1a871264"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:19:00.893182 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.893147 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "54f07651-da39-4175-8afe-63fe1a871264" (UID: "54f07651-da39-4175-8afe-63fe1a871264"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:19:00.895438 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.895408 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-kube-api-access-662cz" (OuterVolumeSpecName: "kube-api-access-662cz") pod "54f07651-da39-4175-8afe-63fe1a871264" (UID: "54f07651-da39-4175-8afe-63fe1a871264"). InnerVolumeSpecName "kube-api-access-662cz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:19:00.895583 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.895527 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "54f07651-da39-4175-8afe-63fe1a871264" (UID: "54f07651-da39-4175-8afe-63fe1a871264"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:19:00.895644 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.895574 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "54f07651-da39-4175-8afe-63fe1a871264" (UID: "54f07651-da39-4175-8afe-63fe1a871264"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:19:00.895894 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.895869 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "54f07651-da39-4175-8afe-63fe1a871264" (UID: "54f07651-da39-4175-8afe-63fe1a871264"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:19:00.895966 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.895875 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "54f07651-da39-4175-8afe-63fe1a871264" (UID: "54f07651-da39-4175-8afe-63fe1a871264"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:19:00.901862 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.901831 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54f07651-da39-4175-8afe-63fe1a871264-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "54f07651-da39-4175-8afe-63fe1a871264" (UID: "54f07651-da39-4175-8afe-63fe1a871264"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:19:00.993440 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.993399 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-662cz\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-kube-api-access-662cz\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:19:00.993440 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.993435 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-registry-tls\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:19:00.993440 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.993445 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-trusted-ca\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:19:00.993659 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.993453 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54f07651-da39-4175-8afe-63fe1a871264-ca-trust-extracted\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:19:00.993659 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.993462 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54f07651-da39-4175-8afe-63fe1a871264-registry-certificates\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:19:00.993659 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.993473 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-image-registry-private-configuration\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:19:00.993659 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.993483 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54f07651-da39-4175-8afe-63fe1a871264-installation-pull-secrets\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:19:00.993659 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:00.993491 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54f07651-da39-4175-8afe-63fe1a871264-bound-sa-token\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:19:01.625015 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:01.624978 2559 generic.go:358] "Generic (PLEG): container finished" podID="54f07651-da39-4175-8afe-63fe1a871264" containerID="30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1" exitCode=0 Jun 03 16:19:01.625472 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:01.625022 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" event={"ID":"54f07651-da39-4175-8afe-63fe1a871264","Type":"ContainerDied","Data":"30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1"} Jun 03 16:19:01.625472 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:01.625042 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" Jun 03 16:19:01.625472 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:01.625055 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55db599d8c-tx7kf" event={"ID":"54f07651-da39-4175-8afe-63fe1a871264","Type":"ContainerDied","Data":"a12ff5a463fcd3ba3c953720886a18902ae8894e7965c839f61e5a224ee58df1"} Jun 03 16:19:01.625472 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:01.625073 2559 scope.go:117] "RemoveContainer" containerID="30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1" Jun 03 16:19:01.632873 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:01.632854 2559 scope.go:117] "RemoveContainer" containerID="30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1" Jun 03 16:19:01.633138 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:19:01.633110 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1\": container with ID starting with 30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1 not found: ID does not exist" containerID="30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1" Jun 03 16:19:01.633202 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:01.633146 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1"} err="failed to get container status \"30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1\": rpc error: code = NotFound desc = could not find container \"30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1\": container with ID starting with 30b8de40c0ed1932299b84941bf725ea311c48a244b2e8c5ea94c5b6c01c1cd1 not found: ID does not exist" Jun 03 16:19:01.645677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:01.645649 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55db599d8c-tx7kf"] Jun 03 16:19:01.647969 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:01.647945 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55db599d8c-tx7kf"] Jun 03 16:19:03.060686 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:03.060644 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54f07651-da39-4175-8afe-63fe1a871264" path="/var/lib/kubelet/pods/54f07651-da39-4175-8afe-63fe1a871264/volumes" Jun 03 16:19:07.643470 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:07.643435 2559 generic.go:358] "Generic (PLEG): container finished" podID="dee86b17-6167-42fc-a8ec-52db70989ee6" containerID="01bd2ab2919291271d31bafd1f326f7d891576262aec6843756e4eecda944be8" exitCode=0 Jun 03 16:19:07.643871 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:07.643493 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" event={"ID":"dee86b17-6167-42fc-a8ec-52db70989ee6","Type":"ContainerDied","Data":"01bd2ab2919291271d31bafd1f326f7d891576262aec6843756e4eecda944be8"} Jun 03 16:19:07.643871 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:07.643824 2559 scope.go:117] "RemoveContainer" containerID="01bd2ab2919291271d31bafd1f326f7d891576262aec6843756e4eecda944be8" Jun 03 16:19:08.647957 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:08.647918 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-5hcrs" event={"ID":"dee86b17-6167-42fc-a8ec-52db70989ee6","Type":"ContainerStarted","Data":"3f82b22d9f0b44ad68cfe612689441e6c31d6370348bf93a764e45aad009e9db"} Jun 03 16:19:12.664815 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:12.664778 2559 generic.go:358] "Generic (PLEG): container finished" podID="f327c6e2-8b7e-45e2-b773-7ccbf8badc30" containerID="5539130051e9a47b00a84cf72f88fbc07f1e0b8b0397e422da877c63fb31716c" exitCode=0 Jun 03 16:19:12.665265 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:12.664823 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-mz5lt" event={"ID":"f327c6e2-8b7e-45e2-b773-7ccbf8badc30","Type":"ContainerDied","Data":"5539130051e9a47b00a84cf72f88fbc07f1e0b8b0397e422da877c63fb31716c"} Jun 03 16:19:12.665265 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:12.665198 2559 scope.go:117] "RemoveContainer" containerID="5539130051e9a47b00a84cf72f88fbc07f1e0b8b0397e422da877c63fb31716c" Jun 03 16:19:13.669093 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:13.669063 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-mz5lt" event={"ID":"f327c6e2-8b7e-45e2-b773-7ccbf8badc30","Type":"ContainerStarted","Data":"84812ef2aa926415e72e8e683dff75bda0b222a5a0d9985c0a923a4d0a4cde2c"} Jun 03 16:19:14.672693 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:14.672657 2559 generic.go:358] "Generic (PLEG): container finished" podID="57ec466a-4a66-4dd3-b11a-22798042ffdb" containerID="080a791ebacccc6d656cc02fb3a6331882a32ebb0004f7c24daba23696406fed" exitCode=0 Jun 03 16:19:14.673094 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:14.672731 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" event={"ID":"57ec466a-4a66-4dd3-b11a-22798042ffdb","Type":"ContainerDied","Data":"080a791ebacccc6d656cc02fb3a6331882a32ebb0004f7c24daba23696406fed"} Jun 03 16:19:14.673094 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:14.673063 2559 scope.go:117] "RemoveContainer" containerID="080a791ebacccc6d656cc02fb3a6331882a32ebb0004f7c24daba23696406fed" Jun 03 16:19:15.677395 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:19:15.677359 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-4wctr" event={"ID":"57ec466a-4a66-4dd3-b11a-22798042ffdb","Type":"ContainerStarted","Data":"06e1090fed3aa329a2909579f985ae43453e1c763820491b25d48f5ff35980f9"} Jun 03 16:22:02.939028 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:22:02.938994 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/1.log" Jun 03 16:22:02.939515 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:22:02.939497 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/1.log" Jun 03 16:22:02.943417 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:22:02.943384 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztm65_7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1/ovn-acl-logging/0.log" Jun 03 16:22:02.943862 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:22:02.943839 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztm65_7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1/ovn-acl-logging/0.log" Jun 03 16:22:02.950234 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:22:02.950215 2559 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 16:23:34.146698 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.146657 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5"] Jun 03 16:23:34.147307 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.147111 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54f07651-da39-4175-8afe-63fe1a871264" containerName="registry" Jun 03 16:23:34.147307 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.147130 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="54f07651-da39-4175-8afe-63fe1a871264" containerName="registry" Jun 03 16:23:34.147307 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.147224 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="54f07651-da39-4175-8afe-63fe1a871264" containerName="registry" Jun 03 16:23:34.150891 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.150871 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:34.153303 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.153283 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 16:23:34.153446 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.153425 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 16:23:34.153513 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.153499 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 16:23:34.153578 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.153558 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 16:23:34.153638 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.153617 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lbsp8\"" Jun 03 16:23:34.166919 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.166894 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5"] Jun 03 16:23:34.288664 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.288619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkdbd\" (UniqueName: \"kubernetes.io/projected/591a7fe2-a90d-4ed6-9d38-f2cbbf45b316-kube-api-access-wkdbd\") pod \"opendatahub-operator-controller-manager-6c656db94d-xb4p5\" (UID: \"591a7fe2-a90d-4ed6-9d38-f2cbbf45b316\") " pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:34.288850 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.288666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/591a7fe2-a90d-4ed6-9d38-f2cbbf45b316-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c656db94d-xb4p5\" (UID: \"591a7fe2-a90d-4ed6-9d38-f2cbbf45b316\") " pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:34.288850 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.288802 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/591a7fe2-a90d-4ed6-9d38-f2cbbf45b316-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c656db94d-xb4p5\" (UID: \"591a7fe2-a90d-4ed6-9d38-f2cbbf45b316\") " pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:34.390113 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.390081 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/591a7fe2-a90d-4ed6-9d38-f2cbbf45b316-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c656db94d-xb4p5\" (UID: \"591a7fe2-a90d-4ed6-9d38-f2cbbf45b316\") " pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:34.390279 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.390144 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wkdbd\" (UniqueName: \"kubernetes.io/projected/591a7fe2-a90d-4ed6-9d38-f2cbbf45b316-kube-api-access-wkdbd\") pod \"opendatahub-operator-controller-manager-6c656db94d-xb4p5\" (UID: \"591a7fe2-a90d-4ed6-9d38-f2cbbf45b316\") " pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:34.390279 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.390187 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/591a7fe2-a90d-4ed6-9d38-f2cbbf45b316-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c656db94d-xb4p5\" (UID: \"591a7fe2-a90d-4ed6-9d38-f2cbbf45b316\") " pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:34.392529 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.392497 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/591a7fe2-a90d-4ed6-9d38-f2cbbf45b316-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c656db94d-xb4p5\" (UID: \"591a7fe2-a90d-4ed6-9d38-f2cbbf45b316\") " pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:34.392632 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.392505 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/591a7fe2-a90d-4ed6-9d38-f2cbbf45b316-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c656db94d-xb4p5\" (UID: \"591a7fe2-a90d-4ed6-9d38-f2cbbf45b316\") " pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:34.398700 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.398651 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkdbd\" (UniqueName: \"kubernetes.io/projected/591a7fe2-a90d-4ed6-9d38-f2cbbf45b316-kube-api-access-wkdbd\") pod \"opendatahub-operator-controller-manager-6c656db94d-xb4p5\" (UID: \"591a7fe2-a90d-4ed6-9d38-f2cbbf45b316\") " pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:34.460619 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.460593 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:34.590480 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.590459 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5"] Jun 03 16:23:34.593182 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:23:34.593157 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591a7fe2_a90d_4ed6_9d38_f2cbbf45b316.slice/crio-c0668130fb12d96eb8d294081569f6c3049fd2e437fdb4da01562e9cf0fa64c0 WatchSource:0}: Error finding container c0668130fb12d96eb8d294081569f6c3049fd2e437fdb4da01562e9cf0fa64c0: Status 404 returned error can't find the container with id c0668130fb12d96eb8d294081569f6c3049fd2e437fdb4da01562e9cf0fa64c0 Jun 03 16:23:34.594760 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:34.594734 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:23:35.389921 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:35.389886 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" event={"ID":"591a7fe2-a90d-4ed6-9d38-f2cbbf45b316","Type":"ContainerStarted","Data":"c0668130fb12d96eb8d294081569f6c3049fd2e437fdb4da01562e9cf0fa64c0"} Jun 03 16:23:37.398893 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:37.398853 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" event={"ID":"591a7fe2-a90d-4ed6-9d38-f2cbbf45b316","Type":"ContainerStarted","Data":"c17879c3ee6a9dda1a9fda6786983b68ecc0bb21b5cd9cfe6855e2beec89ff71"} Jun 03 16:23:37.399260 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:37.398964 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:37.434793 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:37.434577 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" podStartSLOduration=0.803103683 podStartE2EDuration="3.434566919s" podCreationTimestamp="2026-06-03 16:23:34 +0000 UTC" firstStartedPulling="2026-06-03 16:23:34.594875969 +0000 UTC m=+392.111872597" lastFinishedPulling="2026-06-03 16:23:37.226339189 +0000 UTC m=+394.743335833" observedRunningTime="2026-06-03 16:23:37.433000135 +0000 UTC m=+394.949996784" watchObservedRunningTime="2026-06-03 16:23:37.434566919 +0000 UTC m=+394.951563635" Jun 03 16:23:48.403661 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:48.403631 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c656db94d-xb4p5" Jun 03 16:23:55.377163 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:55.377132 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-hpcs7"] Jun 03 16:23:55.380359 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:55.380341 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:23:55.384003 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:55.383978 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-w6rg8\"" Jun 03 16:23:55.384137 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:55.384006 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 16:23:55.394523 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:55.394496 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-hpcs7"] Jun 03 16:23:55.558260 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:55.558222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5jtf\" (UniqueName: \"kubernetes.io/projected/31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca-kube-api-access-k5jtf\") pod \"odh-model-controller-858dbf95b8-hpcs7\" (UID: \"31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca\") " pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:23:55.558435 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:55.558267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca-cert\") pod \"odh-model-controller-858dbf95b8-hpcs7\" (UID: \"31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca\") " pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:23:55.659522 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:55.659434 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k5jtf\" (UniqueName: \"kubernetes.io/projected/31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca-kube-api-access-k5jtf\") pod \"odh-model-controller-858dbf95b8-hpcs7\" (UID: \"31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca\") " pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:23:55.659522 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:55.659476 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca-cert\") pod \"odh-model-controller-858dbf95b8-hpcs7\" (UID: \"31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca\") " pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:23:55.659841 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:23:55.659584 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 16:23:55.659841 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:23:55.659639 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca-cert podName:31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca nodeName:}" failed. No retries permitted until 2026-06-03 16:23:56.159622321 +0000 UTC m=+413.676618948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca-cert") pod "odh-model-controller-858dbf95b8-hpcs7" (UID: "31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca") : secret "odh-model-controller-webhook-cert" not found Jun 03 16:23:55.669059 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:55.669039 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5jtf\" (UniqueName: \"kubernetes.io/projected/31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca-kube-api-access-k5jtf\") pod \"odh-model-controller-858dbf95b8-hpcs7\" (UID: \"31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca\") " pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:23:56.163004 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:56.162972 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca-cert\") pod \"odh-model-controller-858dbf95b8-hpcs7\" (UID: \"31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca\") " pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:23:56.165394 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:56.165374 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca-cert\") pod \"odh-model-controller-858dbf95b8-hpcs7\" (UID: \"31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca\") " pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:23:56.291194 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:56.291162 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:23:56.412263 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:56.412229 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-hpcs7"] Jun 03 16:23:56.417140 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:23:56.417073 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e9514e_f6f3_4ab2_9b2e_08dedbdc60ca.slice/crio-af299e27b24609cbf11ba2a7108513eae9497f6b209dba14f4e3d0c9f9edb197 WatchSource:0}: Error finding container af299e27b24609cbf11ba2a7108513eae9497f6b209dba14f4e3d0c9f9edb197: Status 404 returned error can't find the container with id af299e27b24609cbf11ba2a7108513eae9497f6b209dba14f4e3d0c9f9edb197 Jun 03 16:23:56.459170 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:23:56.459141 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" event={"ID":"31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca","Type":"ContainerStarted","Data":"af299e27b24609cbf11ba2a7108513eae9497f6b209dba14f4e3d0c9f9edb197"} Jun 03 16:24:00.474766 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.474722 2559 generic.go:358] "Generic (PLEG): container finished" podID="31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca" containerID="e07eb436f047235343bf654e981d9c532e8071c6e3de9018155e5e2ed2ac07d1" exitCode=1 Jun 03 16:24:00.475123 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.474791 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" event={"ID":"31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca","Type":"ContainerDied","Data":"e07eb436f047235343bf654e981d9c532e8071c6e3de9018155e5e2ed2ac07d1"} Jun 03 16:24:00.475123 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.475037 2559 scope.go:117] "RemoveContainer" containerID="e07eb436f047235343bf654e981d9c532e8071c6e3de9018155e5e2ed2ac07d1" Jun 03 16:24:00.595800 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.595739 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-l4t9z"] Jun 03 16:24:00.599084 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.599059 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" Jun 03 16:24:00.603440 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.603419 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2mzcn\"" Jun 03 16:24:00.603561 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.603507 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 16:24:00.610383 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.610357 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-l4t9z"] Jun 03 16:24:00.704336 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.704303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/157615a9-d69f-4b8b-b021-1e25a0ace242-cert\") pod \"kserve-controller-manager-856948b99f-l4t9z\" (UID: \"157615a9-d69f-4b8b-b021-1e25a0ace242\") " pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" Jun 03 16:24:00.704489 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.704357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfsmk\" (UniqueName: \"kubernetes.io/projected/157615a9-d69f-4b8b-b021-1e25a0ace242-kube-api-access-rfsmk\") pod \"kserve-controller-manager-856948b99f-l4t9z\" (UID: \"157615a9-d69f-4b8b-b021-1e25a0ace242\") " pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" Jun 03 16:24:00.805731 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.805696 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfsmk\" (UniqueName: \"kubernetes.io/projected/157615a9-d69f-4b8b-b021-1e25a0ace242-kube-api-access-rfsmk\") pod \"kserve-controller-manager-856948b99f-l4t9z\" (UID: \"157615a9-d69f-4b8b-b021-1e25a0ace242\") " pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" Jun 03 16:24:00.805841 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.805801 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/157615a9-d69f-4b8b-b021-1e25a0ace242-cert\") pod \"kserve-controller-manager-856948b99f-l4t9z\" (UID: \"157615a9-d69f-4b8b-b021-1e25a0ace242\") " pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" Jun 03 16:24:00.805943 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:24:00.805929 2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 03 16:24:00.806009 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:24:00.805998 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/157615a9-d69f-4b8b-b021-1e25a0ace242-cert podName:157615a9-d69f-4b8b-b021-1e25a0ace242 nodeName:}" failed. No retries permitted until 2026-06-03 16:24:01.305976962 +0000 UTC m=+418.822973592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/157615a9-d69f-4b8b-b021-1e25a0ace242-cert") pod "kserve-controller-manager-856948b99f-l4t9z" (UID: "157615a9-d69f-4b8b-b021-1e25a0ace242") : secret "kserve-webhook-server-cert" not found Jun 03 16:24:00.816230 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:00.816201 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfsmk\" (UniqueName: \"kubernetes.io/projected/157615a9-d69f-4b8b-b021-1e25a0ace242-kube-api-access-rfsmk\") pod \"kserve-controller-manager-856948b99f-l4t9z\" (UID: \"157615a9-d69f-4b8b-b021-1e25a0ace242\") " pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" Jun 03 16:24:01.309894 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:01.309856 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/157615a9-d69f-4b8b-b021-1e25a0ace242-cert\") pod \"kserve-controller-manager-856948b99f-l4t9z\" (UID: \"157615a9-d69f-4b8b-b021-1e25a0ace242\") " pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" Jun 03 16:24:01.312331 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:01.312308 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/157615a9-d69f-4b8b-b021-1e25a0ace242-cert\") pod \"kserve-controller-manager-856948b99f-l4t9z\" (UID: \"157615a9-d69f-4b8b-b021-1e25a0ace242\") " pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" Jun 03 16:24:01.479036 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:01.479001 2559 generic.go:358] "Generic (PLEG): container finished" podID="31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca" containerID="b3458b81e4f019c7a785251f89d7016566a90fa034c9e4d23b16d2dc48dc98e6" exitCode=1 Jun 03 16:24:01.479455 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:01.479091 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" event={"ID":"31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca","Type":"ContainerDied","Data":"b3458b81e4f019c7a785251f89d7016566a90fa034c9e4d23b16d2dc48dc98e6"} Jun 03 16:24:01.479455 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:01.479131 2559 scope.go:117] "RemoveContainer" containerID="e07eb436f047235343bf654e981d9c532e8071c6e3de9018155e5e2ed2ac07d1" Jun 03 16:24:01.479455 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:01.479326 2559 scope.go:117] "RemoveContainer" containerID="b3458b81e4f019c7a785251f89d7016566a90fa034c9e4d23b16d2dc48dc98e6" Jun 03 16:24:01.479562 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:24:01.479543 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-hpcs7_opendatahub(31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca)\"" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" podUID="31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca" Jun 03 16:24:01.511359 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:01.511332 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" Jun 03 16:24:01.638343 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:01.638319 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-l4t9z"] Jun 03 16:24:01.640112 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:24:01.640084 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157615a9_d69f_4b8b_b021_1e25a0ace242.slice/crio-dc52e0e088bc496573dd525b3a21d3e127b3df7a6cddedcb47c4cc1f3c6a5c0f WatchSource:0}: Error finding container dc52e0e088bc496573dd525b3a21d3e127b3df7a6cddedcb47c4cc1f3c6a5c0f: Status 404 returned error can't find the container with id dc52e0e088bc496573dd525b3a21d3e127b3df7a6cddedcb47c4cc1f3c6a5c0f Jun 03 16:24:02.484273 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:02.484243 2559 scope.go:117] "RemoveContainer" containerID="b3458b81e4f019c7a785251f89d7016566a90fa034c9e4d23b16d2dc48dc98e6" Jun 03 16:24:02.484740 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:24:02.484484 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-hpcs7_opendatahub(31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca)\"" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" podUID="31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca" Jun 03 16:24:02.484952 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:02.484929 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" event={"ID":"157615a9-d69f-4b8b-b021-1e25a0ace242","Type":"ContainerStarted","Data":"dc52e0e088bc496573dd525b3a21d3e127b3df7a6cddedcb47c4cc1f3c6a5c0f"} Jun 03 16:24:03.143610 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.143572 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4"] Jun 03 16:24:03.150023 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.149992 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:03.153312 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.153292 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 16:24:03.153419 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.153329 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 16:24:03.159717 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.159694 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4"] Jun 03 16:24:03.225196 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.225169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c780928e-1daf-44b0-8e32-b9298fe5c0c9-tls-certs\") pod \"kube-auth-proxy-7b4fb99578-7d4q4\" (UID: \"c780928e-1daf-44b0-8e32-b9298fe5c0c9\") " pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:03.225196 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.225199 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jh7m\" (UniqueName: \"kubernetes.io/projected/c780928e-1daf-44b0-8e32-b9298fe5c0c9-kube-api-access-8jh7m\") pod \"kube-auth-proxy-7b4fb99578-7d4q4\" (UID: \"c780928e-1daf-44b0-8e32-b9298fe5c0c9\") " pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:03.225404 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.225236 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c780928e-1daf-44b0-8e32-b9298fe5c0c9-tmp\") pod \"kube-auth-proxy-7b4fb99578-7d4q4\" (UID: \"c780928e-1daf-44b0-8e32-b9298fe5c0c9\") " pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:03.326126 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.326082 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c780928e-1daf-44b0-8e32-b9298fe5c0c9-tls-certs\") pod \"kube-auth-proxy-7b4fb99578-7d4q4\" (UID: \"c780928e-1daf-44b0-8e32-b9298fe5c0c9\") " pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:03.326300 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.326134 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jh7m\" (UniqueName: \"kubernetes.io/projected/c780928e-1daf-44b0-8e32-b9298fe5c0c9-kube-api-access-8jh7m\") pod \"kube-auth-proxy-7b4fb99578-7d4q4\" (UID: \"c780928e-1daf-44b0-8e32-b9298fe5c0c9\") " pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:03.326300 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.326199 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c780928e-1daf-44b0-8e32-b9298fe5c0c9-tmp\") pod \"kube-auth-proxy-7b4fb99578-7d4q4\" (UID: \"c780928e-1daf-44b0-8e32-b9298fe5c0c9\") " pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:03.326300 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:24:03.326243 2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 03 16:24:03.326452 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:24:03.326321 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c780928e-1daf-44b0-8e32-b9298fe5c0c9-tls-certs podName:c780928e-1daf-44b0-8e32-b9298fe5c0c9 nodeName:}" failed. No retries permitted until 2026-06-03 16:24:03.826303344 +0000 UTC m=+421.343299971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c780928e-1daf-44b0-8e32-b9298fe5c0c9-tls-certs") pod "kube-auth-proxy-7b4fb99578-7d4q4" (UID: "c780928e-1daf-44b0-8e32-b9298fe5c0c9") : secret "kube-auth-proxy-tls" not found Jun 03 16:24:03.328762 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.328725 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c780928e-1daf-44b0-8e32-b9298fe5c0c9-tmp\") pod \"kube-auth-proxy-7b4fb99578-7d4q4\" (UID: \"c780928e-1daf-44b0-8e32-b9298fe5c0c9\") " pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:03.338281 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.338261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jh7m\" (UniqueName: \"kubernetes.io/projected/c780928e-1daf-44b0-8e32-b9298fe5c0c9-kube-api-access-8jh7m\") pod \"kube-auth-proxy-7b4fb99578-7d4q4\" (UID: \"c780928e-1daf-44b0-8e32-b9298fe5c0c9\") " pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:03.831090 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.831055 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c780928e-1daf-44b0-8e32-b9298fe5c0c9-tls-certs\") pod \"kube-auth-proxy-7b4fb99578-7d4q4\" (UID: \"c780928e-1daf-44b0-8e32-b9298fe5c0c9\") " pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:03.833851 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:03.833819 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c780928e-1daf-44b0-8e32-b9298fe5c0c9-tls-certs\") pod \"kube-auth-proxy-7b4fb99578-7d4q4\" (UID: \"c780928e-1daf-44b0-8e32-b9298fe5c0c9\") " pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:04.060462 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:04.060427 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" Jun 03 16:24:04.207278 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:04.207245 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4"] Jun 03 16:24:04.209656 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:24:04.209632 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc780928e_1daf_44b0_8e32_b9298fe5c0c9.slice/crio-c89653f63f8b19728b928abc811c218cc918d25eb5e8d357f1a24b0b67138cbf WatchSource:0}: Error finding container c89653f63f8b19728b928abc811c218cc918d25eb5e8d357f1a24b0b67138cbf: Status 404 returned error can't find the container with id c89653f63f8b19728b928abc811c218cc918d25eb5e8d357f1a24b0b67138cbf Jun 03 16:24:04.493077 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:04.492988 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" event={"ID":"c780928e-1daf-44b0-8e32-b9298fe5c0c9","Type":"ContainerStarted","Data":"c89653f63f8b19728b928abc811c218cc918d25eb5e8d357f1a24b0b67138cbf"} Jun 03 16:24:06.291340 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:06.291297 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:24:06.291885 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:06.291868 2559 scope.go:117] "RemoveContainer" containerID="b3458b81e4f019c7a785251f89d7016566a90fa034c9e4d23b16d2dc48dc98e6" Jun 03 16:24:06.292140 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:24:06.292113 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-hpcs7_opendatahub(31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca)\"" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" podUID="31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca" Jun 03 16:24:07.506676 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:07.506636 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" event={"ID":"157615a9-d69f-4b8b-b021-1e25a0ace242","Type":"ContainerStarted","Data":"e52173a48c8ef9fe8b1b9af3375d56368942ced4c4b223523c11a51780c88d2e"} Jun 03 16:24:07.507100 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:07.506736 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" Jun 03 16:24:07.524195 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:07.524152 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" podStartSLOduration=2.289588735 podStartE2EDuration="7.524141773s" podCreationTimestamp="2026-06-03 16:24:00 +0000 UTC" firstStartedPulling="2026-06-03 16:24:01.641420114 +0000 UTC m=+419.158416742" lastFinishedPulling="2026-06-03 16:24:06.875973146 +0000 UTC m=+424.392969780" observedRunningTime="2026-06-03 16:24:07.522373651 +0000 UTC m=+425.039370304" watchObservedRunningTime="2026-06-03 16:24:07.524141773 +0000 UTC m=+425.041138423" Jun 03 16:24:09.514490 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:09.514450 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" event={"ID":"c780928e-1daf-44b0-8e32-b9298fe5c0c9","Type":"ContainerStarted","Data":"aa5f00d5c14a4d5e532b5b5f0c4286fd4dd5dcd9ef6c639dc9bf42cd437a089e"} Jun 03 16:24:09.530943 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:09.530897 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b4fb99578-7d4q4" podStartSLOduration=1.956965015 podStartE2EDuration="6.530880122s" podCreationTimestamp="2026-06-03 16:24:03 +0000 UTC" firstStartedPulling="2026-06-03 16:24:04.211405945 +0000 UTC m=+421.728402588" lastFinishedPulling="2026-06-03 16:24:08.785321063 +0000 UTC m=+426.302317695" observedRunningTime="2026-06-03 16:24:09.529382865 +0000 UTC m=+427.046379514" watchObservedRunningTime="2026-06-03 16:24:09.530880122 +0000 UTC m=+427.047876774" Jun 03 16:24:16.292311 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:16.292272 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:24:16.292676 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:16.292624 2559 scope.go:117] "RemoveContainer" containerID="b3458b81e4f019c7a785251f89d7016566a90fa034c9e4d23b16d2dc48dc98e6" Jun 03 16:24:17.539443 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:17.539408 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" event={"ID":"31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca","Type":"ContainerStarted","Data":"0030743ab38c71ac6d8e78ef5d3969571b349f843caad549ad0ae8aa120c38a7"} Jun 03 16:24:17.539839 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:17.539618 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:24:17.616744 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:17.616692 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" podStartSLOduration=2.413762631 podStartE2EDuration="22.616676714s" podCreationTimestamp="2026-06-03 16:23:55 +0000 UTC" firstStartedPulling="2026-06-03 16:23:56.418071982 +0000 UTC m=+413.935068612" lastFinishedPulling="2026-06-03 16:24:16.620986064 +0000 UTC m=+434.137982695" observedRunningTime="2026-06-03 16:24:17.612915277 +0000 UTC m=+435.129911927" watchObservedRunningTime="2026-06-03 16:24:17.616676714 +0000 UTC m=+435.133673414" Jun 03 16:24:19.136431 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.136395 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-27xlg"] Jun 03 16:24:19.139670 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.139651 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" Jun 03 16:24:19.142087 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.142060 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 16:24:19.142818 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.142794 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 16:24:19.143708 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.143689 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-ghg94\"" Jun 03 16:24:19.158871 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.158849 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-27xlg"] Jun 03 16:24:19.264141 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.264106 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd2cp\" (UniqueName: \"kubernetes.io/projected/9ce1725f-20e6-4220-b2db-b76a9962ba5c-kube-api-access-kd2cp\") pod \"servicemesh-operator3-55f49c5f94-27xlg\" (UID: \"9ce1725f-20e6-4220-b2db-b76a9962ba5c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" Jun 03 16:24:19.264141 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.264140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9ce1725f-20e6-4220-b2db-b76a9962ba5c-operator-config\") pod \"servicemesh-operator3-55f49c5f94-27xlg\" (UID: \"9ce1725f-20e6-4220-b2db-b76a9962ba5c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" Jun 03 16:24:19.364877 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.364843 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd2cp\" (UniqueName: \"kubernetes.io/projected/9ce1725f-20e6-4220-b2db-b76a9962ba5c-kube-api-access-kd2cp\") pod \"servicemesh-operator3-55f49c5f94-27xlg\" (UID: \"9ce1725f-20e6-4220-b2db-b76a9962ba5c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" Jun 03 16:24:19.364877 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.364880 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9ce1725f-20e6-4220-b2db-b76a9962ba5c-operator-config\") pod \"servicemesh-operator3-55f49c5f94-27xlg\" (UID: \"9ce1725f-20e6-4220-b2db-b76a9962ba5c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" Jun 03 16:24:19.367316 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.367298 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9ce1725f-20e6-4220-b2db-b76a9962ba5c-operator-config\") pod \"servicemesh-operator3-55f49c5f94-27xlg\" (UID: \"9ce1725f-20e6-4220-b2db-b76a9962ba5c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" Jun 03 16:24:19.375165 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.375141 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd2cp\" (UniqueName: \"kubernetes.io/projected/9ce1725f-20e6-4220-b2db-b76a9962ba5c-kube-api-access-kd2cp\") pod \"servicemesh-operator3-55f49c5f94-27xlg\" (UID: \"9ce1725f-20e6-4220-b2db-b76a9962ba5c\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" Jun 03 16:24:19.448688 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.448617 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" Jun 03 16:24:19.589191 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:19.589168 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-27xlg"] Jun 03 16:24:19.591843 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:24:19.591810 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce1725f_20e6_4220_b2db_b76a9962ba5c.slice/crio-b4f0eae390390e1657beb84e20fd2fdb63cfc10834bea74efad7da59c8cacdfb WatchSource:0}: Error finding container b4f0eae390390e1657beb84e20fd2fdb63cfc10834bea74efad7da59c8cacdfb: Status 404 returned error can't find the container with id b4f0eae390390e1657beb84e20fd2fdb63cfc10834bea74efad7da59c8cacdfb Jun 03 16:24:20.552308 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:20.552277 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" event={"ID":"9ce1725f-20e6-4220-b2db-b76a9962ba5c","Type":"ContainerStarted","Data":"b4f0eae390390e1657beb84e20fd2fdb63cfc10834bea74efad7da59c8cacdfb"} Jun 03 16:24:22.562560 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:22.562459 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" event={"ID":"9ce1725f-20e6-4220-b2db-b76a9962ba5c","Type":"ContainerStarted","Data":"ac6a8fac86b0a6324ea4fd74f16feb40d5f2fa38e63cdd69cd576617cd67713d"} Jun 03 16:24:22.562985 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:22.562597 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" Jun 03 16:24:22.584880 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:22.584822 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" podStartSLOduration=0.931066545 podStartE2EDuration="3.584805763s" podCreationTimestamp="2026-06-03 16:24:19 +0000 UTC" firstStartedPulling="2026-06-03 16:24:19.594349859 +0000 UTC m=+437.111346486" lastFinishedPulling="2026-06-03 16:24:22.248089076 +0000 UTC m=+439.765085704" observedRunningTime="2026-06-03 16:24:22.584087732 +0000 UTC m=+440.101084383" watchObservedRunningTime="2026-06-03 16:24:22.584805763 +0000 UTC m=+440.101802414" Jun 03 16:24:28.546590 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:28.546562 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-hpcs7" Jun 03 16:24:33.568189 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:33.568159 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-27xlg" Jun 03 16:24:34.924416 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:34.924384 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw"] Jun 03 16:24:34.928816 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:34.928793 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:34.931879 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:34.931859 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 16:24:34.932025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:34.931859 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 16:24:34.932025 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:34.931860 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 16:24:34.932449 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:34.932431 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6w28w\"" Jun 03 16:24:34.932601 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:34.932589 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 16:24:34.948052 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:34.948028 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw"] Jun 03 16:24:35.094434 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.094399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a51119c-fc24-4ec3-a002-718766693190-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.094640 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.094460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a51119c-fc24-4ec3-a002-718766693190-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.094640 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.094491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d4gs\" (UniqueName: \"kubernetes.io/projected/9a51119c-fc24-4ec3-a002-718766693190-kube-api-access-5d4gs\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.094640 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.094522 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a51119c-fc24-4ec3-a002-718766693190-cacerts\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.094640 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.094573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a51119c-fc24-4ec3-a002-718766693190-istio-token\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.094640 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.094611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a51119c-fc24-4ec3-a002-718766693190-local-certs\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.094939 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.094692 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a51119c-fc24-4ec3-a002-718766693190-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.195400 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.195314 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a51119c-fc24-4ec3-a002-718766693190-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.195400 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.195355 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a51119c-fc24-4ec3-a002-718766693190-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.195400 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.195374 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5d4gs\" (UniqueName: \"kubernetes.io/projected/9a51119c-fc24-4ec3-a002-718766693190-kube-api-access-5d4gs\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.195400 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.195399 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a51119c-fc24-4ec3-a002-718766693190-cacerts\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.195718 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.195434 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a51119c-fc24-4ec3-a002-718766693190-istio-token\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.195718 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.195466 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a51119c-fc24-4ec3-a002-718766693190-local-certs\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.195718 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.195506 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a51119c-fc24-4ec3-a002-718766693190-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.196164 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.196138 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a51119c-fc24-4ec3-a002-718766693190-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.197960 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.197930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a51119c-fc24-4ec3-a002-718766693190-cacerts\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.198070 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.198032 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a51119c-fc24-4ec3-a002-718766693190-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.198070 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.198061 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a51119c-fc24-4ec3-a002-718766693190-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.198184 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.198071 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a51119c-fc24-4ec3-a002-718766693190-local-certs\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.212353 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.212330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a51119c-fc24-4ec3-a002-718766693190-istio-token\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.212619 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.212603 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d4gs\" (UniqueName: \"kubernetes.io/projected/9a51119c-fc24-4ec3-a002-718766693190-kube-api-access-5d4gs\") pod \"istiod-openshift-gateway-798958bb55-hfnlw\" (UID: \"9a51119c-fc24-4ec3-a002-718766693190\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.241883 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.238419 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:35.391552 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.391435 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw"] Jun 03 16:24:35.393631 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:24:35.393603 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a51119c_fc24_4ec3_a002_718766693190.slice/crio-816c7bf3f6b3bf9b68ade17e1866cf45f0c4825d9c13c2b8166cdce7386d7541 WatchSource:0}: Error finding container 816c7bf3f6b3bf9b68ade17e1866cf45f0c4825d9c13c2b8166cdce7386d7541: Status 404 returned error can't find the container with id 816c7bf3f6b3bf9b68ade17e1866cf45f0c4825d9c13c2b8166cdce7386d7541 Jun 03 16:24:35.605357 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:35.605323 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" event={"ID":"9a51119c-fc24-4ec3-a002-718766693190","Type":"ContainerStarted","Data":"816c7bf3f6b3bf9b68ade17e1866cf45f0c4825d9c13c2b8166cdce7386d7541"} Jun 03 16:24:38.501661 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:38.501616 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 16:24:38.502094 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:38.501699 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 16:24:38.516792 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:38.516739 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-l4t9z" Jun 03 16:24:38.617391 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:38.617350 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" event={"ID":"9a51119c-fc24-4ec3-a002-718766693190","Type":"ContainerStarted","Data":"617a637cfe53deaa80cd950646a08110d86af5e7586d5f68aa6c920d5a4e629e"} Jun 03 16:24:38.617585 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:38.617439 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:24:38.637679 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:38.637636 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" podStartSLOduration=1.5319287830000001 podStartE2EDuration="4.637624394s" podCreationTimestamp="2026-06-03 16:24:34 +0000 UTC" firstStartedPulling="2026-06-03 16:24:35.395678635 +0000 UTC m=+452.912675263" lastFinishedPulling="2026-06-03 16:24:38.501374247 +0000 UTC m=+456.018370874" observedRunningTime="2026-06-03 16:24:38.635525764 +0000 UTC m=+456.152522414" watchObservedRunningTime="2026-06-03 16:24:38.637624394 +0000 UTC m=+456.154621045" Jun 03 16:24:39.623326 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:24:39.623295 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-hfnlw" Jun 03 16:25:31.821034 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:31.820995 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv"] Jun 03 16:25:31.824250 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:31.824229 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" Jun 03 16:25:31.826506 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:31.826485 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2j2lq\"" Jun 03 16:25:31.827102 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:31.827084 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 16:25:31.827171 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:31.827103 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 16:25:31.838648 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:31.838621 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv"] Jun 03 16:25:31.946440 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:31.946406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99xg7\" (UniqueName: \"kubernetes.io/projected/a1b56a10-5c1b-49d6-8065-388b6bfc921f-kube-api-access-99xg7\") pod \"limitador-operator-controller-manager-85c4996f8c-c5qcv\" (UID: \"a1b56a10-5c1b-49d6-8065-388b6bfc921f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" Jun 03 16:25:32.047833 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:32.047801 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99xg7\" (UniqueName: \"kubernetes.io/projected/a1b56a10-5c1b-49d6-8065-388b6bfc921f-kube-api-access-99xg7\") pod \"limitador-operator-controller-manager-85c4996f8c-c5qcv\" (UID: \"a1b56a10-5c1b-49d6-8065-388b6bfc921f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" Jun 03 16:25:32.057414 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:32.057389 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99xg7\" (UniqueName: \"kubernetes.io/projected/a1b56a10-5c1b-49d6-8065-388b6bfc921f-kube-api-access-99xg7\") pod \"limitador-operator-controller-manager-85c4996f8c-c5qcv\" (UID: \"a1b56a10-5c1b-49d6-8065-388b6bfc921f\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" Jun 03 16:25:32.136629 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:32.136596 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" Jun 03 16:25:32.268634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:32.268608 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv"] Jun 03 16:25:32.271232 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:25:32.271206 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b56a10_5c1b_49d6_8065_388b6bfc921f.slice/crio-24a6250402270a233ddb1368518b1fb7e157641f504e9e3b736e775ee4dd3275 WatchSource:0}: Error finding container 24a6250402270a233ddb1368518b1fb7e157641f504e9e3b736e775ee4dd3275: Status 404 returned error can't find the container with id 24a6250402270a233ddb1368518b1fb7e157641f504e9e3b736e775ee4dd3275 Jun 03 16:25:32.790594 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:32.790555 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" event={"ID":"a1b56a10-5c1b-49d6-8065-388b6bfc921f","Type":"ContainerStarted","Data":"24a6250402270a233ddb1368518b1fb7e157641f504e9e3b736e775ee4dd3275"} Jun 03 16:25:34.799552 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:34.799518 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" event={"ID":"a1b56a10-5c1b-49d6-8065-388b6bfc921f","Type":"ContainerStarted","Data":"9f1c7acd8cdaf6d44a155088aa857e05ce160208548cdf81028edcea347ffff5"} Jun 03 16:25:34.799946 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:34.799631 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" Jun 03 16:25:34.822723 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:34.822672 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" podStartSLOduration=1.452965559 podStartE2EDuration="3.822660159s" podCreationTimestamp="2026-06-03 16:25:31 +0000 UTC" firstStartedPulling="2026-06-03 16:25:32.273120355 +0000 UTC m=+509.790116983" lastFinishedPulling="2026-06-03 16:25:34.642814951 +0000 UTC m=+512.159811583" observedRunningTime="2026-06-03 16:25:34.820041861 +0000 UTC m=+512.337038710" watchObservedRunningTime="2026-06-03 16:25:34.822660159 +0000 UTC m=+512.339656812" Jun 03 16:25:45.806372 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:45.806339 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" Jun 03 16:25:56.721237 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:56.721205 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv"] Jun 03 16:25:56.721609 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:56.721461 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" podUID="a1b56a10-5c1b-49d6-8065-388b6bfc921f" containerName="manager" containerID="cri-o://9f1c7acd8cdaf6d44a155088aa857e05ce160208548cdf81028edcea347ffff5" gracePeriod=2 Jun 03 16:25:56.750161 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:56.750133 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv"] Jun 03 16:25:56.872857 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:56.872824 2559 generic.go:358] "Generic (PLEG): container finished" podID="a1b56a10-5c1b-49d6-8065-388b6bfc921f" containerID="9f1c7acd8cdaf6d44a155088aa857e05ce160208548cdf81028edcea347ffff5" exitCode=0 Jun 03 16:25:56.956375 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:56.956349 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" Jun 03 16:25:56.959190 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:56.959164 2559 status_manager.go:895] "Failed to get status for pod" podUID="a1b56a10-5c1b-49d6-8065-388b6bfc921f" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" err="pods \"limitador-operator-controller-manager-85c4996f8c-c5qcv\" is forbidden: User \"system:node:ip-10-0-133-169.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-169.ec2.internal' and this object" Jun 03 16:25:57.055474 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:57.055382 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99xg7\" (UniqueName: \"kubernetes.io/projected/a1b56a10-5c1b-49d6-8065-388b6bfc921f-kube-api-access-99xg7\") pod \"a1b56a10-5c1b-49d6-8065-388b6bfc921f\" (UID: \"a1b56a10-5c1b-49d6-8065-388b6bfc921f\") " Jun 03 16:25:57.057620 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:57.057592 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b56a10-5c1b-49d6-8065-388b6bfc921f-kube-api-access-99xg7" (OuterVolumeSpecName: "kube-api-access-99xg7") pod "a1b56a10-5c1b-49d6-8065-388b6bfc921f" (UID: "a1b56a10-5c1b-49d6-8065-388b6bfc921f"). InnerVolumeSpecName "kube-api-access-99xg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:25:57.060320 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:57.060289 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b56a10-5c1b-49d6-8065-388b6bfc921f" path="/var/lib/kubelet/pods/a1b56a10-5c1b-49d6-8065-388b6bfc921f/volumes" Jun 03 16:25:57.156156 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:57.156127 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99xg7\" (UniqueName: \"kubernetes.io/projected/a1b56a10-5c1b-49d6-8065-388b6bfc921f-kube-api-access-99xg7\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:25:57.876868 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:57.876836 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-c5qcv" Jun 03 16:25:57.877325 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:25:57.876820 2559 scope.go:117] "RemoveContainer" containerID="9f1c7acd8cdaf6d44a155088aa857e05ce160208548cdf81028edcea347ffff5" Jun 03 16:26:25.410132 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.410096 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz"] Jun 03 16:26:25.410531 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.410433 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b56a10-5c1b-49d6-8065-388b6bfc921f" containerName="manager" Jun 03 16:26:25.410531 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.410444 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b56a10-5c1b-49d6-8065-388b6bfc921f" containerName="manager" Jun 03 16:26:25.410531 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.410519 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1b56a10-5c1b-49d6-8065-388b6bfc921f" containerName="manager" Jun 03 16:26:25.413409 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.413390 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.415975 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.415927 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-nl9x7\"" Jun 03 16:26:25.434647 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.434617 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz"] Jun 03 16:26:25.481155 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.481130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcqjj\" (UniqueName: \"kubernetes.io/projected/9575adae-c350-4110-9690-e1f95aa1f3ea-kube-api-access-rcqjj\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.481283 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.481171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.481283 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.481190 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.481283 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.481215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.481283 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.481231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.481283 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.481248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.481283 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.481270 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9575adae-c350-4110-9690-e1f95aa1f3ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.481497 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.481332 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.481497 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.481400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.582716 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.582678 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.582887 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.582734 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcqjj\" (UniqueName: \"kubernetes.io/projected/9575adae-c350-4110-9690-e1f95aa1f3ea-kube-api-access-rcqjj\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.582887 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.582797 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.582887 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.582816 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.582887 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.582841 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.582887 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.582865 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.583160 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.582897 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.583160 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.582934 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9575adae-c350-4110-9690-e1f95aa1f3ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.583160 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.582980 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.583398 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.583167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.583398 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.583333 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.583474 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.583409 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.583633 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.583606 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.583851 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.583733 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9575adae-c350-4110-9690-e1f95aa1f3ea-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.585334 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.585311 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.585823 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.585744 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.591012 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.590988 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9575adae-c350-4110-9690-e1f95aa1f3ea-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.591346 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.591330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcqjj\" (UniqueName: \"kubernetes.io/projected/9575adae-c350-4110-9690-e1f95aa1f3ea-kube-api-access-rcqjj\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-cfpnz\" (UID: \"9575adae-c350-4110-9690-e1f95aa1f3ea\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.727768 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.727672 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:25.872022 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.871994 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz"] Jun 03 16:26:25.874824 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:26:25.874795 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9575adae_c350_4110_9690_e1f95aa1f3ea.slice/crio-fe8c245c3eb38be3e60dd29a46688ee0a746c4c53c5b71df0aed8e69e8b60a54 WatchSource:0}: Error finding container fe8c245c3eb38be3e60dd29a46688ee0a746c4c53c5b71df0aed8e69e8b60a54: Status 404 returned error can't find the container with id fe8c245c3eb38be3e60dd29a46688ee0a746c4c53c5b71df0aed8e69e8b60a54 Jun 03 16:26:25.966822 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:25.966790 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" event={"ID":"9575adae-c350-4110-9690-e1f95aa1f3ea","Type":"ContainerStarted","Data":"fe8c245c3eb38be3e60dd29a46688ee0a746c4c53c5b71df0aed8e69e8b60a54"} Jun 03 16:26:29.259475 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:29.259431 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 16:26:29.259798 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:29.259514 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 16:26:29.259798 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:29.259545 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 16:26:29.981819 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:29.981781 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" event={"ID":"9575adae-c350-4110-9690-e1f95aa1f3ea","Type":"ContainerStarted","Data":"c86da7b116d8bfe80da276df1ae8776057b4cf28e82b47fa767277624424685c"} Jun 03 16:26:30.007415 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:30.007370 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" podStartSLOduration=1.624873805 podStartE2EDuration="5.007357671s" podCreationTimestamp="2026-06-03 16:26:25 +0000 UTC" firstStartedPulling="2026-06-03 16:26:25.876700378 +0000 UTC m=+563.393697006" lastFinishedPulling="2026-06-03 16:26:29.259184234 +0000 UTC m=+566.776180872" observedRunningTime="2026-06-03 16:26:30.005269025 +0000 UTC m=+567.522265698" watchObservedRunningTime="2026-06-03 16:26:30.007357671 +0000 UTC m=+567.524354320" Jun 03 16:26:30.728416 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:30.728376 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:30.733251 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:30.733226 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:30.985050 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:30.984969 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:30.986078 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:30.986059 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-cfpnz" Jun 03 16:26:38.392219 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.392184 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-c2vt9"] Jun 03 16:26:38.395698 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.395681 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:38.397971 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.397951 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 16:26:38.398074 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.397955 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 16:26:38.398454 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.398433 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5t7wf\"" Jun 03 16:26:38.398555 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.398436 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 16:26:38.403966 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.403947 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-c2vt9"] Jun 03 16:26:38.485898 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.485866 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-c2vt9"] Jun 03 16:26:38.493451 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.493397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e520dbbb-439a-41bb-88cc-f9692edb06a5-config-file\") pod \"limitador-limitador-7d549b5b-c2vt9\" (UID: \"e520dbbb-439a-41bb-88cc-f9692edb06a5\") " pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:38.493634 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.493516 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwjsc\" (UniqueName: \"kubernetes.io/projected/e520dbbb-439a-41bb-88cc-f9692edb06a5-kube-api-access-lwjsc\") pod \"limitador-limitador-7d549b5b-c2vt9\" (UID: \"e520dbbb-439a-41bb-88cc-f9692edb06a5\") " pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:38.593954 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.593909 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwjsc\" (UniqueName: \"kubernetes.io/projected/e520dbbb-439a-41bb-88cc-f9692edb06a5-kube-api-access-lwjsc\") pod \"limitador-limitador-7d549b5b-c2vt9\" (UID: \"e520dbbb-439a-41bb-88cc-f9692edb06a5\") " pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:38.594119 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.594004 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e520dbbb-439a-41bb-88cc-f9692edb06a5-config-file\") pod \"limitador-limitador-7d549b5b-c2vt9\" (UID: \"e520dbbb-439a-41bb-88cc-f9692edb06a5\") " pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:38.594538 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.594521 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e520dbbb-439a-41bb-88cc-f9692edb06a5-config-file\") pod \"limitador-limitador-7d549b5b-c2vt9\" (UID: \"e520dbbb-439a-41bb-88cc-f9692edb06a5\") " pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:38.602423 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.602395 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwjsc\" (UniqueName: \"kubernetes.io/projected/e520dbbb-439a-41bb-88cc-f9692edb06a5-kube-api-access-lwjsc\") pod \"limitador-limitador-7d549b5b-c2vt9\" (UID: \"e520dbbb-439a-41bb-88cc-f9692edb06a5\") " pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:38.707575 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.707497 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:38.837640 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:38.837463 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-c2vt9"] Jun 03 16:26:38.840638 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:26:38.840601 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode520dbbb_439a_41bb_88cc_f9692edb06a5.slice/crio-631ee2fb585aec1f1dcdad6a20b186accbe1124a9982c7f930edf5e4aa6398fd WatchSource:0}: Error finding container 631ee2fb585aec1f1dcdad6a20b186accbe1124a9982c7f930edf5e4aa6398fd: Status 404 returned error can't find the container with id 631ee2fb585aec1f1dcdad6a20b186accbe1124a9982c7f930edf5e4aa6398fd Jun 03 16:26:39.014343 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:39.014263 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" event={"ID":"e520dbbb-439a-41bb-88cc-f9692edb06a5","Type":"ContainerStarted","Data":"631ee2fb585aec1f1dcdad6a20b186accbe1124a9982c7f930edf5e4aa6398fd"} Jun 03 16:26:42.028573 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:42.028537 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" event={"ID":"e520dbbb-439a-41bb-88cc-f9692edb06a5","Type":"ContainerStarted","Data":"f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a"} Jun 03 16:26:42.029019 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:42.028720 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:42.046677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:42.046638 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" podStartSLOduration=1.4379991429999999 podStartE2EDuration="4.046621395s" podCreationTimestamp="2026-06-03 16:26:38 +0000 UTC" firstStartedPulling="2026-06-03 16:26:38.842338891 +0000 UTC m=+576.359335523" lastFinishedPulling="2026-06-03 16:26:41.450961147 +0000 UTC m=+578.967957775" observedRunningTime="2026-06-03 16:26:42.045442274 +0000 UTC m=+579.562438948" watchObservedRunningTime="2026-06-03 16:26:42.046621395 +0000 UTC m=+579.563618038" Jun 03 16:26:53.033834 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:53.033804 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:55.126102 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:55.126065 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-c2vt9"] Jun 03 16:26:55.126541 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:55.126299 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" podUID="e520dbbb-439a-41bb-88cc-f9692edb06a5" containerName="limitador" containerID="cri-o://f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a" gracePeriod=30 Jun 03 16:26:55.673704 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:55.673682 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:55.744104 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:55.744027 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e520dbbb-439a-41bb-88cc-f9692edb06a5-config-file\") pod \"e520dbbb-439a-41bb-88cc-f9692edb06a5\" (UID: \"e520dbbb-439a-41bb-88cc-f9692edb06a5\") " Jun 03 16:26:55.744104 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:55.744062 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwjsc\" (UniqueName: \"kubernetes.io/projected/e520dbbb-439a-41bb-88cc-f9692edb06a5-kube-api-access-lwjsc\") pod \"e520dbbb-439a-41bb-88cc-f9692edb06a5\" (UID: \"e520dbbb-439a-41bb-88cc-f9692edb06a5\") " Jun 03 16:26:55.744475 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:55.744450 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e520dbbb-439a-41bb-88cc-f9692edb06a5-config-file" (OuterVolumeSpecName: "config-file") pod "e520dbbb-439a-41bb-88cc-f9692edb06a5" (UID: "e520dbbb-439a-41bb-88cc-f9692edb06a5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:26:55.746118 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:55.746094 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e520dbbb-439a-41bb-88cc-f9692edb06a5-kube-api-access-lwjsc" (OuterVolumeSpecName: "kube-api-access-lwjsc") pod "e520dbbb-439a-41bb-88cc-f9692edb06a5" (UID: "e520dbbb-439a-41bb-88cc-f9692edb06a5"). InnerVolumeSpecName "kube-api-access-lwjsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:26:55.845090 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:55.845057 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e520dbbb-439a-41bb-88cc-f9692edb06a5-config-file\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:26:55.845090 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:55.845084 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwjsc\" (UniqueName: \"kubernetes.io/projected/e520dbbb-439a-41bb-88cc-f9692edb06a5-kube-api-access-lwjsc\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:26:56.079671 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.079590 2559 generic.go:358] "Generic (PLEG): container finished" podID="e520dbbb-439a-41bb-88cc-f9692edb06a5" containerID="f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a" exitCode=0 Jun 03 16:26:56.079671 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.079638 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" Jun 03 16:26:56.079899 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.079674 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" event={"ID":"e520dbbb-439a-41bb-88cc-f9692edb06a5","Type":"ContainerDied","Data":"f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a"} Jun 03 16:26:56.079899 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.079707 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-c2vt9" event={"ID":"e520dbbb-439a-41bb-88cc-f9692edb06a5","Type":"ContainerDied","Data":"631ee2fb585aec1f1dcdad6a20b186accbe1124a9982c7f930edf5e4aa6398fd"} Jun 03 16:26:56.079899 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.079721 2559 scope.go:117] "RemoveContainer" containerID="f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a" Jun 03 16:26:56.088268 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.088249 2559 scope.go:117] "RemoveContainer" containerID="f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a" Jun 03 16:26:56.088497 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:26:56.088476 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a\": container with ID starting with f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a not found: ID does not exist" containerID="f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a" Jun 03 16:26:56.088551 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.088505 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a"} err="failed to get container status \"f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a\": rpc error: code = NotFound desc = could not find container \"f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a\": container with ID starting with f96614ba6977a6a9c6ff888a45862059fb616530cc09c23ba5bb8a194067842a not found: ID does not exist" Jun 03 16:26:56.099957 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.099936 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-c2vt9"] Jun 03 16:26:56.104480 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.104460 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-c2vt9"] Jun 03 16:26:56.745224 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.745191 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-868db5846d-r5qp9"] Jun 03 16:26:56.745668 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.745648 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e520dbbb-439a-41bb-88cc-f9692edb06a5" containerName="limitador" Jun 03 16:26:56.745668 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.745667 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e520dbbb-439a-41bb-88cc-f9692edb06a5" containerName="limitador" Jun 03 16:26:56.745806 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.745793 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="e520dbbb-439a-41bb-88cc-f9692edb06a5" containerName="limitador" Jun 03 16:26:56.755041 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.755016 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-868db5846d-r5qp9" Jun 03 16:26:56.757541 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.757516 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 16:26:56.757705 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.757530 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w77nz\"" Jun 03 16:26:56.758311 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.758289 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-868db5846d-r5qp9"] Jun 03 16:26:56.853926 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.853895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfr4z\" (UniqueName: \"kubernetes.io/projected/23e98219-d12d-4614-8b45-10428120fa62-kube-api-access-kfr4z\") pod \"postgres-868db5846d-r5qp9\" (UID: \"23e98219-d12d-4614-8b45-10428120fa62\") " pod="opendatahub/postgres-868db5846d-r5qp9" Jun 03 16:26:56.854112 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.853973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23e98219-d12d-4614-8b45-10428120fa62-data\") pod \"postgres-868db5846d-r5qp9\" (UID: \"23e98219-d12d-4614-8b45-10428120fa62\") " pod="opendatahub/postgres-868db5846d-r5qp9" Jun 03 16:26:56.955103 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.955071 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kfr4z\" (UniqueName: \"kubernetes.io/projected/23e98219-d12d-4614-8b45-10428120fa62-kube-api-access-kfr4z\") pod \"postgres-868db5846d-r5qp9\" (UID: \"23e98219-d12d-4614-8b45-10428120fa62\") " pod="opendatahub/postgres-868db5846d-r5qp9" Jun 03 16:26:56.955266 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.955121 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23e98219-d12d-4614-8b45-10428120fa62-data\") pod \"postgres-868db5846d-r5qp9\" (UID: \"23e98219-d12d-4614-8b45-10428120fa62\") " pod="opendatahub/postgres-868db5846d-r5qp9" Jun 03 16:26:56.955461 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.955444 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/23e98219-d12d-4614-8b45-10428120fa62-data\") pod \"postgres-868db5846d-r5qp9\" (UID: \"23e98219-d12d-4614-8b45-10428120fa62\") " pod="opendatahub/postgres-868db5846d-r5qp9" Jun 03 16:26:56.964267 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:56.964241 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfr4z\" (UniqueName: \"kubernetes.io/projected/23e98219-d12d-4614-8b45-10428120fa62-kube-api-access-kfr4z\") pod \"postgres-868db5846d-r5qp9\" (UID: \"23e98219-d12d-4614-8b45-10428120fa62\") " pod="opendatahub/postgres-868db5846d-r5qp9" Jun 03 16:26:57.061605 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:57.061530 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e520dbbb-439a-41bb-88cc-f9692edb06a5" path="/var/lib/kubelet/pods/e520dbbb-439a-41bb-88cc-f9692edb06a5/volumes" Jun 03 16:26:57.066744 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:57.066727 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-868db5846d-r5qp9" Jun 03 16:26:57.190797 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:57.190772 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-868db5846d-r5qp9"] Jun 03 16:26:57.193301 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:26:57.193268 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e98219_d12d_4614_8b45_10428120fa62.slice/crio-6b32060ca9c405fc631af4888a38d8aebde94da8f5be23ac53832d812ef0b669 WatchSource:0}: Error finding container 6b32060ca9c405fc631af4888a38d8aebde94da8f5be23ac53832d812ef0b669: Status 404 returned error can't find the container with id 6b32060ca9c405fc631af4888a38d8aebde94da8f5be23ac53832d812ef0b669 Jun 03 16:26:58.087947 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:26:58.087915 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-868db5846d-r5qp9" event={"ID":"23e98219-d12d-4614-8b45-10428120fa62","Type":"ContainerStarted","Data":"6b32060ca9c405fc631af4888a38d8aebde94da8f5be23ac53832d812ef0b669"} Jun 03 16:27:02.965335 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:02.965306 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/1.log" Jun 03 16:27:02.965727 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:02.965366 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/1.log" Jun 03 16:27:02.968872 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:02.968851 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztm65_7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1/ovn-acl-logging/0.log" Jun 03 16:27:02.969069 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:02.969047 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztm65_7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1/ovn-acl-logging/0.log" Jun 03 16:27:12.629124 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:12.629096 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 16:27:13.137724 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:13.137685 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-868db5846d-r5qp9" event={"ID":"23e98219-d12d-4614-8b45-10428120fa62","Type":"ContainerStarted","Data":"08c2790de8b06d44fd90415c0e69461cffcaaebaf3c478d01ac05ce881d27f60"} Jun 03 16:27:13.137904 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:13.137789 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-868db5846d-r5qp9" Jun 03 16:27:13.155348 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:13.155287 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-868db5846d-r5qp9" podStartSLOduration=1.7228364379999999 podStartE2EDuration="17.155268065s" podCreationTimestamp="2026-06-03 16:26:56 +0000 UTC" firstStartedPulling="2026-06-03 16:26:57.194486344 +0000 UTC m=+594.711482971" lastFinishedPulling="2026-06-03 16:27:12.626917971 +0000 UTC m=+610.143914598" observedRunningTime="2026-06-03 16:27:13.152286481 +0000 UTC m=+610.669283130" watchObservedRunningTime="2026-06-03 16:27:13.155268065 +0000 UTC m=+610.672264718" Jun 03 16:27:19.171454 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:19.171379 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-868db5846d-r5qp9" Jun 03 16:27:22.104314 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.104284 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cdc884d7c-c56df"] Jun 03 16:27:22.107849 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.107828 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdc884d7c-c56df" Jun 03 16:27:22.110567 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.110541 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xgdjf\"" Jun 03 16:27:22.110678 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.110610 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 16:27:22.118898 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.118876 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdc884d7c-c56df"] Jun 03 16:27:22.176081 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.176045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4z29\" (UniqueName: \"kubernetes.io/projected/7e08c4a4-836c-4855-9d6c-d57122958a68-kube-api-access-g4z29\") pod \"maas-controller-7cdc884d7c-c56df\" (UID: \"7e08c4a4-836c-4855-9d6c-d57122958a68\") " pod="opendatahub/maas-controller-7cdc884d7c-c56df" Jun 03 16:27:22.265518 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.265486 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cddc48d79-thkwh"] Jun 03 16:27:22.268928 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.268906 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cddc48d79-thkwh" Jun 03 16:27:22.276209 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.276169 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cddc48d79-thkwh"] Jun 03 16:27:22.276526 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.276504 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4z29\" (UniqueName: \"kubernetes.io/projected/7e08c4a4-836c-4855-9d6c-d57122958a68-kube-api-access-g4z29\") pod \"maas-controller-7cdc884d7c-c56df\" (UID: \"7e08c4a4-836c-4855-9d6c-d57122958a68\") " pod="opendatahub/maas-controller-7cdc884d7c-c56df" Jun 03 16:27:22.289822 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.289795 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4z29\" (UniqueName: \"kubernetes.io/projected/7e08c4a4-836c-4855-9d6c-d57122958a68-kube-api-access-g4z29\") pod \"maas-controller-7cdc884d7c-c56df\" (UID: \"7e08c4a4-836c-4855-9d6c-d57122958a68\") " pod="opendatahub/maas-controller-7cdc884d7c-c56df" Jun 03 16:27:22.377796 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.377693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42mn8\" (UniqueName: \"kubernetes.io/projected/be07a0b8-9ea3-46d1-af79-2f2e3223e018-kube-api-access-42mn8\") pod \"maas-controller-cddc48d79-thkwh\" (UID: \"be07a0b8-9ea3-46d1-af79-2f2e3223e018\") " pod="opendatahub/maas-controller-cddc48d79-thkwh" Jun 03 16:27:22.385268 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.385244 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdc884d7c-c56df"] Jun 03 16:27:22.385473 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.385462 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdc884d7c-c56df" Jun 03 16:27:22.438550 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.438518 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cc8f6dbc6-7zfml"] Jun 03 16:27:22.443572 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.443547 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" Jun 03 16:27:22.458845 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.458793 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cc8f6dbc6-7zfml"] Jun 03 16:27:22.479441 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.478922 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42mn8\" (UniqueName: \"kubernetes.io/projected/be07a0b8-9ea3-46d1-af79-2f2e3223e018-kube-api-access-42mn8\") pod \"maas-controller-cddc48d79-thkwh\" (UID: \"be07a0b8-9ea3-46d1-af79-2f2e3223e018\") " pod="opendatahub/maas-controller-cddc48d79-thkwh" Jun 03 16:27:22.493261 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.493232 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42mn8\" (UniqueName: \"kubernetes.io/projected/be07a0b8-9ea3-46d1-af79-2f2e3223e018-kube-api-access-42mn8\") pod \"maas-controller-cddc48d79-thkwh\" (UID: \"be07a0b8-9ea3-46d1-af79-2f2e3223e018\") " pod="opendatahub/maas-controller-cddc48d79-thkwh" Jun 03 16:27:22.526361 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.526337 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdc884d7c-c56df"] Jun 03 16:27:22.528015 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:27:22.527981 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e08c4a4_836c_4855_9d6c_d57122958a68.slice/crio-7068fb95d8dfaf0cba620584798615359810b763549a75c912e37a33c62e0244 WatchSource:0}: Error finding container 7068fb95d8dfaf0cba620584798615359810b763549a75c912e37a33c62e0244: Status 404 returned error can't find the container with id 7068fb95d8dfaf0cba620584798615359810b763549a75c912e37a33c62e0244 Jun 03 16:27:22.579870 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.579836 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxvr9\" (UniqueName: \"kubernetes.io/projected/4b4bec78-6fec-47b9-9207-809438dcab44-kube-api-access-dxvr9\") pod \"maas-controller-5cc8f6dbc6-7zfml\" (UID: \"4b4bec78-6fec-47b9-9207-809438dcab44\") " pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" Jun 03 16:27:22.581673 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.581658 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cddc48d79-thkwh" Jun 03 16:27:22.680948 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.680917 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxvr9\" (UniqueName: \"kubernetes.io/projected/4b4bec78-6fec-47b9-9207-809438dcab44-kube-api-access-dxvr9\") pod \"maas-controller-5cc8f6dbc6-7zfml\" (UID: \"4b4bec78-6fec-47b9-9207-809438dcab44\") " pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" Jun 03 16:27:22.689713 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.689680 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxvr9\" (UniqueName: \"kubernetes.io/projected/4b4bec78-6fec-47b9-9207-809438dcab44-kube-api-access-dxvr9\") pod \"maas-controller-5cc8f6dbc6-7zfml\" (UID: \"4b4bec78-6fec-47b9-9207-809438dcab44\") " pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" Jun 03 16:27:22.703745 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.703720 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cddc48d79-thkwh"] Jun 03 16:27:22.705368 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:27:22.705343 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe07a0b8_9ea3_46d1_af79_2f2e3223e018.slice/crio-466f2cc02ba1d01199e80a1c12d0c10704552440729a88244b52ff8681f3a2e0 WatchSource:0}: Error finding container 466f2cc02ba1d01199e80a1c12d0c10704552440729a88244b52ff8681f3a2e0: Status 404 returned error can't find the container with id 466f2cc02ba1d01199e80a1c12d0c10704552440729a88244b52ff8681f3a2e0 Jun 03 16:27:22.757019 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.756993 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" Jun 03 16:27:22.882269 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:22.882243 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cc8f6dbc6-7zfml"] Jun 03 16:27:22.884817 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:27:22.884789 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4bec78_6fec_47b9_9207_809438dcab44.slice/crio-13daa398da80fec056b07879c57cc58fec61e1a82f506a1d0a0523d05356ec38 WatchSource:0}: Error finding container 13daa398da80fec056b07879c57cc58fec61e1a82f506a1d0a0523d05356ec38: Status 404 returned error can't find the container with id 13daa398da80fec056b07879c57cc58fec61e1a82f506a1d0a0523d05356ec38 Jun 03 16:27:23.174383 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:23.174296 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" event={"ID":"4b4bec78-6fec-47b9-9207-809438dcab44","Type":"ContainerStarted","Data":"13daa398da80fec056b07879c57cc58fec61e1a82f506a1d0a0523d05356ec38"} Jun 03 16:27:23.175719 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:23.175694 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdc884d7c-c56df" event={"ID":"7e08c4a4-836c-4855-9d6c-d57122958a68","Type":"ContainerStarted","Data":"7068fb95d8dfaf0cba620584798615359810b763549a75c912e37a33c62e0244"} Jun 03 16:27:23.176907 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:23.176883 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cddc48d79-thkwh" event={"ID":"be07a0b8-9ea3-46d1-af79-2f2e3223e018","Type":"ContainerStarted","Data":"466f2cc02ba1d01199e80a1c12d0c10704552440729a88244b52ff8681f3a2e0"} Jun 03 16:27:26.203160 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.203056 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" event={"ID":"4b4bec78-6fec-47b9-9207-809438dcab44","Type":"ContainerStarted","Data":"95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545"} Jun 03 16:27:26.203160 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.203136 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" Jun 03 16:27:26.204423 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.204400 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdc884d7c-c56df" event={"ID":"7e08c4a4-836c-4855-9d6c-d57122958a68","Type":"ContainerStarted","Data":"d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec"} Jun 03 16:27:26.204543 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.204487 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7cdc884d7c-c56df" podUID="7e08c4a4-836c-4855-9d6c-d57122958a68" containerName="manager" containerID="cri-o://d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec" gracePeriod=10 Jun 03 16:27:26.204606 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.204525 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cdc884d7c-c56df" Jun 03 16:27:26.205826 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.205805 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cddc48d79-thkwh" event={"ID":"be07a0b8-9ea3-46d1-af79-2f2e3223e018","Type":"ContainerStarted","Data":"1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038"} Jun 03 16:27:26.205969 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.205947 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cddc48d79-thkwh" Jun 03 16:27:26.229358 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.228585 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" podStartSLOduration=1.160413645 podStartE2EDuration="4.228569586s" podCreationTimestamp="2026-06-03 16:27:22 +0000 UTC" firstStartedPulling="2026-06-03 16:27:22.886139605 +0000 UTC m=+620.403136232" lastFinishedPulling="2026-06-03 16:27:25.954295528 +0000 UTC m=+623.471292173" observedRunningTime="2026-06-03 16:27:26.227066363 +0000 UTC m=+623.744063014" watchObservedRunningTime="2026-06-03 16:27:26.228569586 +0000 UTC m=+623.745566237" Jun 03 16:27:26.245108 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.245066 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-cddc48d79-thkwh" podStartSLOduration=1.007697456 podStartE2EDuration="4.245054074s" podCreationTimestamp="2026-06-03 16:27:22 +0000 UTC" firstStartedPulling="2026-06-03 16:27:22.706780829 +0000 UTC m=+620.223777457" lastFinishedPulling="2026-06-03 16:27:25.944137448 +0000 UTC m=+623.461134075" observedRunningTime="2026-06-03 16:27:26.244216283 +0000 UTC m=+623.761212933" watchObservedRunningTime="2026-06-03 16:27:26.245054074 +0000 UTC m=+623.762050724" Jun 03 16:27:26.267033 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.266983 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7cdc884d7c-c56df" podStartSLOduration=0.852656908 podStartE2EDuration="4.266966909s" podCreationTimestamp="2026-06-03 16:27:22 +0000 UTC" firstStartedPulling="2026-06-03 16:27:22.529410385 +0000 UTC m=+620.046407012" lastFinishedPulling="2026-06-03 16:27:25.943720374 +0000 UTC m=+623.460717013" observedRunningTime="2026-06-03 16:27:26.264535829 +0000 UTC m=+623.781532477" watchObservedRunningTime="2026-06-03 16:27:26.266966909 +0000 UTC m=+623.783963560" Jun 03 16:27:26.453052 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.453026 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdc884d7c-c56df" Jun 03 16:27:26.618491 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.618455 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4z29\" (UniqueName: \"kubernetes.io/projected/7e08c4a4-836c-4855-9d6c-d57122958a68-kube-api-access-g4z29\") pod \"7e08c4a4-836c-4855-9d6c-d57122958a68\" (UID: \"7e08c4a4-836c-4855-9d6c-d57122958a68\") " Jun 03 16:27:26.620732 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.620708 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e08c4a4-836c-4855-9d6c-d57122958a68-kube-api-access-g4z29" (OuterVolumeSpecName: "kube-api-access-g4z29") pod "7e08c4a4-836c-4855-9d6c-d57122958a68" (UID: "7e08c4a4-836c-4855-9d6c-d57122958a68"). InnerVolumeSpecName "kube-api-access-g4z29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:27:26.719314 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:26.719269 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4z29\" (UniqueName: \"kubernetes.io/projected/7e08c4a4-836c-4855-9d6c-d57122958a68-kube-api-access-g4z29\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:27:27.209973 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:27.209939 2559 generic.go:358] "Generic (PLEG): container finished" podID="7e08c4a4-836c-4855-9d6c-d57122958a68" containerID="d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec" exitCode=0 Jun 03 16:27:27.210386 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:27.210000 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdc884d7c-c56df" Jun 03 16:27:27.210386 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:27.210022 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdc884d7c-c56df" event={"ID":"7e08c4a4-836c-4855-9d6c-d57122958a68","Type":"ContainerDied","Data":"d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec"} Jun 03 16:27:27.210386 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:27.210052 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdc884d7c-c56df" event={"ID":"7e08c4a4-836c-4855-9d6c-d57122958a68","Type":"ContainerDied","Data":"7068fb95d8dfaf0cba620584798615359810b763549a75c912e37a33c62e0244"} Jun 03 16:27:27.210386 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:27.210071 2559 scope.go:117] "RemoveContainer" containerID="d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec" Jun 03 16:27:27.218107 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:27.218084 2559 scope.go:117] "RemoveContainer" containerID="d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec" Jun 03 16:27:27.218344 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:27:27.218328 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec\": container with ID starting with d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec not found: ID does not exist" containerID="d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec" Jun 03 16:27:27.218407 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:27.218352 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec"} err="failed to get container status \"d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec\": rpc error: code = NotFound desc = could not find container \"d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec\": container with ID starting with d905565428279001499b15fef0e03b449127a7c162c32235cd933c41123f94ec not found: ID does not exist" Jun 03 16:27:27.227480 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:27.227460 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdc884d7c-c56df"] Jun 03 16:27:27.233927 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:27.233905 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7cdc884d7c-c56df"] Jun 03 16:27:28.259353 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.259321 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8f7b6f664-wdwml"] Jun 03 16:27:28.259693 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.259671 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e08c4a4-836c-4855-9d6c-d57122958a68" containerName="manager" Jun 03 16:27:28.259693 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.259683 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e08c4a4-836c-4855-9d6c-d57122958a68" containerName="manager" Jun 03 16:27:28.259786 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.259768 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e08c4a4-836c-4855-9d6c-d57122958a68" containerName="manager" Jun 03 16:27:28.264004 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.263984 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:27:28.266119 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.266097 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 16:27:28.266315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.266300 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-j8x4v\"" Jun 03 16:27:28.273040 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.273013 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8f7b6f664-wdwml"] Jun 03 16:27:28.434933 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.434901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm456\" (UniqueName: \"kubernetes.io/projected/bae7f646-3ec6-4538-a0d8-c955eab73cc5-kube-api-access-lm456\") pod \"maas-api-8f7b6f664-wdwml\" (UID: \"bae7f646-3ec6-4538-a0d8-c955eab73cc5\") " pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:27:28.434933 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.434939 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae7f646-3ec6-4538-a0d8-c955eab73cc5-maas-api-tls\") pod \"maas-api-8f7b6f664-wdwml\" (UID: \"bae7f646-3ec6-4538-a0d8-c955eab73cc5\") " pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:27:28.536079 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.536005 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lm456\" (UniqueName: \"kubernetes.io/projected/bae7f646-3ec6-4538-a0d8-c955eab73cc5-kube-api-access-lm456\") pod \"maas-api-8f7b6f664-wdwml\" (UID: \"bae7f646-3ec6-4538-a0d8-c955eab73cc5\") " pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:27:28.536079 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.536039 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae7f646-3ec6-4538-a0d8-c955eab73cc5-maas-api-tls\") pod \"maas-api-8f7b6f664-wdwml\" (UID: \"bae7f646-3ec6-4538-a0d8-c955eab73cc5\") " pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:27:28.538658 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.538634 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae7f646-3ec6-4538-a0d8-c955eab73cc5-maas-api-tls\") pod \"maas-api-8f7b6f664-wdwml\" (UID: \"bae7f646-3ec6-4538-a0d8-c955eab73cc5\") " pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:27:28.544715 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.544687 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm456\" (UniqueName: \"kubernetes.io/projected/bae7f646-3ec6-4538-a0d8-c955eab73cc5-kube-api-access-lm456\") pod \"maas-api-8f7b6f664-wdwml\" (UID: \"bae7f646-3ec6-4538-a0d8-c955eab73cc5\") " pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:27:28.575409 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.575383 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:27:28.600467 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.598041 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-msd6z"] Jun 03 16:27:28.604055 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.604029 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-msd6z" Jun 03 16:27:28.610221 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.610189 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 16:27:28.610327 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.610199 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-p2fmb\"" Jun 03 16:27:28.613679 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.613656 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-msd6z"] Jun 03 16:27:28.713724 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.713694 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8f7b6f664-wdwml"] Jun 03 16:27:28.716262 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:27:28.716233 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae7f646_3ec6_4538_a0d8_c955eab73cc5.slice/crio-a81ef34450755d38984cf60c193dd3cd0ef114322c86ee9babc5d01df50e08f4 WatchSource:0}: Error finding container a81ef34450755d38984cf60c193dd3cd0ef114322c86ee9babc5d01df50e08f4: Status 404 returned error can't find the container with id a81ef34450755d38984cf60c193dd3cd0ef114322c86ee9babc5d01df50e08f4 Jun 03 16:27:28.738173 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.738146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qb57\" (UniqueName: \"kubernetes.io/projected/7572893f-c9a4-4c88-a041-1989063a4ec6-kube-api-access-7qb57\") pod \"payload-processing-58b6c8fdc7-msd6z\" (UID: \"7572893f-c9a4-4c88-a041-1989063a4ec6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-msd6z" Jun 03 16:27:28.839484 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.839397 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qb57\" (UniqueName: \"kubernetes.io/projected/7572893f-c9a4-4c88-a041-1989063a4ec6-kube-api-access-7qb57\") pod \"payload-processing-58b6c8fdc7-msd6z\" (UID: \"7572893f-c9a4-4c88-a041-1989063a4ec6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-msd6z" Jun 03 16:27:28.847537 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.847513 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qb57\" (UniqueName: \"kubernetes.io/projected/7572893f-c9a4-4c88-a041-1989063a4ec6-kube-api-access-7qb57\") pod \"payload-processing-58b6c8fdc7-msd6z\" (UID: \"7572893f-c9a4-4c88-a041-1989063a4ec6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-msd6z" Jun 03 16:27:28.915817 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:28.915779 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-msd6z" Jun 03 16:27:29.053656 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:29.053623 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-msd6z"] Jun 03 16:27:29.055850 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:27:29.055807 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7572893f_c9a4_4c88_a041_1989063a4ec6.slice/crio-34fdb6974147a277906f97ce2b7b65e760a0875b4fc0f04f46f535537938eedb WatchSource:0}: Error finding container 34fdb6974147a277906f97ce2b7b65e760a0875b4fc0f04f46f535537938eedb: Status 404 returned error can't find the container with id 34fdb6974147a277906f97ce2b7b65e760a0875b4fc0f04f46f535537938eedb Jun 03 16:27:29.060656 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:29.060630 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e08c4a4-836c-4855-9d6c-d57122958a68" path="/var/lib/kubelet/pods/7e08c4a4-836c-4855-9d6c-d57122958a68/volumes" Jun 03 16:27:29.219509 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:29.219471 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-msd6z" event={"ID":"7572893f-c9a4-4c88-a041-1989063a4ec6","Type":"ContainerStarted","Data":"34fdb6974147a277906f97ce2b7b65e760a0875b4fc0f04f46f535537938eedb"} Jun 03 16:27:29.220765 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:29.220724 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8f7b6f664-wdwml" event={"ID":"bae7f646-3ec6-4538-a0d8-c955eab73cc5","Type":"ContainerStarted","Data":"a81ef34450755d38984cf60c193dd3cd0ef114322c86ee9babc5d01df50e08f4"} Jun 03 16:27:32.257180 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:32.257143 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-msd6z" event={"ID":"7572893f-c9a4-4c88-a041-1989063a4ec6","Type":"ContainerStarted","Data":"88c36cfd99013dc387ae6987a5e3f5e5454609806b70811302de31e41df38a85"} Jun 03 16:27:32.257631 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:32.257239 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-msd6z" Jun 03 16:27:32.258491 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:32.258465 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8f7b6f664-wdwml" event={"ID":"bae7f646-3ec6-4538-a0d8-c955eab73cc5","Type":"ContainerStarted","Data":"4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401"} Jun 03 16:27:32.258597 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:32.258554 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:27:32.273486 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:32.273449 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-msd6z" podStartSLOduration=1.4568310420000001 podStartE2EDuration="4.273438567s" podCreationTimestamp="2026-06-03 16:27:28 +0000 UTC" firstStartedPulling="2026-06-03 16:27:29.057639715 +0000 UTC m=+626.574636347" lastFinishedPulling="2026-06-03 16:27:31.874247239 +0000 UTC m=+629.391243872" observedRunningTime="2026-06-03 16:27:32.272036309 +0000 UTC m=+629.789032962" watchObservedRunningTime="2026-06-03 16:27:32.273438567 +0000 UTC m=+629.790435216" Jun 03 16:27:32.291577 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:32.291534 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-8f7b6f664-wdwml" podStartSLOduration=1.195581641 podStartE2EDuration="4.291524081s" podCreationTimestamp="2026-06-03 16:27:28 +0000 UTC" firstStartedPulling="2026-06-03 16:27:28.717625088 +0000 UTC m=+626.234621717" lastFinishedPulling="2026-06-03 16:27:31.813567518 +0000 UTC m=+629.330564157" observedRunningTime="2026-06-03 16:27:32.289964892 +0000 UTC m=+629.806961541" watchObservedRunningTime="2026-06-03 16:27:32.291524081 +0000 UTC m=+629.808520731" Jun 03 16:27:37.215474 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.215445 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" Jun 03 16:27:37.215848 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.215498 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cddc48d79-thkwh" Jun 03 16:27:37.278244 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.278209 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cddc48d79-thkwh"] Jun 03 16:27:37.278417 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.278397 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-cddc48d79-thkwh" podUID="be07a0b8-9ea3-46d1-af79-2f2e3223e018" containerName="manager" containerID="cri-o://1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038" gracePeriod=10 Jun 03 16:27:37.464610 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.464573 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d47c5fdcd-ffsjx"] Jun 03 16:27:37.468651 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.468597 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d47c5fdcd-ffsjx" Jun 03 16:27:37.479357 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.479322 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d47c5fdcd-ffsjx"] Jun 03 16:27:37.536447 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.536428 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cddc48d79-thkwh" Jun 03 16:27:37.624934 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.624905 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h592j\" (UniqueName: \"kubernetes.io/projected/fcb99363-8c5c-49f4-9768-ff82863759a1-kube-api-access-h592j\") pod \"maas-controller-7d47c5fdcd-ffsjx\" (UID: \"fcb99363-8c5c-49f4-9768-ff82863759a1\") " pod="opendatahub/maas-controller-7d47c5fdcd-ffsjx" Jun 03 16:27:37.725450 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.725377 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42mn8\" (UniqueName: \"kubernetes.io/projected/be07a0b8-9ea3-46d1-af79-2f2e3223e018-kube-api-access-42mn8\") pod \"be07a0b8-9ea3-46d1-af79-2f2e3223e018\" (UID: \"be07a0b8-9ea3-46d1-af79-2f2e3223e018\") " Jun 03 16:27:37.725575 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.725491 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h592j\" (UniqueName: \"kubernetes.io/projected/fcb99363-8c5c-49f4-9768-ff82863759a1-kube-api-access-h592j\") pod \"maas-controller-7d47c5fdcd-ffsjx\" (UID: \"fcb99363-8c5c-49f4-9768-ff82863759a1\") " pod="opendatahub/maas-controller-7d47c5fdcd-ffsjx" Jun 03 16:27:37.727345 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.727314 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be07a0b8-9ea3-46d1-af79-2f2e3223e018-kube-api-access-42mn8" (OuterVolumeSpecName: "kube-api-access-42mn8") pod "be07a0b8-9ea3-46d1-af79-2f2e3223e018" (UID: "be07a0b8-9ea3-46d1-af79-2f2e3223e018"). InnerVolumeSpecName "kube-api-access-42mn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:27:37.733520 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.733500 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h592j\" (UniqueName: \"kubernetes.io/projected/fcb99363-8c5c-49f4-9768-ff82863759a1-kube-api-access-h592j\") pod \"maas-controller-7d47c5fdcd-ffsjx\" (UID: \"fcb99363-8c5c-49f4-9768-ff82863759a1\") " pod="opendatahub/maas-controller-7d47c5fdcd-ffsjx" Jun 03 16:27:37.780797 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.780768 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d47c5fdcd-ffsjx" Jun 03 16:27:37.826191 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.826147 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42mn8\" (UniqueName: \"kubernetes.io/projected/be07a0b8-9ea3-46d1-af79-2f2e3223e018-kube-api-access-42mn8\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:27:37.929718 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:37.929692 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d47c5fdcd-ffsjx"] Jun 03 16:27:37.931716 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:27:37.931687 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb99363_8c5c_49f4_9768_ff82863759a1.slice/crio-9568a572ac640a0af91fbbb6fd4234f09030718f437158b98c98df579bc32b66 WatchSource:0}: Error finding container 9568a572ac640a0af91fbbb6fd4234f09030718f437158b98c98df579bc32b66: Status 404 returned error can't find the container with id 9568a572ac640a0af91fbbb6fd4234f09030718f437158b98c98df579bc32b66 Jun 03 16:27:38.266779 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:38.266729 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:27:38.279614 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:38.279590 2559 generic.go:358] "Generic (PLEG): container finished" podID="be07a0b8-9ea3-46d1-af79-2f2e3223e018" containerID="1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038" exitCode=0 Jun 03 16:27:38.279773 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:38.279642 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cddc48d79-thkwh" Jun 03 16:27:38.279773 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:38.279669 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cddc48d79-thkwh" event={"ID":"be07a0b8-9ea3-46d1-af79-2f2e3223e018","Type":"ContainerDied","Data":"1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038"} Jun 03 16:27:38.279773 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:38.279705 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cddc48d79-thkwh" event={"ID":"be07a0b8-9ea3-46d1-af79-2f2e3223e018","Type":"ContainerDied","Data":"466f2cc02ba1d01199e80a1c12d0c10704552440729a88244b52ff8681f3a2e0"} Jun 03 16:27:38.279773 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:38.279721 2559 scope.go:117] "RemoveContainer" containerID="1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038" Jun 03 16:27:38.280909 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:38.280687 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d47c5fdcd-ffsjx" event={"ID":"fcb99363-8c5c-49f4-9768-ff82863759a1","Type":"ContainerStarted","Data":"9568a572ac640a0af91fbbb6fd4234f09030718f437158b98c98df579bc32b66"} Jun 03 16:27:38.289627 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:38.289608 2559 scope.go:117] "RemoveContainer" containerID="1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038" Jun 03 16:27:38.290118 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:27:38.289972 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038\": container with ID starting with 1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038 not found: ID does not exist" containerID="1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038" Jun 03 16:27:38.290118 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:38.290008 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038"} err="failed to get container status \"1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038\": rpc error: code = NotFound desc = could not find container \"1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038\": container with ID starting with 1cae5e8cf252ce5e371cacf5f2c571ce106e19d5ff4f0486cad04cb1422ec038 not found: ID does not exist" Jun 03 16:27:38.312201 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:38.312174 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cddc48d79-thkwh"] Jun 03 16:27:38.316942 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:38.316920 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cddc48d79-thkwh"] Jun 03 16:27:39.060693 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:39.060662 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be07a0b8-9ea3-46d1-af79-2f2e3223e018" path="/var/lib/kubelet/pods/be07a0b8-9ea3-46d1-af79-2f2e3223e018/volumes" Jun 03 16:27:39.286652 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:39.286614 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d47c5fdcd-ffsjx" event={"ID":"fcb99363-8c5c-49f4-9768-ff82863759a1","Type":"ContainerStarted","Data":"9e6898f4efa3a96e2ca6980061a8d6833088967a7be166c55bb1f52c26e31c72"} Jun 03 16:27:39.287091 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:39.286670 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d47c5fdcd-ffsjx" Jun 03 16:27:39.302770 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:39.302707 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7d47c5fdcd-ffsjx" podStartSLOduration=1.93635578 podStartE2EDuration="2.302694263s" podCreationTimestamp="2026-06-03 16:27:37 +0000 UTC" firstStartedPulling="2026-06-03 16:27:37.932811318 +0000 UTC m=+635.449807949" lastFinishedPulling="2026-06-03 16:27:38.2991498 +0000 UTC m=+635.816146432" observedRunningTime="2026-06-03 16:27:39.301311806 +0000 UTC m=+636.818308456" watchObservedRunningTime="2026-06-03 16:27:39.302694263 +0000 UTC m=+636.819690892" Jun 03 16:27:43.264152 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:43.264109 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-msd6z" Jun 03 16:27:50.297726 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:50.297697 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d47c5fdcd-ffsjx" Jun 03 16:27:50.345823 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:50.345791 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cc8f6dbc6-7zfml"] Jun 03 16:27:50.346024 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:50.346004 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" podUID="4b4bec78-6fec-47b9-9207-809438dcab44" containerName="manager" containerID="cri-o://95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545" gracePeriod=10 Jun 03 16:27:50.586994 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:50.586972 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" Jun 03 16:27:50.630219 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:50.630175 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxvr9\" (UniqueName: \"kubernetes.io/projected/4b4bec78-6fec-47b9-9207-809438dcab44-kube-api-access-dxvr9\") pod \"4b4bec78-6fec-47b9-9207-809438dcab44\" (UID: \"4b4bec78-6fec-47b9-9207-809438dcab44\") " Jun 03 16:27:50.632166 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:50.632140 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4bec78-6fec-47b9-9207-809438dcab44-kube-api-access-dxvr9" (OuterVolumeSpecName: "kube-api-access-dxvr9") pod "4b4bec78-6fec-47b9-9207-809438dcab44" (UID: "4b4bec78-6fec-47b9-9207-809438dcab44"). InnerVolumeSpecName "kube-api-access-dxvr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:27:50.731677 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:50.731643 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxvr9\" (UniqueName: \"kubernetes.io/projected/4b4bec78-6fec-47b9-9207-809438dcab44-kube-api-access-dxvr9\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:27:51.332458 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:51.332381 2559 generic.go:358] "Generic (PLEG): container finished" podID="4b4bec78-6fec-47b9-9207-809438dcab44" containerID="95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545" exitCode=0 Jun 03 16:27:51.332458 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:51.332435 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" event={"ID":"4b4bec78-6fec-47b9-9207-809438dcab44","Type":"ContainerDied","Data":"95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545"} Jun 03 16:27:51.332891 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:51.332469 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" event={"ID":"4b4bec78-6fec-47b9-9207-809438dcab44","Type":"ContainerDied","Data":"13daa398da80fec056b07879c57cc58fec61e1a82f506a1d0a0523d05356ec38"} Jun 03 16:27:51.332891 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:51.332484 2559 scope.go:117] "RemoveContainer" containerID="95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545" Jun 03 16:27:51.332891 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:51.332441 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc8f6dbc6-7zfml" Jun 03 16:27:51.340853 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:51.340830 2559 scope.go:117] "RemoveContainer" containerID="95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545" Jun 03 16:27:51.341103 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:27:51.341085 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545\": container with ID starting with 95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545 not found: ID does not exist" containerID="95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545" Jun 03 16:27:51.341165 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:51.341114 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545"} err="failed to get container status \"95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545\": rpc error: code = NotFound desc = could not find container \"95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545\": container with ID starting with 95e5bc26037fc81f7e229ccba19eb86367a9862282a770aa6376931213800545 not found: ID does not exist" Jun 03 16:27:51.351818 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:51.351794 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cc8f6dbc6-7zfml"] Jun 03 16:27:51.359314 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:51.359292 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cc8f6dbc6-7zfml"] Jun 03 16:27:53.060101 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:27:53.060068 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b4bec78-6fec-47b9-9207-809438dcab44" path="/var/lib/kubelet/pods/4b4bec78-6fec-47b9-9207-809438dcab44/volumes" Jun 03 16:28:11.484365 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.484330 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-fb55646db-cx8g2"] Jun 03 16:28:11.484735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.484684 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be07a0b8-9ea3-46d1-af79-2f2e3223e018" containerName="manager" Jun 03 16:28:11.484735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.484695 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="be07a0b8-9ea3-46d1-af79-2f2e3223e018" containerName="manager" Jun 03 16:28:11.484735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.484718 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4bec78-6fec-47b9-9207-809438dcab44" containerName="manager" Jun 03 16:28:11.484735 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.484724 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4bec78-6fec-47b9-9207-809438dcab44" containerName="manager" Jun 03 16:28:11.484899 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.484800 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b4bec78-6fec-47b9-9207-809438dcab44" containerName="manager" Jun 03 16:28:11.484899 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.484809 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="be07a0b8-9ea3-46d1-af79-2f2e3223e018" containerName="manager" Jun 03 16:28:11.490969 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.490949 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-fb55646db-cx8g2" Jun 03 16:28:11.499279 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.499204 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-fb55646db-cx8g2"] Jun 03 16:28:11.617124 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.617079 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4qrg\" (UniqueName: \"kubernetes.io/projected/8f678202-2728-4e91-afcd-db95fdb2630c-kube-api-access-k4qrg\") pod \"maas-api-fb55646db-cx8g2\" (UID: \"8f678202-2728-4e91-afcd-db95fdb2630c\") " pod="opendatahub/maas-api-fb55646db-cx8g2" Jun 03 16:28:11.617315 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.617265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f678202-2728-4e91-afcd-db95fdb2630c-maas-api-tls\") pod \"maas-api-fb55646db-cx8g2\" (UID: \"8f678202-2728-4e91-afcd-db95fdb2630c\") " pod="opendatahub/maas-api-fb55646db-cx8g2" Jun 03 16:28:11.718326 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.718282 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f678202-2728-4e91-afcd-db95fdb2630c-maas-api-tls\") pod \"maas-api-fb55646db-cx8g2\" (UID: \"8f678202-2728-4e91-afcd-db95fdb2630c\") " pod="opendatahub/maas-api-fb55646db-cx8g2" Jun 03 16:28:11.718524 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.718344 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qrg\" (UniqueName: \"kubernetes.io/projected/8f678202-2728-4e91-afcd-db95fdb2630c-kube-api-access-k4qrg\") pod \"maas-api-fb55646db-cx8g2\" (UID: \"8f678202-2728-4e91-afcd-db95fdb2630c\") " pod="opendatahub/maas-api-fb55646db-cx8g2" Jun 03 16:28:11.720817 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.720793 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f678202-2728-4e91-afcd-db95fdb2630c-maas-api-tls\") pod \"maas-api-fb55646db-cx8g2\" (UID: \"8f678202-2728-4e91-afcd-db95fdb2630c\") " pod="opendatahub/maas-api-fb55646db-cx8g2" Jun 03 16:28:11.733291 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.733263 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4qrg\" (UniqueName: \"kubernetes.io/projected/8f678202-2728-4e91-afcd-db95fdb2630c-kube-api-access-k4qrg\") pod \"maas-api-fb55646db-cx8g2\" (UID: \"8f678202-2728-4e91-afcd-db95fdb2630c\") " pod="opendatahub/maas-api-fb55646db-cx8g2" Jun 03 16:28:11.802918 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.802834 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-fb55646db-cx8g2" Jun 03 16:28:11.934577 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:11.934544 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-fb55646db-cx8g2"] Jun 03 16:28:11.936827 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:28:11.936793 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f678202_2728_4e91_afcd_db95fdb2630c.slice/crio-eb215e346d55bc673165809a40266016b7b34f360f8298b12e176c97ddb0f00a WatchSource:0}: Error finding container eb215e346d55bc673165809a40266016b7b34f360f8298b12e176c97ddb0f00a: Status 404 returned error can't find the container with id eb215e346d55bc673165809a40266016b7b34f360f8298b12e176c97ddb0f00a Jun 03 16:28:12.409378 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:12.409338 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-fb55646db-cx8g2" event={"ID":"8f678202-2728-4e91-afcd-db95fdb2630c","Type":"ContainerStarted","Data":"eb215e346d55bc673165809a40266016b7b34f360f8298b12e176c97ddb0f00a"} Jun 03 16:28:14.417875 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:14.417835 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-fb55646db-cx8g2" event={"ID":"8f678202-2728-4e91-afcd-db95fdb2630c","Type":"ContainerStarted","Data":"33b4d119ee0c789c918beace4ae342f5ad00732443e01a23b19eebac34638962"} Jun 03 16:28:14.418264 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:14.417992 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-fb55646db-cx8g2" Jun 03 16:28:14.438234 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:14.438176 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-fb55646db-cx8g2" podStartSLOduration=1.363153066 podStartE2EDuration="3.438162436s" podCreationTimestamp="2026-06-03 16:28:11 +0000 UTC" firstStartedPulling="2026-06-03 16:28:11.93800882 +0000 UTC m=+669.455005448" lastFinishedPulling="2026-06-03 16:28:14.013018181 +0000 UTC m=+671.530014818" observedRunningTime="2026-06-03 16:28:14.437269201 +0000 UTC m=+671.954265862" watchObservedRunningTime="2026-06-03 16:28:14.438162436 +0000 UTC m=+671.955159085" Jun 03 16:28:20.427648 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:20.427615 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-fb55646db-cx8g2" Jun 03 16:28:20.475878 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:20.475844 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-8f7b6f664-wdwml"] Jun 03 16:28:20.476130 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:20.476078 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-8f7b6f664-wdwml" podUID="bae7f646-3ec6-4538-a0d8-c955eab73cc5" containerName="maas-api" containerID="cri-o://4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401" gracePeriod=30 Jun 03 16:28:20.728072 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:20.728045 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:28:20.908319 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:20.908286 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae7f646-3ec6-4538-a0d8-c955eab73cc5-maas-api-tls\") pod \"bae7f646-3ec6-4538-a0d8-c955eab73cc5\" (UID: \"bae7f646-3ec6-4538-a0d8-c955eab73cc5\") " Jun 03 16:28:20.908491 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:20.908474 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm456\" (UniqueName: \"kubernetes.io/projected/bae7f646-3ec6-4538-a0d8-c955eab73cc5-kube-api-access-lm456\") pod \"bae7f646-3ec6-4538-a0d8-c955eab73cc5\" (UID: \"bae7f646-3ec6-4538-a0d8-c955eab73cc5\") " Jun 03 16:28:20.910377 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:20.910351 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae7f646-3ec6-4538-a0d8-c955eab73cc5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bae7f646-3ec6-4538-a0d8-c955eab73cc5" (UID: "bae7f646-3ec6-4538-a0d8-c955eab73cc5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:28:20.910468 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:20.910378 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae7f646-3ec6-4538-a0d8-c955eab73cc5-kube-api-access-lm456" (OuterVolumeSpecName: "kube-api-access-lm456") pod "bae7f646-3ec6-4538-a0d8-c955eab73cc5" (UID: "bae7f646-3ec6-4538-a0d8-c955eab73cc5"). InnerVolumeSpecName "kube-api-access-lm456". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:28:21.009659 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:21.009586 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm456\" (UniqueName: \"kubernetes.io/projected/bae7f646-3ec6-4538-a0d8-c955eab73cc5-kube-api-access-lm456\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:28:21.009659 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:21.009610 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae7f646-3ec6-4538-a0d8-c955eab73cc5-maas-api-tls\") on node \"ip-10-0-133-169.ec2.internal\" DevicePath \"\"" Jun 03 16:28:21.445209 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:21.445174 2559 generic.go:358] "Generic (PLEG): container finished" podID="bae7f646-3ec6-4538-a0d8-c955eab73cc5" containerID="4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401" exitCode=0 Jun 03 16:28:21.445608 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:21.445231 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8f7b6f664-wdwml" Jun 03 16:28:21.445608 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:21.445250 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8f7b6f664-wdwml" event={"ID":"bae7f646-3ec6-4538-a0d8-c955eab73cc5","Type":"ContainerDied","Data":"4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401"} Jun 03 16:28:21.445608 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:21.445289 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8f7b6f664-wdwml" event={"ID":"bae7f646-3ec6-4538-a0d8-c955eab73cc5","Type":"ContainerDied","Data":"a81ef34450755d38984cf60c193dd3cd0ef114322c86ee9babc5d01df50e08f4"} Jun 03 16:28:21.445608 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:21.445306 2559 scope.go:117] "RemoveContainer" containerID="4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401" Jun 03 16:28:21.453540 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:21.453526 2559 scope.go:117] "RemoveContainer" containerID="4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401" Jun 03 16:28:21.453810 ip-10-0-133-169 kubenswrapper[2559]: E0603 16:28:21.453780 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401\": container with ID starting with 4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401 not found: ID does not exist" containerID="4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401" Jun 03 16:28:21.453879 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:21.453809 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401"} err="failed to get container status \"4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401\": rpc error: code = NotFound desc = could not find container \"4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401\": container with ID starting with 4b118047c7d676ce1ff33d0f1a940ee64a7329010113ca5feb6964e221fa4401 not found: ID does not exist" Jun 03 16:28:21.463294 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:21.463269 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-8f7b6f664-wdwml"] Jun 03 16:28:21.467062 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:21.467042 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-8f7b6f664-wdwml"] Jun 03 16:28:23.060511 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:28:23.060473 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae7f646-3ec6-4538-a0d8-c955eab73cc5" path="/var/lib/kubelet/pods/bae7f646-3ec6-4538-a0d8-c955eab73cc5/volumes" Jun 03 16:32:02.990188 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:32:02.990153 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/1.log" Jun 03 16:32:02.992397 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:32:02.992376 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/1.log" Jun 03 16:32:02.994440 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:32:02.994424 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztm65_7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1/ovn-acl-logging/0.log" Jun 03 16:32:02.996383 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:32:02.996369 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztm65_7f5e7ac5-c8d1-4c58-8bf3-32988a0d5ac1/ovn-acl-logging/0.log" Jun 03 16:33:47.575465 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:33:47.575382 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-l4t9z_157615a9-d69f-4b8b-b021-1e25a0ace242/manager/0.log" Jun 03 16:33:47.713186 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:33:47.713155 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-fb55646db-cx8g2_8f678202-2728-4e91-afcd-db95fdb2630c/maas-api/0.log" Jun 03 16:33:47.955345 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:33:47.955306 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d47c5fdcd-ffsjx_fcb99363-8c5c-49f4-9768-ff82863759a1/manager/0.log" Jun 03 16:33:48.088409 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:33:48.088380 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-hpcs7_31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca/manager/2.log" Jun 03 16:33:48.478258 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:33:48.478227 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c656db94d-xb4p5_591a7fe2-a90d-4ed6-9d38-f2cbbf45b316/manager/0.log" Jun 03 16:33:48.597097 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:33:48.597070 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-868db5846d-r5qp9_23e98219-d12d-4614-8b45-10428120fa62/postgres/0.log" Jun 03 16:33:51.250323 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:33:51.250294 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-hfnlw_9a51119c-fc24-4ec3-a002-718766693190/discovery/0.log" Jun 03 16:33:51.474691 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:33:51.474665 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b4fb99578-7d4q4_c780928e-1daf-44b0-8e32-b9298fe5c0c9/kube-auth-proxy/0.log" Jun 03 16:33:51.586721 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:33:51.586626 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-cfpnz_9575adae-c350-4110-9690-e1f95aa1f3ea/istio-proxy/0.log" Jun 03 16:33:51.700362 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:33:51.700330 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-msd6z_7572893f-c9a4-4c88-a041-1989063a4ec6/payload-processing/0.log" Jun 03 16:33:51.817218 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:33:51.817191 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6868b4f58f-cq6sd_6234e9c7-9a83-4d91-847f-cd559b30aa96/router/0.log" Jun 03 16:34:00.280216 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:00.280172 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zkx42_c1f85abe-3593-4155-99a9-696dde6fb845/global-pull-secret-syncer/0.log" Jun 03 16:34:00.360062 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:00.360011 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-khlfs_53211488-be94-4a12-acc0-0d4064b9c740/konnectivity-agent/0.log" Jun 03 16:34:00.433157 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:00.433124 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-169.ec2.internal_3ef07b2a1294412403570bdfa95343bd/haproxy/0.log" Jun 03 16:34:06.896791 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:06.896736 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-wmldl_8211b5cc-90d3-4d03-9b66-7327113954c8/cluster-monitoring-operator/0.log" Jun 03 16:34:07.181801 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:07.181697 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d5wrv_7161e58c-6398-4623-a685-71a8aca25673/node-exporter/0.log" Jun 03 16:34:07.205442 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:07.205410 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d5wrv_7161e58c-6398-4623-a685-71a8aca25673/kube-rbac-proxy/0.log" Jun 03 16:34:07.233156 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:07.233137 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d5wrv_7161e58c-6398-4623-a685-71a8aca25673/init-textfile/0.log" Jun 03 16:34:09.193662 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.193636 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-l67ld_7a9a71cc-0fa9-4cfc-a6cf-0311b8395784/networking-console-plugin/0.log" Jun 03 16:34:09.198938 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.198911 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll"] Jun 03 16:34:09.199253 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.199242 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae7f646-3ec6-4538-a0d8-c955eab73cc5" containerName="maas-api" Jun 03 16:34:09.199295 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.199255 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae7f646-3ec6-4538-a0d8-c955eab73cc5" containerName="maas-api" Jun 03 16:34:09.199328 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.199318 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="bae7f646-3ec6-4538-a0d8-c955eab73cc5" containerName="maas-api" Jun 03 16:34:09.202386 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.202366 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.205282 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.205266 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-clkt5\"/\"kube-root-ca.crt\"" Jun 03 16:34:09.205598 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.205582 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-clkt5\"/\"openshift-service-ca.crt\"" Jun 03 16:34:09.206073 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.206059 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-clkt5\"/\"default-dockercfg-zpvg7\"" Jun 03 16:34:09.211124 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.211103 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll"] Jun 03 16:34:09.256627 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.256599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-sys\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.256739 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.256629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-lib-modules\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.256739 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.256652 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-proc\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.256739 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.256716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58rn8\" (UniqueName: \"kubernetes.io/projected/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-kube-api-access-58rn8\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.256884 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.256786 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-podres\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.357656 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.357629 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-podres\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.357818 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.357662 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-sys\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.357818 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.357684 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-lib-modules\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.357818 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.357707 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-proc\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.357818 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.357744 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58rn8\" (UniqueName: \"kubernetes.io/projected/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-kube-api-access-58rn8\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.357818 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.357781 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-sys\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.357818 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.357804 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-podres\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.358029 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.357828 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-lib-modules\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.358029 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.357847 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-proc\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.367068 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.367047 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58rn8\" (UniqueName: \"kubernetes.io/projected/3db1afd4-a1ee-4023-a2f9-7d6755fe4d46-kube-api-access-58rn8\") pod \"perf-node-gather-daemonset-hzsll\" (UID: \"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46\") " pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.513885 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.513799 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:09.646982 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.646951 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll"] Jun 03 16:34:09.649629 ip-10-0-133-169 kubenswrapper[2559]: W0603 16:34:09.649591 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3db1afd4_a1ee_4023_a2f9_7d6755fe4d46.slice/crio-8e2bf17693d931bd54dfcb4728d319f484573fed0452414ea6abf143c5b96585 WatchSource:0}: Error finding container 8e2bf17693d931bd54dfcb4728d319f484573fed0452414ea6abf143c5b96585: Status 404 returned error can't find the container with id 8e2bf17693d931bd54dfcb4728d319f484573fed0452414ea6abf143c5b96585 Jun 03 16:34:09.651191 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.651175 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:34:09.665981 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.665948 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" event={"ID":"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46","Type":"ContainerStarted","Data":"8e2bf17693d931bd54dfcb4728d319f484573fed0452414ea6abf143c5b96585"} Jun 03 16:34:09.826081 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.825982 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/1.log" Jun 03 16:34:09.835098 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:09.835071 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-lq5m4_d8f45027-664c-47e2-a385-7c4fe95993f0/console-operator/2.log" Jun 03 16:34:10.670775 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:10.670726 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" event={"ID":"3db1afd4-a1ee-4023-a2f9-7d6755fe4d46","Type":"ContainerStarted","Data":"c3c24bc93af98ef15f167e89662c6ea3d86b8f2567c8c19aac26205eda137566"} Jun 03 16:34:10.671145 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:10.670791 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:10.689358 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:10.689307 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" podStartSLOduration=1.689294082 podStartE2EDuration="1.689294082s" podCreationTimestamp="2026-06-03 16:34:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:34:10.687776265 +0000 UTC m=+1028.204772909" watchObservedRunningTime="2026-06-03 16:34:10.689294082 +0000 UTC m=+1028.206290732" Jun 03 16:34:10.917681 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:10.917641 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-r8gml_27ef8f31-95e5-4c5b-b582-6fa848db3a16/volume-data-source-validator/0.log" Jun 03 16:34:11.747694 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:11.747669 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-84vdh_044b7d3d-10a9-4d90-aee0-da4ddcdf9132/dns/0.log" Jun 03 16:34:11.771985 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:11.771955 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-84vdh_044b7d3d-10a9-4d90-aee0-da4ddcdf9132/kube-rbac-proxy/0.log" Jun 03 16:34:11.958099 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:11.958074 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l2gc6_38f3431f-3e93-4762-bb4e-41f7cdeb5c1e/dns-node-resolver/0.log" Jun 03 16:34:12.506532 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:12.506507 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-68nhq_66a3af12-9718-4e7f-b6e3-ef4b33be72c5/node-ca/0.log" Jun 03 16:34:13.561250 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:13.561219 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-hfnlw_9a51119c-fc24-4ec3-a002-718766693190/discovery/0.log" Jun 03 16:34:13.622438 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:13.622409 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b4fb99578-7d4q4_c780928e-1daf-44b0-8e32-b9298fe5c0c9/kube-auth-proxy/0.log" Jun 03 16:34:13.654181 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:13.654159 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-cfpnz_9575adae-c350-4110-9690-e1f95aa1f3ea/istio-proxy/0.log" Jun 03 16:34:13.680280 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:13.680253 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-msd6z_7572893f-c9a4-4c88-a041-1989063a4ec6/payload-processing/0.log" Jun 03 16:34:13.734618 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:13.734595 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6868b4f58f-cq6sd_6234e9c7-9a83-4d91-847f-cd559b30aa96/router/0.log" Jun 03 16:34:14.351552 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:14.351526 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9wbh7_dd27ea7c-d1de-4ba7-b04e-0e423252086f/serve-healthcheck-canary/0.log" Jun 03 16:34:14.790900 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:14.790814 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-mz5lt_f327c6e2-8b7e-45e2-b773-7ccbf8badc30/insights-operator/1.log" Jun 03 16:34:14.800446 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:14.800421 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-mz5lt_f327c6e2-8b7e-45e2-b773-7ccbf8badc30/insights-operator/0.log" Jun 03 16:34:14.903406 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:14.903376 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5vrzx_89b44451-f3ad-4384-87f9-1e21fc07839d/kube-rbac-proxy/0.log" Jun 03 16:34:14.926006 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:14.925982 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5vrzx_89b44451-f3ad-4384-87f9-1e21fc07839d/exporter/0.log" Jun 03 16:34:14.950148 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:14.950120 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5vrzx_89b44451-f3ad-4384-87f9-1e21fc07839d/extractor/0.log" Jun 03 16:34:16.684292 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:16.684260 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-clkt5/perf-node-gather-daemonset-hzsll" Jun 03 16:34:16.937802 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:16.937700 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-l4t9z_157615a9-d69f-4b8b-b021-1e25a0ace242/manager/0.log" Jun 03 16:34:16.970360 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:16.970331 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-fb55646db-cx8g2_8f678202-2728-4e91-afcd-db95fdb2630c/maas-api/0.log" Jun 03 16:34:17.028349 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:17.028318 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d47c5fdcd-ffsjx_fcb99363-8c5c-49f4-9768-ff82863759a1/manager/0.log" Jun 03 16:34:17.057727 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:17.057688 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-hpcs7_31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca/manager/1.log" Jun 03 16:34:17.074934 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:17.074911 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-hpcs7_31e9514e-f6f3-4ab2-9b2e-08dedbdc60ca/manager/2.log" Jun 03 16:34:17.201244 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:17.201152 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c656db94d-xb4p5_591a7fe2-a90d-4ed6-9d38-f2cbbf45b316/manager/0.log" Jun 03 16:34:17.237299 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:17.237259 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-868db5846d-r5qp9_23e98219-d12d-4614-8b45-10428120fa62/postgres/0.log" Jun 03 16:34:23.554433 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:23.554395 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-4wctr_57ec466a-4a66-4dd3-b11a-22798042ffdb/kube-storage-version-migrator-operator/1.log" Jun 03 16:34:23.556231 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:23.556205 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-4wctr_57ec466a-4a66-4dd3-b11a-22798042ffdb/kube-storage-version-migrator-operator/0.log" Jun 03 16:34:24.626848 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:24.626815 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7tfm8_162704e6-bff8-4d14-8295-9cb4fcc6d9d6/kube-multus/0.log" Jun 03 16:34:24.723790 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:24.723739 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdldd_f8b84af5-f720-4e50-8fda-b9ea46260bf4/kube-multus-additional-cni-plugins/0.log" Jun 03 16:34:24.745880 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:24.745853 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdldd_f8b84af5-f720-4e50-8fda-b9ea46260bf4/egress-router-binary-copy/0.log" Jun 03 16:34:24.768002 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:24.767979 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdldd_f8b84af5-f720-4e50-8fda-b9ea46260bf4/cni-plugins/0.log" Jun 03 16:34:24.789416 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:24.789388 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdldd_f8b84af5-f720-4e50-8fda-b9ea46260bf4/bond-cni-plugin/0.log" Jun 03 16:34:24.810734 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:24.810712 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdldd_f8b84af5-f720-4e50-8fda-b9ea46260bf4/routeoverride-cni/0.log" Jun 03 16:34:24.831693 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:24.831673 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdldd_f8b84af5-f720-4e50-8fda-b9ea46260bf4/whereabouts-cni-bincopy/0.log" Jun 03 16:34:24.852538 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:24.852515 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdldd_f8b84af5-f720-4e50-8fda-b9ea46260bf4/whereabouts-cni/0.log" Jun 03 16:34:25.332468 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:25.332440 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ks9qp_525a53b8-7bcc-461b-89f0-cb054ce2ddfa/network-metrics-daemon/0.log" Jun 03 16:34:25.352608 ip-10-0-133-169 kubenswrapper[2559]: I0603 16:34:25.352585 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ks9qp_525a53b8-7bcc-461b-89f0-cb054ce2ddfa/kube-rbac-proxy/0.log"