Jun 03 21:37:31.538137 ip-10-0-141-1 systemd[1]: Starting Kubernetes Kubelet... Jun 03 21:37:31.971046 ip-10-0-141-1 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:37:31.971046 ip-10-0-141-1 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 21:37:31.971046 ip-10-0-141-1 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:37:31.971046 ip-10-0-141-1 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 21:37:31.971046 ip-10-0-141-1 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 21:37:31.972188 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.972111 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 21:37:31.981257 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981234 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:37:31.981257 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981254 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:37:31.981257 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981258 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:37:31.981257 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981262 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:37:31.981257 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981265 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981268 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981271 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981274 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981277 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981280 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981283 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981285 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981288 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981290 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981293 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981295 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981298 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981300 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981303 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981312 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981315 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981318 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981320 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:37:31.981459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981323 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981326 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981328 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981331 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981334 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981337 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981339 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981342 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981345 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981347 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981349 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981352 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981354 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981357 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981360 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981365 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981369 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981373 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981376 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981379 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:37:31.981954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981382 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981385 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981388 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981391 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981393 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981396 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981399 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981403 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981406 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981409 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981411 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981414 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981417 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981420 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981422 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981425 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981430 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981433 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981436 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981439 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:37:31.982489 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981443 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981446 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981449 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981452 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981455 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981457 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981461 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981464 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981468 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981470 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981473 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981476 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981479 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981481 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981484 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981486 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981489 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981492 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981494 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981497 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:37:31.982985 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981500 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981503 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981506 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981508 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981510 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981513 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981515 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981518 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981521 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981524 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981527 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981530 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981532 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981535 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.981538 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982229 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982234 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982237 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982240 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982243 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:37:31.983459 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982246 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982250 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982253 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982256 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982259 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982262 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982264 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982267 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982269 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982272 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982274 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982277 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982281 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982286 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982289 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982292 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982295 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982298 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:37:31.983945 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982300 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982303 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982307 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982310 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982313 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982316 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982318 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982322 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982326 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982329 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982331 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982334 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982337 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982340 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982342 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982346 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982348 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982351 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982353 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982356 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:37:31.984393 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982358 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982361 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982363 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982366 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982368 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982371 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982373 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982376 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982379 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982382 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982385 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982387 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982390 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982392 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982395 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982406 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982409 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982412 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982414 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982417 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:37:31.984886 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982420 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982422 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982425 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982428 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982430 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982433 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982436 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982439 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982441 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982444 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982446 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982449 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982451 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982454 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982457 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982460 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982462 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982465 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982467 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982470 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:37:31.985374 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982472 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982476 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982478 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982481 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982483 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982486 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982489 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982492 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982494 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982497 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982500 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982502 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982505 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982508 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982510 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982894 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982901 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982904 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982907 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982910 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:37:31.985869 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982913 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982915 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982918 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982921 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982924 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982926 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982929 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982932 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982934 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982937 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982940 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982942 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982945 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982948 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982951 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982953 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982956 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982959 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982962 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982965 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:37:31.986354 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982967 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982970 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982972 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982975 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982978 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982981 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982983 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982986 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982989 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982992 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982995 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.982997 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983000 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983002 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983005 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983007 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983010 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983012 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983015 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983018 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:37:31.986854 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983020 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983023 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983025 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983028 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983031 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983033 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983036 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983039 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983041 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983044 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983049 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983051 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983054 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983058 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983061 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983064 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983067 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983070 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983073 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:37:31.987371 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983075 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983080 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983083 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983085 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983088 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983090 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983093 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983095 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983098 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983100 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983103 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983105 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983108 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983110 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983112 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983115 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983117 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983120 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983122 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983125 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:37:31.987881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983128 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983131 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983134 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983140 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983143 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983146 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983150 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983152 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983155 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983158 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983161 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983163 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983166 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983169 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983235 2554 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983242 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983248 2554 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983252 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983256 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983260 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 21:37:31.988372 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983264 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983267 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983271 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983274 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983277 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983281 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983284 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983287 2554 flags.go:64] FLAG: --cgroup-root="" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983290 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983293 2554 flags.go:64] FLAG: --client-ca-file="" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983296 2554 flags.go:64] FLAG: --cloud-provider="external" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983298 2554 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983303 2554 flags.go:64] FLAG: --cluster-domain="" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983307 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983310 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983315 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983318 2554 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983322 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983325 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983328 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983331 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983334 2554 flags.go:64] FLAG: --contention-profiling="false" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983337 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983340 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 21:37:31.988878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983344 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983347 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983350 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983353 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983356 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983359 2554 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983362 2554 flags.go:64] FLAG: --enable-server="true" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983365 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983369 2554 flags.go:64] FLAG: --event-burst="100" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983372 2554 flags.go:64] FLAG: --event-qps="50" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983375 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983378 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983381 2554 flags.go:64] FLAG: --eviction-hard="" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983384 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983387 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983390 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983393 2554 flags.go:64] FLAG: --eviction-soft="" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983396 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983398 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983401 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983404 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983407 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983410 2554 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983414 2554 flags.go:64] FLAG: --feature-gates="" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983418 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 21:37:31.989473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983421 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983424 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983427 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983430 2554 flags.go:64] FLAG: --healthz-port="10248" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983433 2554 flags.go:64] FLAG: --help="false" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983436 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-141-1.ec2.internal" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983439 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983443 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983446 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983450 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983453 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983456 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983459 2554 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983462 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983465 2554 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983468 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983472 2554 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983475 2554 flags.go:64] FLAG: --kube-reserved="" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983477 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983480 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983483 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983486 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983489 2554 flags.go:64] FLAG: --lock-file="" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983492 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 21:37:31.990160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983495 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983498 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983503 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983506 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983508 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983511 2554 flags.go:64] FLAG: --logging-format="text" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983516 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983519 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983522 2554 flags.go:64] FLAG: --manifest-url="" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983524 2554 flags.go:64] FLAG: --manifest-url-header="" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983528 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983531 2554 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983535 2554 flags.go:64] FLAG: --max-pods="110" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983538 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983541 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983545 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983548 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983551 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983554 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983556 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983563 2554 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983566 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983569 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 21:37:31.990758 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983572 2554 flags.go:64] FLAG: --pod-cidr="" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983575 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983581 2554 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983584 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983586 2554 flags.go:64] FLAG: --pods-per-core="0" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983589 2554 flags.go:64] FLAG: --port="10250" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983592 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983595 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09a90a170fbcd5772" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983598 2554 flags.go:64] FLAG: --qos-reserved="" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983601 2554 flags.go:64] FLAG: --read-only-port="10255" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983604 2554 flags.go:64] FLAG: --register-node="true" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983607 2554 flags.go:64] FLAG: --register-with-taints="" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983610 2554 flags.go:64] FLAG: --registry-burst="10" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983613 2554 flags.go:64] FLAG: --registry-qps="5" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983616 2554 flags.go:64] FLAG: --reserved-cpus="" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983619 2554 flags.go:64] FLAG: --reserved-memory="" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983623 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983626 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983629 2554 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983632 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983635 2554 flags.go:64] FLAG: --runonce="false" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983638 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983641 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983644 2554 flags.go:64] FLAG: --seccomp-default="false" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983648 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 21:37:31.991334 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983651 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983654 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983657 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983660 2554 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983663 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983666 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983669 2554 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983671 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983674 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983677 2554 flags.go:64] FLAG: --system-cgroups="" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983680 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983685 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983688 2554 flags.go:64] FLAG: --tls-cert-file="" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983690 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983695 2554 flags.go:64] FLAG: --tls-min-version="" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983697 2554 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983700 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983703 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983706 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983708 2554 flags.go:64] FLAG: --v="2" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983712 2554 flags.go:64] FLAG: --version="false" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983716 2554 flags.go:64] FLAG: --vmodule="" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983720 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.983723 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983852 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:37:31.992041 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983857 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983861 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983865 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983868 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983871 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983873 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983877 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983880 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983883 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983885 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983888 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983891 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983893 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983896 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983899 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983902 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983904 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983907 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983909 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:37:31.992650 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983912 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983914 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983916 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983919 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983922 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983924 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983927 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983929 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983932 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983935 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983937 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983940 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983942 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983945 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983948 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983951 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983953 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983956 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983959 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983963 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:37:31.993143 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983965 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983968 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983970 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983973 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983975 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983978 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983980 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983983 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983986 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983988 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983991 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983993 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.983998 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984002 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984005 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984008 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984010 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984013 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984016 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:37:31.993637 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984019 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984022 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984025 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984028 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984031 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984033 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984036 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984039 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984042 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984045 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984047 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984051 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984056 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984060 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984062 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984065 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984067 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984070 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984073 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984076 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:37:31.994120 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984078 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984081 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984083 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984086 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984089 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984093 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984096 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984098 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984101 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984104 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984106 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984109 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984112 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984114 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984117 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984119 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984122 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984125 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:37:31.994655 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.984128 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.984133 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.990950 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.990965 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.991943 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.991954 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992016 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992021 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992024 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992027 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992031 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992034 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992036 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992039 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:37:31.995110 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992043 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992048 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992051 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992054 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992056 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992059 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992063 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992066 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992068 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992071 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992074 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992077 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992079 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992082 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992084 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992087 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992089 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992092 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992095 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992097 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:37:31.995464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992100 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992103 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992106 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992109 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992111 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992114 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992117 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992119 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992122 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992125 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992127 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992130 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992132 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992135 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992137 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992140 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992142 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992145 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992150 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992153 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:37:31.996079 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992156 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992159 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992162 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992165 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992168 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992170 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992173 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992176 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992178 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992181 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992184 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992186 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992189 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992192 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992196 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992198 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992202 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992205 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992208 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:37:31.996568 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992211 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992214 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992217 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992220 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992222 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992225 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992228 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992231 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992234 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992236 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992239 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992242 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992245 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992247 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992250 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992252 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992255 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992258 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992260 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992263 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:37:31.997051 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992265 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992268 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992271 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992273 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992276 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992279 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992282 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992285 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992288 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992291 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992293 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.992299 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992415 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992420 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992423 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 21:37:31.997530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992426 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992429 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992432 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992435 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992438 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992440 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992444 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992446 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992450 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992452 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992455 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992458 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992460 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992463 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992465 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992468 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992471 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992473 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992476 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 21:37:31.997919 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992478 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992480 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992483 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992487 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992490 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992493 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992496 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992499 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992502 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992504 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992507 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992510 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992512 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992515 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992517 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992520 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992522 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992525 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992527 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 21:37:31.998384 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992530 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992533 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992535 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992538 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992541 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992543 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992546 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992548 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992551 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992553 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992556 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992558 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992561 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992563 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992566 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992569 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992571 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992574 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992576 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992579 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 21:37:31.998849 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992582 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992585 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992588 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992590 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992594 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992597 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992600 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992603 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992605 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992608 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992610 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992614 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992616 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992619 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992621 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992624 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992626 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992629 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992632 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992634 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 21:37:31.999340 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992637 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992640 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992642 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992645 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992647 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992649 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992653 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992657 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992660 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992663 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992667 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992669 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992673 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992676 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992679 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992682 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 21:37:31.999823 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:31.992685 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 21:37:32.000252 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.992690 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 21:37:32.000252 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.992790 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 21:37:32.000252 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.995200 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 21:37:32.000252 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.996856 2554 server.go:1019] "Starting client certificate rotation" Jun 03 21:37:32.000252 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.996956 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 21:37:32.000252 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.996992 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 21:37:32.000252 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:31.999949 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 21:37:32.027519 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.027500 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 21:37:32.039014 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.038994 2554 log.go:25] "Validated CRI v1 runtime API" Jun 03 21:37:32.042292 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.042278 2554 log.go:25] "Validated CRI v1 image API" Jun 03 21:37:32.043897 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.043871 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 21:37:32.047082 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.047056 2554 fs.go:135] Filesystem UUIDs: map[45eee870-2237-4b31-8eda-6556e3fa8e9a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 96592f0e-4084-4421-9992-9d03b00265c3:/dev/nvme0n1p4] Jun 03 21:37:32.047148 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.047081 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 21:37:32.049773 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.049757 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 21:37:32.053522 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.053420 2554 manager.go:216] Machine: {Timestamp:2026-06-03 21:37:32.052021735 +0000 UTC m=+0.388115011 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101398 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec234d04c9352a7155538dee264aa244 SystemUUID:ec234d04-c935-2a71-5553-8dee264aa244 BootID:a99de6bd-bccd-4c33-9bd7-dd7f943ec946 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a9:0f:bc:f4:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a9:0f:bc:f4:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:bf:10:53:1a:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 21:37:32.053522 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.053517 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 21:37:32.053616 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.053584 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 21:37:32.057053 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.057026 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 21:37:32.057188 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.057055 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 21:37:32.058693 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.058683 2554 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 21:37:32.058728 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.058696 2554 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 21:37:32.058728 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.058703 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 21:37:32.059527 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.059517 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 21:37:32.060615 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.060600 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 21:37:32.064683 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.064672 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 03 21:37:32.064792 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.064783 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 21:37:32.064827 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.064820 2554 kubelet.go:486] "Attempting to sync node with API server" Jun 03 21:37:32.064878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.064865 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 21:37:32.064910 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.064885 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 21:37:32.064910 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.064894 2554 kubelet.go:398] "Adding apiserver pod source" Jun 03 21:37:32.064910 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.064903 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 21:37:32.065294 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.065213 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 21:37:32.065294 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.065231 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 21:37:32.067617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.067599 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 21:37:32.069863 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.069847 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 21:37:32.069957 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.069886 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 21:37:32.071267 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071252 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 21:37:32.071341 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071273 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 21:37:32.071341 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071283 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 21:37:32.071341 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071290 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 21:37:32.071341 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071303 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 21:37:32.071341 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071322 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 21:37:32.071341 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071335 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 21:37:32.071545 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071344 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 21:37:32.071545 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071355 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 21:37:32.071545 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071365 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 21:37:32.071545 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071385 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 21:37:32.071545 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.071394 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 21:37:32.072310 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.072297 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 21:37:32.072366 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.072311 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 21:37:32.075143 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.075122 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 21:37:32.075224 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.075143 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 21:37:32.075260 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.075229 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 21:37:32.075574 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.075562 2554 server.go:1268] "Started kubelet" Jun 03 21:37:32.075656 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.075633 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 21:37:32.075709 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.075631 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 21:37:32.075754 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.075713 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 21:37:32.076513 ip-10-0-141-1 systemd[1]: Started Kubernetes Kubelet. Jun 03 21:37:32.077951 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.077929 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 21:37:32.081878 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.081859 2554 server.go:310] "Adding debug handlers to kubelet server" Jun 03 21:37:32.082568 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.082547 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 21:37:32.085813 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.084675 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-1.ec2.internal.18b5afeb1f7fabdf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-1.ec2.internal,UID:ip-10-0-141-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-1.ec2.internal,},FirstTimestamp:2026-06-03 21:37:32.075535327 +0000 UTC m=+0.411628585,LastTimestamp:2026-06-03 21:37:32.075535327 +0000 UTC m=+0.411628585,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-1.ec2.internal,}" Jun 03 21:37:32.087742 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.087725 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 21:37:32.087742 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.087733 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 21:37:32.087935 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.087918 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:32.088520 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.088494 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 21:37:32.088578 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.088526 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 21:37:32.088659 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.088601 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 21:37:32.088723 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.088681 2554 factory.go:55] Registering systemd factory Jun 03 21:37:32.088723 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.088698 2554 factory.go:223] Registration of the systemd container factory successfully Jun 03 21:37:32.088802 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.088685 2554 reconstruct.go:97] "Volume reconstruction finished" Jun 03 21:37:32.088802 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.088763 2554 reconciler.go:29] "Reconciler: start to sync state" Jun 03 21:37:32.089011 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.088995 2554 factory.go:153] Registering CRI-O factory Jun 03 21:37:32.089188 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.089015 2554 factory.go:223] Registration of the crio container factory successfully Jun 03 21:37:32.089298 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.089284 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 21:37:32.089357 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.089310 2554 factory.go:103] Registering Raw factory Jun 03 21:37:32.089357 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.089325 2554 manager.go:1196] Started watching for new ooms in manager Jun 03 21:37:32.089619 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.089609 2554 manager.go:349] Starting recovery of all containers Jun 03 21:37:32.093107 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.093078 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 21:37:32.093203 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.093146 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 21:37:32.099626 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.099610 2554 manager.go:354] Recovery completed Jun 03 21:37:32.099724 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.099704 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rpvxh" Jun 03 21:37:32.103998 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.103949 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:37:32.105478 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.105462 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rpvxh" Jun 03 21:37:32.105604 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.105586 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:37:32.105660 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.105620 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:37:32.105660 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.105630 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:37:32.106122 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.106107 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 21:37:32.106122 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.106120 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 21:37:32.106247 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.106133 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 03 21:37:32.106247 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.106120 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:37:32.106958 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.106942 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:37:32.107010 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.106969 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:37:32.107010 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.106979 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:37:32.107314 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.107260 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-1.ec2.internal.18b5afeb214a7eaf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-1.ec2.internal,UID:ip-10-0-141-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-1.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-1.ec2.internal,},FirstTimestamp:2026-06-03 21:37:32.105604783 +0000 UTC m=+0.441698048,LastTimestamp:2026-06-03 21:37:32.105604783 +0000 UTC m=+0.441698048,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-1.ec2.internal,}" Jun 03 21:37:32.108846 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.108823 2554 policy_none.go:49] "None policy: Start" Jun 03 21:37:32.108963 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.108856 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 21:37:32.108963 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.108866 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 21:37:32.110662 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.110651 2554 policy_none.go:47] "Start" Jun 03 21:37:32.149470 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.149450 2554 manager.go:337] "Starting Device Plugin manager" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.149479 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.149489 2554 server.go:87] "Starting device plugin registration server" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.149679 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.149688 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.149805 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.149932 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.149942 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.151117 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.151154 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.159526 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.160639 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.160671 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.160689 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.160722 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 21:37:32.172543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.162871 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:37:32.250009 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.249954 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:37:32.251223 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.251209 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:37:32.251284 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.251234 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:37:32.251284 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.251245 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:37:32.251284 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.251267 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.260765 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.260747 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.260765 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.260766 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-1.ec2.internal\": node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:32.260909 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.260796 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"] Jun 03 21:37:32.260909 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.260861 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:37:32.262672 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.262650 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:37:32.262754 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.262679 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:37:32.262754 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.262693 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:37:32.265151 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.265138 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:37:32.265257 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.265245 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.265295 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.265269 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:37:32.265812 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.265790 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:37:32.265901 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.265820 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:37:32.265901 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.265790 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:37:32.265901 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.265845 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:37:32.265901 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.265866 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:37:32.265901 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.265882 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:37:32.268050 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.268033 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.268125 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.268063 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 21:37:32.268929 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.268912 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory" Jun 03 21:37:32.269006 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.268939 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 21:37:32.269006 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.268950 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID" Jun 03 21:37:32.281927 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.281906 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:32.288325 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.288312 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-1.ec2.internal\" not found" node="ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.292464 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.292447 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-1.ec2.internal\" not found" node="ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.382873 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.382848 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:32.389125 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.389096 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/601cc931a3ceb7ad62ad67db9f874af0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-1.ec2.internal\" (UID: \"601cc931a3ceb7ad62ad67db9f874af0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.389221 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.389128 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b5398997199df2ee2c61e85e70545f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b5398997199df2ee2c61e85e70545f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.389221 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.389144 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b5398997199df2ee2c61e85e70545f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b5398997199df2ee2c61e85e70545f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.483270 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.483249 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:32.489512 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.489496 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b5398997199df2ee2c61e85e70545f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b5398997199df2ee2c61e85e70545f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.489558 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.489520 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b5398997199df2ee2c61e85e70545f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b5398997199df2ee2c61e85e70545f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.489558 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.489537 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/601cc931a3ceb7ad62ad67db9f874af0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-1.ec2.internal\" (UID: \"601cc931a3ceb7ad62ad67db9f874af0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.489630 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.489579 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/601cc931a3ceb7ad62ad67db9f874af0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-1.ec2.internal\" (UID: \"601cc931a3ceb7ad62ad67db9f874af0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.489630 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.489592 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b5398997199df2ee2c61e85e70545f7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b5398997199df2ee2c61e85e70545f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.489630 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.489602 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b5398997199df2ee2c61e85e70545f7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"4b5398997199df2ee2c61e85e70545f7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.583997 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.583928 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:32.592378 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.592361 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.598877 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.598826 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" Jun 03 21:37:32.684342 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.684315 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:32.784850 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.784802 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:32.885462 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.885389 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:32.985979 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:32.985944 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:32.996467 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.996443 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 21:37:32.996625 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:32.996605 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 21:37:33.086972 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:33.086945 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:33.108827 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:33.108789 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 21:32:32 +0000 UTC" deadline="2028-01-31 05:17:17.28402203 +0000 UTC" Jun 03 21:37:33.108827 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:33.108820 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14551h39m44.175206348s" Jun 03 21:37:33.150739 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:33.150667 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:37:33.174298 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:33.174270 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601cc931a3ceb7ad62ad67db9f874af0.slice/crio-dbe152372165cc515082c067196b9d1544e15ed6ea184976a0e5a5956862eed0 WatchSource:0}: Error finding container dbe152372165cc515082c067196b9d1544e15ed6ea184976a0e5a5956862eed0: Status 404 returned error can't find the container with id dbe152372165cc515082c067196b9d1544e15ed6ea184976a0e5a5956862eed0 Jun 03 21:37:33.174818 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:33.174800 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5398997199df2ee2c61e85e70545f7.slice/crio-5717e4cf16c484bf1be3c465fe92c8a0898c4724fd9e776fdb2cbecd0acd4c73 WatchSource:0}: Error finding container 5717e4cf16c484bf1be3c465fe92c8a0898c4724fd9e776fdb2cbecd0acd4c73: Status 404 returned error can't find the container with id 5717e4cf16c484bf1be3c465fe92c8a0898c4724fd9e776fdb2cbecd0acd4c73 Jun 03 21:37:33.179723 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:33.179706 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:37:33.187752 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:33.187736 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:33.287892 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:33.287855 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found" Jun 03 21:37:33.341641 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:33.341620 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:37:33.388730 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:33.388695 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" Jun 03 21:37:33.401655 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:33.401595 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 21:37:33.403863 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:33.403848 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" Jun 03 21:37:33.411738 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:33.411724 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 21:37:33.637617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:33.637586 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:37:34.066209 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.066178 2554 apiserver.go:52] "Watching apiserver" Jun 03 21:37:34.074543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.074512 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 21:37:34.074948 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.074922 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-z576l","kube-system/global-pull-secret-syncer-mzrjj","kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4","openshift-multus/multus-zg9r8","openshift-network-diagnostics/network-check-target-52vl2","openshift-network-operator/iptables-alerter-85p29","kube-system/konnectivity-agent-gzhx5","openshift-cluster-node-tuning-operator/tuned-vwh67","openshift-dns/node-resolver-pdbgn","openshift-image-registry/node-ca-59744","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal","openshift-multus/multus-additional-cni-plugins-cmnf2","openshift-multus/network-metrics-daemon-v8b9n"] Jun 03 21:37:34.076518 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.076490 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 21:37:34.077649 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.077621 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-85p29" Jun 03 21:37:34.080175 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.080075 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wdhcx\"" Jun 03 21:37:34.080706 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.080656 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:37:34.080816 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.080790 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 21:37:34.080934 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.080866 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 21:37:34.082130 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.082110 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.084242 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.084222 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:34.084338 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.084298 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:34.084338 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.084333 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 21:37:34.084754 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.084735 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 21:37:34.085015 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.085000 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 21:37:34.085090 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.085038 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9hh5z\"" Jun 03 21:37:34.085219 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.085205 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 21:37:34.085286 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.085270 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 21:37:34.086390 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.086362 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.088477 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.088264 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 21:37:34.089013 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.088990 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 21:37:34.089089 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.089032 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 21:37:34.089251 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.089233 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6xjn5\"" Jun 03 21:37:34.089480 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.089459 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 21:37:34.089759 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.089744 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.091983 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.091964 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 21:37:34.092398 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.092208 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2kfx7\"" Jun 03 21:37:34.092398 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.092250 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:34.092398 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.092306 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:34.094630 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.094611 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.096979 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-os-release\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097011 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-run-netns\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097024 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097037 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-conf-dir\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097062 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-run-multus-certs\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097089 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-os-release\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097116 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f52dda5-0477-4720-ab55-06360a6c69ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097065 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-967fn\"" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-device-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097164 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-sys-fs\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097185 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0452a347-97c3-4fe2-a9ec-569a6d21417c-cni-binary-copy\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097207 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-run-k8s-cni-cncf-io\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097231 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6f93c4a-1d32-4e31-9341-dfbe0361a1a2-iptables-alerter-script\") pod \"iptables-alerter-85p29\" (UID: \"d6f93c4a-1d32-4e31-9341-dfbe0361a1a2\") " pod="openshift-network-operator/iptables-alerter-85p29" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097254 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm6jk\" (UniqueName: \"kubernetes.io/projected/7f52dda5-0477-4720-ab55-06360a6c69ab-kube-api-access-pm6jk\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.097303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097300 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097352 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097394 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-hostroot\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097446 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbrpg\" (UniqueName: \"kubernetes.io/projected/0452a347-97c3-4fe2-a9ec-569a6d21417c-kube-api-access-rbrpg\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097472 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-system-cni-dir\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097497 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097521 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-registration-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097545 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-etc-selinux\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097571 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6f93c4a-1d32-4e31-9341-dfbe0361a1a2-host-slash\") pod \"iptables-alerter-85p29\" (UID: \"d6f93c4a-1d32-4e31-9341-dfbe0361a1a2\") " pod="openshift-network-operator/iptables-alerter-85p29" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097548 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097593 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-socket-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097646 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-var-lib-cni-bin\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097676 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-var-lib-cni-multus\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097704 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v8lr\" (UniqueName: \"kubernetes.io/projected/d6f93c4a-1d32-4e31-9341-dfbe0361a1a2-kube-api-access-8v8lr\") pod \"iptables-alerter-85p29\" (UID: \"d6f93c4a-1d32-4e31-9341-dfbe0361a1a2\") " pod="openshift-network-operator/iptables-alerter-85p29" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097733 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-cnibin\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9rb2\" (UniqueName: \"kubernetes.io/projected/cc2c17c4-779e-414c-a3d5-bf101678097f-kube-api-access-n9rb2\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.098068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-socket-dir-parent\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.098787 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097819 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-daemon-config\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.098787 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097869 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9fk6\" (UniqueName: \"kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6\") pod \"network-check-target-52vl2\" (UID: \"25404632-e1bc-40f4-a8f0-cad642b1c212\") " pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:34.098787 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097893 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f52dda5-0477-4720-ab55-06360a6c69ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.098787 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097927 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn9qg\" (UniqueName: \"kubernetes.io/projected/733dc558-703e-4ee8-b7e3-5c3d39841574-kube-api-access-cn9qg\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:34.098787 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097951 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-system-cni-dir\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.098787 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-cni-dir\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.098787 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.097994 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-etc-kubernetes\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.098787 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.098044 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f52dda5-0477-4720-ab55-06360a6c69ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.098787 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.098068 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-cnibin\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.098787 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.098089 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-var-lib-kubelet\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.099216 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.099198 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.101726 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.101609 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:34.101726 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.101713 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:34.101892 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.101828 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 21:37:34.101952 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.101894 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 21:37:34.102103 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.102082 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 21:37:34.103712 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.103224 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 21:37:34.103712 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.103239 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 21:37:34.103712 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.103259 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 21:37:34.103712 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.103473 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 21:37:34.104045 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.103760 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vl9j7\"" Jun 03 21:37:34.104155 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.104138 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pdbgn" Jun 03 21:37:34.106425 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.106407 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-59744" Jun 03 21:37:34.107004 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.106955 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sftbc\"" Jun 03 21:37:34.107172 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.107154 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 21:37:34.107491 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.107375 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 21:37:34.109029 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.108998 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 21:37:34.109119 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.109072 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:34.109346 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.109311 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 21:37:34.109661 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.109599 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8qj22\"" Jun 03 21:37:34.109661 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.109628 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 21:37:34.111565 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.111544 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 21:37:34.111861 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.111827 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vdzx2\"" Jun 03 21:37:34.112013 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.111989 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 21:37:34.121395 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.121372 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2xp2n" Jun 03 21:37:34.128466 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.128442 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2xp2n" Jun 03 21:37:34.165273 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.165228 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" event={"ID":"4b5398997199df2ee2c61e85e70545f7","Type":"ContainerStarted","Data":"5717e4cf16c484bf1be3c465fe92c8a0898c4724fd9e776fdb2cbecd0acd4c73"} Jun 03 21:37:34.166382 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.166350 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" event={"ID":"601cc931a3ceb7ad62ad67db9f874af0","Type":"ContainerStarted","Data":"dbe152372165cc515082c067196b9d1544e15ed6ea184976a0e5a5956862eed0"} Jun 03 21:37:34.189770 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.189748 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 21:37:34.199066 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-hostroot\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.199174 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66677f28-c099-4884-a43f-30a1d25d2a1f-hosts-file\") pod \"node-resolver-pdbgn\" (UID: \"66677f28-c099-4884-a43f-30a1d25d2a1f\") " pod="openshift-dns/node-resolver-pdbgn" Jun 03 21:37:34.199174 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199103 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-kubelet\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.199174 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-systemd-units\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.199174 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199157 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-hostroot\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.199381 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199191 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-system-cni-dir\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.199381 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199217 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-etc-selinux\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.199381 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199244 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-node-log\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.199381 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199251 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-system-cni-dir\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.199381 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199268 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.199381 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199293 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgsgf\" (UniqueName: \"kubernetes.io/projected/2c252b44-3310-435c-8e02-3211754c50bb-kube-api-access-zgsgf\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.199381 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199294 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-etc-selinux\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.199381 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199318 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6f93c4a-1d32-4e31-9341-dfbe0361a1a2-host-slash\") pod \"iptables-alerter-85p29\" (UID: \"d6f93c4a-1d32-4e31-9341-dfbe0361a1a2\") " pod="openshift-network-operator/iptables-alerter-85p29" Jun 03 21:37:34.199381 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199348 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-socket-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.199381 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199362 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6f93c4a-1d32-4e31-9341-dfbe0361a1a2-host-slash\") pod \"iptables-alerter-85p29\" (UID: \"d6f93c4a-1d32-4e31-9341-dfbe0361a1a2\") " pod="openshift-network-operator/iptables-alerter-85p29" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-var-lib-cni-bin\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199408 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-var-lib-openvswitch\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199427 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-cnibin\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199452 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-socket-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199468 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-socket-dir-parent\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199470 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-var-lib-cni-bin\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199488 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-daemon-config\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199507 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-cnibin\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199510 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-sysconfig\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199546 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-kubernetes\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199566 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-socket-dir-parent\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199572 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-run-systemd\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199603 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f52dda5-0477-4720-ab55-06360a6c69ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn9qg\" (UniqueName: \"kubernetes.io/projected/733dc558-703e-4ee8-b7e3-5c3d39841574-kube-api-access-cn9qg\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199651 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-etc-kubernetes\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199673 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-var-lib-kubelet\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.199798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199724 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-etc-kubernetes\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199863 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbr7q\" (UniqueName: \"kubernetes.io/projected/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-kube-api-access-cbr7q\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199897 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199922 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c252b44-3310-435c-8e02-3211754c50bb-ovnkube-config\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199945 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c252b44-3310-435c-8e02-3211754c50bb-ovn-node-metrics-cert\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199971 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f52dda5-0477-4720-ab55-06360a6c69ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.199996 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-var-lib-kubelet\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-sysctl-d\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200077 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c252b44-3310-435c-8e02-3211754c50bb-env-overrides\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200080 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-daemon-config\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200180 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200185 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-var-lib-kubelet\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200193 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f52dda5-0477-4720-ab55-06360a6c69ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200204 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzzhn\" (UniqueName: \"kubernetes.io/projected/b9009d27-4ec0-4368-9eaa-568a95fd3b9d-kube-api-access-hzzhn\") pod \"node-ca-59744\" (UID: \"b9009d27-4ec0-4368-9eaa-568a95fd3b9d\") " pod="openshift-image-registry/node-ca-59744" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200232 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-systemd\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-os-release\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.200708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200286 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f52dda5-0477-4720-ab55-06360a6c69ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200319 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-os-release\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200326 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-sys-fs\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200348 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0452a347-97c3-4fe2-a9ec-569a6d21417c-cni-binary-copy\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200417 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-sys-fs\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200448 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-run-k8s-cni-cncf-io\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200473 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9009d27-4ec0-4368-9eaa-568a95fd3b9d-host\") pod \"node-ca-59744\" (UID: \"b9009d27-4ec0-4368-9eaa-568a95fd3b9d\") " pod="openshift-image-registry/node-ca-59744" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200495 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-lib-modules\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200518 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c182030-5598-4bed-910d-78da9cd3dc27-kubelet-config\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200544 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200560 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f52dda5-0477-4720-ab55-06360a6c69ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbrpg\" (UniqueName: \"kubernetes.io/projected/0452a347-97c3-4fe2-a9ec-569a6d21417c-kube-api-access-rbrpg\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200633 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpgwq\" (UniqueName: \"kubernetes.io/projected/66677f28-c099-4884-a43f-30a1d25d2a1f-kube-api-access-vpgwq\") pod \"node-resolver-pdbgn\" (UID: \"66677f28-c099-4884-a43f-30a1d25d2a1f\") " pod="openshift-dns/node-resolver-pdbgn" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200667 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f52dda5-0477-4720-ab55-06360a6c69ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200686 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-run\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200710 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-run-k8s-cni-cncf-io\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.201419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200711 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-tuned\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200767 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-run-netns\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200787 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-registration-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200810 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200826 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-etc-openvswitch\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200846 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0452a347-97c3-4fe2-a9ec-569a6d21417c-cni-binary-copy\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-var-lib-cni-multus\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200892 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9009d27-4ec0-4368-9eaa-568a95fd3b9d-serviceca\") pod \"node-ca-59744\" (UID: \"b9009d27-4ec0-4368-9eaa-568a95fd3b9d\") " pod="openshift-image-registry/node-ca-59744" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.200896 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200893 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-registration-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200914 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-modprobe-d\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200935 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-slash\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.200957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-log-socket\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v8lr\" (UniqueName: \"kubernetes.io/projected/d6f93c4a-1d32-4e31-9341-dfbe0361a1a2-kube-api-access-8v8lr\") pod \"iptables-alerter-85p29\" (UID: \"d6f93c4a-1d32-4e31-9341-dfbe0361a1a2\") " pod="openshift-network-operator/iptables-alerter-85p29" Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.201046 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs podName:733dc558-703e-4ee8-b7e3-5c3d39841574 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:34.701019761 +0000 UTC m=+3.037113007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs") pod "network-metrics-daemon-v8b9n" (UID: "733dc558-703e-4ee8-b7e3-5c3d39841574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:34.202071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201028 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-var-lib-cni-multus\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201066 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f52dda5-0477-4720-ab55-06360a6c69ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9rb2\" (UniqueName: \"kubernetes.io/projected/cc2c17c4-779e-414c-a3d5-bf101678097f-kube-api-access-n9rb2\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201200 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fk6\" (UniqueName: \"kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6\") pod \"network-check-target-52vl2\" (UID: \"25404632-e1bc-40f4-a8f0-cad642b1c212\") " pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201242 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66677f28-c099-4884-a43f-30a1d25d2a1f-tmp-dir\") pod \"node-resolver-pdbgn\" (UID: \"66677f28-c099-4884-a43f-30a1d25d2a1f\") " pod="openshift-dns/node-resolver-pdbgn" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201274 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e7626cf-83d8-42c0-b139-475266086ac1-konnectivity-ca\") pod \"konnectivity-agent-gzhx5\" (UID: \"0e7626cf-83d8-42c0-b139-475266086ac1\") " pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201303 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-run-openvswitch\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201326 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-run-ovn\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201353 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-system-cni-dir\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201375 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-cni-dir\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201444 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-system-cni-dir\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201448 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-cni-dir\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201498 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-cni-bin\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201519 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-cnibin\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201568 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-sysctl-conf\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201599 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-host\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201614 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-cnibin\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.202617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201622 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-os-release\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-run-netns\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-conf-dir\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201678 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-os-release\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-run-multus-certs\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201737 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-multus-conf-dir\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201744 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-run-netns\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201725 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0452a347-97c3-4fe2-a9ec-569a6d21417c-host-run-multus-certs\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-sys\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201818 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-device-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201858 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e7626cf-83d8-42c0-b139-475266086ac1-agent-certs\") pod \"konnectivity-agent-gzhx5\" (UID: \"0e7626cf-83d8-42c0-b139-475266086ac1\") " pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201880 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-tmp\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201894 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c17c4-779e-414c-a3d5-bf101678097f-device-dir\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201912 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-cni-netd\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201959 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c252b44-3310-435c-8e02-3211754c50bb-ovnkube-script-lib\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.201992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c182030-5598-4bed-910d-78da9cd3dc27-dbus\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.202021 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6f93c4a-1d32-4e31-9341-dfbe0361a1a2-iptables-alerter-script\") pod \"iptables-alerter-85p29\" (UID: \"d6f93c4a-1d32-4e31-9341-dfbe0361a1a2\") " pod="openshift-network-operator/iptables-alerter-85p29" Jun 03 21:37:34.203201 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.202046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm6jk\" (UniqueName: \"kubernetes.io/projected/7f52dda5-0477-4720-ab55-06360a6c69ab-kube-api-access-pm6jk\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.203731 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.202459 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6f93c4a-1d32-4e31-9341-dfbe0361a1a2-iptables-alerter-script\") pod \"iptables-alerter-85p29\" (UID: \"d6f93c4a-1d32-4e31-9341-dfbe0361a1a2\") " pod="openshift-network-operator/iptables-alerter-85p29" Jun 03 21:37:34.206057 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.206032 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 21:37:34.207157 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.207134 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:37:34.207301 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.207162 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:37:34.207301 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.207175 2554 projected.go:196] Error preparing data for projected volume kube-api-access-p9fk6 for pod openshift-network-diagnostics/network-check-target-52vl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:34.207301 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.207229 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6 podName:25404632-e1bc-40f4-a8f0-cad642b1c212 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:34.707211636 +0000 UTC m=+3.043304900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p9fk6" (UniqueName: "kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6") pod "network-check-target-52vl2" (UID: "25404632-e1bc-40f4-a8f0-cad642b1c212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:34.209754 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.209680 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn9qg\" (UniqueName: \"kubernetes.io/projected/733dc558-703e-4ee8-b7e3-5c3d39841574-kube-api-access-cn9qg\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:34.209754 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.209705 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbrpg\" (UniqueName: \"kubernetes.io/projected/0452a347-97c3-4fe2-a9ec-569a6d21417c-kube-api-access-rbrpg\") pod \"multus-zg9r8\" (UID: \"0452a347-97c3-4fe2-a9ec-569a6d21417c\") " pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.209930 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.209801 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v8lr\" (UniqueName: \"kubernetes.io/projected/d6f93c4a-1d32-4e31-9341-dfbe0361a1a2-kube-api-access-8v8lr\") pod \"iptables-alerter-85p29\" (UID: \"d6f93c4a-1d32-4e31-9341-dfbe0361a1a2\") " pod="openshift-network-operator/iptables-alerter-85p29" Jun 03 21:37:34.209930 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.209860 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9rb2\" (UniqueName: \"kubernetes.io/projected/cc2c17c4-779e-414c-a3d5-bf101678097f-kube-api-access-n9rb2\") pod \"aws-ebs-csi-driver-node-7njs4\" (UID: \"cc2c17c4-779e-414c-a3d5-bf101678097f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.210159 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.210139 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm6jk\" (UniqueName: \"kubernetes.io/projected/7f52dda5-0477-4720-ab55-06360a6c69ab-kube-api-access-pm6jk\") pod \"multus-additional-cni-plugins-cmnf2\" (UID: \"7f52dda5-0477-4720-ab55-06360a6c69ab\") " pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.303035 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.302999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-sys\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.303191 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303043 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e7626cf-83d8-42c0-b139-475266086ac1-agent-certs\") pod \"konnectivity-agent-gzhx5\" (UID: \"0e7626cf-83d8-42c0-b139-475266086ac1\") " pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:34.303191 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303117 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-sys\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.303191 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303166 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-tmp\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.303345 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303192 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-cni-netd\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303345 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c252b44-3310-435c-8e02-3211754c50bb-ovnkube-script-lib\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303345 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303283 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-cni-netd\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303345 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303296 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c182030-5598-4bed-910d-78da9cd3dc27-dbus\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:34.303345 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303334 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66677f28-c099-4884-a43f-30a1d25d2a1f-hosts-file\") pod \"node-resolver-pdbgn\" (UID: \"66677f28-c099-4884-a43f-30a1d25d2a1f\") " pod="openshift-dns/node-resolver-pdbgn" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-kubelet\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-systemd-units\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303409 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-node-log\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303449 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-systemd-units\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303455 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgsgf\" (UniqueName: \"kubernetes.io/projected/2c252b44-3310-435c-8e02-3211754c50bb-kube-api-access-zgsgf\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303491 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-var-lib-openvswitch\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303494 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/66677f28-c099-4884-a43f-30a1d25d2a1f-hosts-file\") pod \"node-resolver-pdbgn\" (UID: \"66677f28-c099-4884-a43f-30a1d25d2a1f\") " pod="openshift-dns/node-resolver-pdbgn" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303407 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c182030-5598-4bed-910d-78da9cd3dc27-dbus\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303524 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-sysconfig\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303550 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-kubernetes\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303566 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-node-log\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303575 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-run-systemd\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.303585 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303576 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-run-ovn-kubernetes\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-var-lib-kubelet\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303607 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-var-lib-openvswitch\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303611 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-sysconfig\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303640 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-run-systemd\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303630 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-kubernetes\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbr7q\" (UniqueName: \"kubernetes.io/projected/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-kube-api-access-cbr7q\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303685 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303694 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-kubelet\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303694 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-var-lib-kubelet\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303718 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c252b44-3310-435c-8e02-3211754c50bb-ovnkube-config\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303743 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c252b44-3310-435c-8e02-3211754c50bb-ovn-node-metrics-cert\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303768 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-sysctl-d\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303742 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303808 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c252b44-3310-435c-8e02-3211754c50bb-env-overrides\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303806 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c252b44-3310-435c-8e02-3211754c50bb-ovnkube-script-lib\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303846 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:34.304244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303886 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-sysctl-d\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzzhn\" (UniqueName: \"kubernetes.io/projected/b9009d27-4ec0-4368-9eaa-568a95fd3b9d-kube-api-access-hzzhn\") pod \"node-ca-59744\" (UID: \"b9009d27-4ec0-4368-9eaa-568a95fd3b9d\") " pod="openshift-image-registry/node-ca-59744" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303922 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-systemd\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.303929 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303949 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9009d27-4ec0-4368-9eaa-568a95fd3b9d-host\") pod \"node-ca-59744\" (UID: \"b9009d27-4ec0-4368-9eaa-568a95fd3b9d\") " pod="openshift-image-registry/node-ca-59744" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.303971 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-lib-modules\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.303992 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret podName:4c182030-5598-4bed-910d-78da9cd3dc27 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:34.8039742 +0000 UTC m=+3.140067449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret") pod "global-pull-secret-syncer-mzrjj" (UID: "4c182030-5598-4bed-910d-78da9cd3dc27") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304026 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c182030-5598-4bed-910d-78da9cd3dc27-kubelet-config\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304049 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-lib-modules\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304064 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpgwq\" (UniqueName: \"kubernetes.io/projected/66677f28-c099-4884-a43f-30a1d25d2a1f-kube-api-access-vpgwq\") pod \"node-resolver-pdbgn\" (UID: \"66677f28-c099-4884-a43f-30a1d25d2a1f\") " pod="openshift-dns/node-resolver-pdbgn" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304090 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9009d27-4ec0-4368-9eaa-568a95fd3b9d-host\") pod \"node-ca-59744\" (UID: \"b9009d27-4ec0-4368-9eaa-568a95fd3b9d\") " pod="openshift-image-registry/node-ca-59744" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304095 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-systemd\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304096 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-run\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304125 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-tuned\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304141 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-run\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304147 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-run-netns\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304176 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-etc-openvswitch\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304218 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9009d27-4ec0-4368-9eaa-568a95fd3b9d-serviceca\") pod \"node-ca-59744\" (UID: \"b9009d27-4ec0-4368-9eaa-568a95fd3b9d\") " pod="openshift-image-registry/node-ca-59744" Jun 03 21:37:34.305055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304242 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c252b44-3310-435c-8e02-3211754c50bb-env-overrides\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304180 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-run-netns\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304273 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-etc-openvswitch\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304274 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c252b44-3310-435c-8e02-3211754c50bb-ovnkube-config\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304338 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c182030-5598-4bed-910d-78da9cd3dc27-kubelet-config\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304342 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-modprobe-d\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304244 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-modprobe-d\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304383 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-slash\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304405 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-log-socket\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304445 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66677f28-c099-4884-a43f-30a1d25d2a1f-tmp-dir\") pod \"node-resolver-pdbgn\" (UID: \"66677f28-c099-4884-a43f-30a1d25d2a1f\") " pod="openshift-dns/node-resolver-pdbgn" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304465 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-slash\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304470 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e7626cf-83d8-42c0-b139-475266086ac1-konnectivity-ca\") pod \"konnectivity-agent-gzhx5\" (UID: \"0e7626cf-83d8-42c0-b139-475266086ac1\") " pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304494 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-run-openvswitch\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304514 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-log-socket\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304519 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-run-ovn\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304566 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-cni-bin\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304572 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-run-ovn\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304596 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-sysctl-conf\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.305722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304622 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-host\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.306602 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304696 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-host-cni-bin\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.306602 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304754 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c252b44-3310-435c-8e02-3211754c50bb-run-openvswitch\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.306602 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304758 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-sysctl-conf\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.306602 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304754 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66677f28-c099-4884-a43f-30a1d25d2a1f-tmp-dir\") pod \"node-resolver-pdbgn\" (UID: \"66677f28-c099-4884-a43f-30a1d25d2a1f\") " pod="openshift-dns/node-resolver-pdbgn" Jun 03 21:37:34.306602 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.304805 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-host\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.306602 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.305074 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e7626cf-83d8-42c0-b139-475266086ac1-konnectivity-ca\") pod \"konnectivity-agent-gzhx5\" (UID: \"0e7626cf-83d8-42c0-b139-475266086ac1\") " pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:34.306602 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.305334 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9009d27-4ec0-4368-9eaa-568a95fd3b9d-serviceca\") pod \"node-ca-59744\" (UID: \"b9009d27-4ec0-4368-9eaa-568a95fd3b9d\") " pod="openshift-image-registry/node-ca-59744" Jun 03 21:37:34.306602 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.305977 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e7626cf-83d8-42c0-b139-475266086ac1-agent-certs\") pod \"konnectivity-agent-gzhx5\" (UID: \"0e7626cf-83d8-42c0-b139-475266086ac1\") " pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:34.306602 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.306188 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-tmp\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.307052 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.306702 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-etc-tuned\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.307328 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.307311 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c252b44-3310-435c-8e02-3211754c50bb-ovn-node-metrics-cert\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.313068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.313045 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbr7q\" (UniqueName: \"kubernetes.io/projected/1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac-kube-api-access-cbr7q\") pod \"tuned-vwh67\" (UID: \"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac\") " pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.313248 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.313235 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzzhn\" (UniqueName: \"kubernetes.io/projected/b9009d27-4ec0-4368-9eaa-568a95fd3b9d-kube-api-access-hzzhn\") pod \"node-ca-59744\" (UID: \"b9009d27-4ec0-4368-9eaa-568a95fd3b9d\") " pod="openshift-image-registry/node-ca-59744" Jun 03 21:37:34.313619 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.313606 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgsgf\" (UniqueName: \"kubernetes.io/projected/2c252b44-3310-435c-8e02-3211754c50bb-kube-api-access-zgsgf\") pod \"ovnkube-node-z576l\" (UID: \"2c252b44-3310-435c-8e02-3211754c50bb\") " pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.314001 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.313973 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpgwq\" (UniqueName: \"kubernetes.io/projected/66677f28-c099-4884-a43f-30a1d25d2a1f-kube-api-access-vpgwq\") pod \"node-resolver-pdbgn\" (UID: \"66677f28-c099-4884-a43f-30a1d25d2a1f\") " pod="openshift-dns/node-resolver-pdbgn" Jun 03 21:37:34.393122 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.393052 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-85p29" Jun 03 21:37:34.401261 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.401238 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cmnf2" Jun 03 21:37:34.411824 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.411804 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" Jun 03 21:37:34.417451 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.417429 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zg9r8" Jun 03 21:37:34.427013 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.426994 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vwh67" Jun 03 21:37:34.434630 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.434612 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:34.443030 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.443012 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pdbgn" Jun 03 21:37:34.450483 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.450467 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-59744" Jun 03 21:37:34.456101 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.456081 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:34.708015 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.707983 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:34.708166 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.708036 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fk6\" (UniqueName: \"kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6\") pod \"network-check-target-52vl2\" (UID: \"25404632-e1bc-40f4-a8f0-cad642b1c212\") " pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:34.708166 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.708153 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:34.708256 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.708224 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs podName:733dc558-703e-4ee8-b7e3-5c3d39841574 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:35.708204277 +0000 UTC m=+4.044297537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs") pod "network-metrics-daemon-v8b9n" (UID: "733dc558-703e-4ee8-b7e3-5c3d39841574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:34.708256 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.708221 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:37:34.708256 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.708250 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:37:34.708399 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.708261 2554 projected.go:196] Error preparing data for projected volume kube-api-access-p9fk6 for pod openshift-network-diagnostics/network-check-target-52vl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:34.708399 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.708297 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6 podName:25404632-e1bc-40f4-a8f0-cad642b1c212 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:35.708286723 +0000 UTC m=+4.044379985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9fk6" (UniqueName: "kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6") pod "network-check-target-52vl2" (UID: "25404632-e1bc-40f4-a8f0-cad642b1c212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:34.808960 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:34.808927 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:34.809134 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.809068 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:34.809201 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:34.809138 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret podName:4c182030-5598-4bed-910d-78da9cd3dc27 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:35.809117589 +0000 UTC m=+4.145210836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret") pod "global-pull-secret-syncer-mzrjj" (UID: "4c182030-5598-4bed-910d-78da9cd3dc27") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:35.004955 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:35.004914 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7b8dc8_72ce_4eb6_afba_c1a411b6f4ac.slice/crio-495df022caa8d415c40df16801e5c801e5637eb8cf48ea36067e2237bdece304 WatchSource:0}: Error finding container 495df022caa8d415c40df16801e5c801e5637eb8cf48ea36067e2237bdece304: Status 404 returned error can't find the container with id 495df022caa8d415c40df16801e5c801e5637eb8cf48ea36067e2237bdece304 Jun 03 21:37:35.006617 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:35.006596 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2c17c4_779e_414c_a3d5_bf101678097f.slice/crio-884fcd92c82991357afca82306cc95a34d5cceb3a873d4aaa1f1c8a88015ff32 WatchSource:0}: Error finding container 884fcd92c82991357afca82306cc95a34d5cceb3a873d4aaa1f1c8a88015ff32: Status 404 returned error can't find the container with id 884fcd92c82991357afca82306cc95a34d5cceb3a873d4aaa1f1c8a88015ff32 Jun 03 21:37:35.030380 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:35.030348 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0452a347_97c3_4fe2_a9ec_569a6d21417c.slice/crio-a190f789f11b15f4918f2af61801b0510bb37dc53c87efdbeb19d9cfe36abf85 WatchSource:0}: Error finding container a190f789f11b15f4918f2af61801b0510bb37dc53c87efdbeb19d9cfe36abf85: Status 404 returned error can't find the container with id a190f789f11b15f4918f2af61801b0510bb37dc53c87efdbeb19d9cfe36abf85 Jun 03 21:37:35.031777 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:35.031759 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9009d27_4ec0_4368_9eaa_568a95fd3b9d.slice/crio-0c931072d439ecb5ba4ff758d32bfb0a0e5d13d900f8bf9d7e4f3c7aa89ef0a6 WatchSource:0}: Error finding container 0c931072d439ecb5ba4ff758d32bfb0a0e5d13d900f8bf9d7e4f3c7aa89ef0a6: Status 404 returned error can't find the container with id 0c931072d439ecb5ba4ff758d32bfb0a0e5d13d900f8bf9d7e4f3c7aa89ef0a6 Jun 03 21:37:35.032504 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:35.032476 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66677f28_c099_4884_a43f_30a1d25d2a1f.slice/crio-20a05382d0fba570dee2900327cfbcf80107b31d1e12367082995cbd0831dba1 WatchSource:0}: Error finding container 20a05382d0fba570dee2900327cfbcf80107b31d1e12367082995cbd0831dba1: Status 404 returned error can't find the container with id 20a05382d0fba570dee2900327cfbcf80107b31d1e12367082995cbd0831dba1 Jun 03 21:37:35.033311 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:35.033081 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7626cf_83d8_42c0_b139_475266086ac1.slice/crio-8fcabd8c4da4ed1c450e4dce3ffbc79632222cdbe1a5284e303617212f16b007 WatchSource:0}: Error finding container 8fcabd8c4da4ed1c450e4dce3ffbc79632222cdbe1a5284e303617212f16b007: Status 404 returned error can't find the container with id 8fcabd8c4da4ed1c450e4dce3ffbc79632222cdbe1a5284e303617212f16b007 Jun 03 21:37:35.034321 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:35.034283 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f52dda5_0477_4720_ab55_06360a6c69ab.slice/crio-1807ce7434ec4774620e432f4211b0409d4874ba8c42b00878f6bd0c2e549a27 WatchSource:0}: Error finding container 1807ce7434ec4774620e432f4211b0409d4874ba8c42b00878f6bd0c2e549a27: Status 404 returned error can't find the container with id 1807ce7434ec4774620e432f4211b0409d4874ba8c42b00878f6bd0c2e549a27 Jun 03 21:37:35.034825 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:35.034652 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c252b44_3310_435c_8e02_3211754c50bb.slice/crio-28ae7f60224c0b7cf09e58ebb04ebe90651552efdc6553a3aca78befcd38b558 WatchSource:0}: Error finding container 28ae7f60224c0b7cf09e58ebb04ebe90651552efdc6553a3aca78befcd38b558: Status 404 returned error can't find the container with id 28ae7f60224c0b7cf09e58ebb04ebe90651552efdc6553a3aca78befcd38b558 Jun 03 21:37:35.037210 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:37:35.036885 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f93c4a_1d32_4e31_9341_dfbe0361a1a2.slice/crio-174805baee2421ef154fcefb9b1ca13188f6bc968f7a61165e2b7ba5b4692e6a WatchSource:0}: Error finding container 174805baee2421ef154fcefb9b1ca13188f6bc968f7a61165e2b7ba5b4692e6a: Status 404 returned error can't find the container with id 174805baee2421ef154fcefb9b1ca13188f6bc968f7a61165e2b7ba5b4692e6a Jun 03 21:37:35.132239 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.132091 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 21:32:34 +0000 UTC" deadline="2027-11-08 14:15:55.608916229 +0000 UTC" Jun 03 21:37:35.132526 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.132265 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12544h38m20.47667611s" Jun 03 21:37:35.161499 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.161477 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:35.161589 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:35.161565 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:35.170471 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.170445 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" event={"ID":"601cc931a3ceb7ad62ad67db9f874af0","Type":"ContainerStarted","Data":"08d99f08a34493a2ca4ca52f1fa233cbb4834e9f57e62a40611e69289a7f6f18"} Jun 03 21:37:35.171595 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.171571 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gzhx5" event={"ID":"0e7626cf-83d8-42c0-b139-475266086ac1","Type":"ContainerStarted","Data":"8fcabd8c4da4ed1c450e4dce3ffbc79632222cdbe1a5284e303617212f16b007"} Jun 03 21:37:35.172730 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.172708 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pdbgn" event={"ID":"66677f28-c099-4884-a43f-30a1d25d2a1f","Type":"ContainerStarted","Data":"20a05382d0fba570dee2900327cfbcf80107b31d1e12367082995cbd0831dba1"} Jun 03 21:37:35.173857 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.173820 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-59744" event={"ID":"b9009d27-4ec0-4368-9eaa-568a95fd3b9d","Type":"ContainerStarted","Data":"0c931072d439ecb5ba4ff758d32bfb0a0e5d13d900f8bf9d7e4f3c7aa89ef0a6"} Jun 03 21:37:35.175016 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.174994 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zg9r8" event={"ID":"0452a347-97c3-4fe2-a9ec-569a6d21417c","Type":"ContainerStarted","Data":"a190f789f11b15f4918f2af61801b0510bb37dc53c87efdbeb19d9cfe36abf85"} Jun 03 21:37:35.176159 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.176138 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" event={"ID":"cc2c17c4-779e-414c-a3d5-bf101678097f","Type":"ContainerStarted","Data":"884fcd92c82991357afca82306cc95a34d5cceb3a873d4aaa1f1c8a88015ff32"} Jun 03 21:37:35.177233 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.177210 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-85p29" event={"ID":"d6f93c4a-1d32-4e31-9341-dfbe0361a1a2","Type":"ContainerStarted","Data":"174805baee2421ef154fcefb9b1ca13188f6bc968f7a61165e2b7ba5b4692e6a"} Jun 03 21:37:35.178310 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.178292 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" event={"ID":"2c252b44-3310-435c-8e02-3211754c50bb","Type":"ContainerStarted","Data":"28ae7f60224c0b7cf09e58ebb04ebe90651552efdc6553a3aca78befcd38b558"} Jun 03 21:37:35.179380 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.179355 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmnf2" event={"ID":"7f52dda5-0477-4720-ab55-06360a6c69ab","Type":"ContainerStarted","Data":"1807ce7434ec4774620e432f4211b0409d4874ba8c42b00878f6bd0c2e549a27"} Jun 03 21:37:35.180325 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.180307 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vwh67" event={"ID":"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac","Type":"ContainerStarted","Data":"495df022caa8d415c40df16801e5c801e5637eb8cf48ea36067e2237bdece304"} Jun 03 21:37:35.184749 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.184707 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" podStartSLOduration=2.184691982 podStartE2EDuration="2.184691982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:35.184147717 +0000 UTC m=+3.520240984" watchObservedRunningTime="2026-06-03 21:37:35.184691982 +0000 UTC m=+3.520785251" Jun 03 21:37:35.716338 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.715393 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:35.716338 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.715479 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fk6\" (UniqueName: \"kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6\") pod \"network-check-target-52vl2\" (UID: \"25404632-e1bc-40f4-a8f0-cad642b1c212\") " pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:35.716338 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:35.715669 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:37:35.716338 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:35.715693 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:37:35.716338 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:35.715706 2554 projected.go:196] Error preparing data for projected volume kube-api-access-p9fk6 for pod openshift-network-diagnostics/network-check-target-52vl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:35.716338 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:35.715797 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6 podName:25404632-e1bc-40f4-a8f0-cad642b1c212 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:37.715777833 +0000 UTC m=+6.051871096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9fk6" (UniqueName: "kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6") pod "network-check-target-52vl2" (UID: "25404632-e1bc-40f4-a8f0-cad642b1c212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:35.716338 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:35.716249 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:35.716338 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:35.716298 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs podName:733dc558-703e-4ee8-b7e3-5c3d39841574 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:37.716281765 +0000 UTC m=+6.052375025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs") pod "network-metrics-daemon-v8b9n" (UID: "733dc558-703e-4ee8-b7e3-5c3d39841574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:35.816437 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:35.816370 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:35.816608 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:35.816564 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:35.816673 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:35.816630 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret podName:4c182030-5598-4bed-910d-78da9cd3dc27 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:37.816611621 +0000 UTC m=+6.152704887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret") pod "global-pull-secret-syncer-mzrjj" (UID: "4c182030-5598-4bed-910d-78da9cd3dc27") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:36.132805 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:36.132683 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 21:32:34 +0000 UTC" deadline="2027-12-15 23:34:25.390242551 +0000 UTC" Jun 03 21:37:36.132805 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:36.132742 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13441h56m49.257504569s" Jun 03 21:37:36.163531 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:36.163505 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:36.163661 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:36.163628 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:36.164023 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:36.164004 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:36.164130 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:36.164111 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:36.206911 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:36.206699 2554 generic.go:356] "Generic (PLEG): container finished" podID="4b5398997199df2ee2c61e85e70545f7" containerID="f3124579c469d913d699b3ba32aa6a6487dbc70edb4bd8d89735924fef47bc95" exitCode=0 Jun 03 21:37:36.206911 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:36.206752 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" event={"ID":"4b5398997199df2ee2c61e85e70545f7","Type":"ContainerDied","Data":"f3124579c469d913d699b3ba32aa6a6487dbc70edb4bd8d89735924fef47bc95"} Jun 03 21:37:37.161552 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:37.161080 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:37.161552 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:37.161199 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:37.237860 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:37.237567 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" event={"ID":"4b5398997199df2ee2c61e85e70545f7","Type":"ContainerStarted","Data":"918dae99bc156f0b8e9de400626959bfff5100b116b25409b64cacb1d94ec3eb"} Jun 03 21:37:37.733801 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:37.733761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:37.734000 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:37.733815 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fk6\" (UniqueName: \"kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6\") pod \"network-check-target-52vl2\" (UID: \"25404632-e1bc-40f4-a8f0-cad642b1c212\") " pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:37.734000 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:37.733995 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:37:37.734114 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:37.734014 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:37:37.734114 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:37.734027 2554 projected.go:196] Error preparing data for projected volume kube-api-access-p9fk6 for pod openshift-network-diagnostics/network-check-target-52vl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:37.734114 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:37.734086 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6 podName:25404632-e1bc-40f4-a8f0-cad642b1c212 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:41.734066868 +0000 UTC m=+10.070160114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9fk6" (UniqueName: "kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6") pod "network-check-target-52vl2" (UID: "25404632-e1bc-40f4-a8f0-cad642b1c212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:37.734278 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:37.734156 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:37.734278 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:37.734192 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs podName:733dc558-703e-4ee8-b7e3-5c3d39841574 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:41.734180494 +0000 UTC m=+10.070273742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs") pod "network-metrics-daemon-v8b9n" (UID: "733dc558-703e-4ee8-b7e3-5c3d39841574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:37.835068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:37.834983 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:37.835239 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:37.835190 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:37.835315 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:37.835253 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret podName:4c182030-5598-4bed-910d-78da9cd3dc27 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:41.835235055 +0000 UTC m=+10.171328307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret") pod "global-pull-secret-syncer-mzrjj" (UID: "4c182030-5598-4bed-910d-78da9cd3dc27") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:38.164009 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:38.161926 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:38.164009 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:38.162059 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:38.164009 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:38.162176 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:38.164009 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:38.162268 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:39.161603 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:39.161538 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:39.161856 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:39.161671 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:40.161616 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:40.161141 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:40.161616 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:40.161152 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:40.161616 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:40.161280 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:40.161616 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:40.161331 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:41.161971 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:41.161929 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:41.162434 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:41.162078 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:41.768501 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:41.768466 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fk6\" (UniqueName: \"kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6\") pod \"network-check-target-52vl2\" (UID: \"25404632-e1bc-40f4-a8f0-cad642b1c212\") " pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:41.768682 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:41.768564 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:41.768761 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:41.768693 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:41.768761 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:41.768758 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs podName:733dc558-703e-4ee8-b7e3-5c3d39841574 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:49.768737343 +0000 UTC m=+18.104830594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs") pod "network-metrics-daemon-v8b9n" (UID: "733dc558-703e-4ee8-b7e3-5c3d39841574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:41.768952 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:41.768697 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:37:41.768952 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:41.768819 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:37:41.768952 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:41.768849 2554 projected.go:196] Error preparing data for projected volume kube-api-access-p9fk6 for pod openshift-network-diagnostics/network-check-target-52vl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:41.768952 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:41.768904 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6 podName:25404632-e1bc-40f4-a8f0-cad642b1c212 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:49.768886837 +0000 UTC m=+18.104980098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9fk6" (UniqueName: "kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6") pod "network-check-target-52vl2" (UID: "25404632-e1bc-40f4-a8f0-cad642b1c212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:41.869296 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:41.869261 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:41.869471 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:41.869392 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:41.869471 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:41.869456 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret podName:4c182030-5598-4bed-910d-78da9cd3dc27 nodeName:}" failed. No retries permitted until 2026-06-03 21:37:49.869437735 +0000 UTC m=+18.205530982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret") pod "global-pull-secret-syncer-mzrjj" (UID: "4c182030-5598-4bed-910d-78da9cd3dc27") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:42.161434 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:42.160969 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:42.161434 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:42.161091 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:42.163894 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:42.162434 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:42.163894 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:42.162546 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:43.160941 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:43.160909 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:43.161079 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:43.161033 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:44.161991 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:44.161953 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:44.162446 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:44.162107 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:44.162521 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:44.161952 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:44.162622 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:44.162575 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:45.161357 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:45.161274 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:45.161522 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:45.161394 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:46.161361 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:46.161329 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:46.161902 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:46.161461 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:46.161902 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:46.161528 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:46.161902 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:46.161630 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:47.161364 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:47.161332 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:47.161766 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:47.161443 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:48.160944 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:48.160917 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:48.160944 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:48.160930 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:48.161190 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:48.161031 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:48.161190 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:48.161169 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:49.160897 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:49.160866 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:49.161332 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:49.160969 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:49.825657 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:49.825623 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:49.825859 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:49.825665 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fk6\" (UniqueName: \"kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6\") pod \"network-check-target-52vl2\" (UID: \"25404632-e1bc-40f4-a8f0-cad642b1c212\") " pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:49.825859 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:49.825790 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:49.825859 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:49.825809 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:37:49.825859 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:49.825824 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:37:49.825859 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:49.825849 2554 projected.go:196] Error preparing data for projected volume kube-api-access-p9fk6 for pod openshift-network-diagnostics/network-check-target-52vl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:49.826113 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:49.825875 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs podName:733dc558-703e-4ee8-b7e3-5c3d39841574 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:05.825858055 +0000 UTC m=+34.161951301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs") pod "network-metrics-daemon-v8b9n" (UID: "733dc558-703e-4ee8-b7e3-5c3d39841574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:37:49.826113 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:49.825897 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6 podName:25404632-e1bc-40f4-a8f0-cad642b1c212 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:05.82588179 +0000 UTC m=+34.161975055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9fk6" (UniqueName: "kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6") pod "network-check-target-52vl2" (UID: "25404632-e1bc-40f4-a8f0-cad642b1c212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:37:49.926176 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:49.926145 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:49.926348 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:49.926266 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:49.926348 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:49.926322 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret podName:4c182030-5598-4bed-910d-78da9cd3dc27 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:05.926306835 +0000 UTC m=+34.262400080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret") pod "global-pull-secret-syncer-mzrjj" (UID: "4c182030-5598-4bed-910d-78da9cd3dc27") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:37:50.161624 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:50.161476 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:50.161624 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:50.161603 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:50.162156 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:50.161758 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:50.162156 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:50.161874 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:51.161091 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:51.161061 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:51.161272 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:51.161181 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:52.162409 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:52.162377 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:52.162821 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:52.162492 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:52.162821 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:52.162548 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:52.162821 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:52.162672 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:53.161000 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.160972 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:53.161119 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:53.161099 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:53.279153 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.278919 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pdbgn" event={"ID":"66677f28-c099-4884-a43f-30a1d25d2a1f","Type":"ContainerStarted","Data":"7c602a6197e6c7926287e4d4715a247bc22a0604bcabbc899d6fa76cb2a2fc1b"} Jun 03 21:37:53.280955 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.280929 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-59744" event={"ID":"b9009d27-4ec0-4368-9eaa-568a95fd3b9d","Type":"ContainerStarted","Data":"79cd4958603550700a07dd61416032540af9f895efbcfaa02fdea55335f4a364"} Jun 03 21:37:53.282557 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.282527 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" event={"ID":"cc2c17c4-779e-414c-a3d5-bf101678097f","Type":"ContainerStarted","Data":"4b987274eeb2e27af2564ac1b14135a239d2bb9b40d1661f0e12d1e23009ba35"} Jun 03 21:37:53.283994 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.283965 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vwh67" event={"ID":"1a7b8dc8-72ce-4eb6-afba-c1a411b6f4ac","Type":"ContainerStarted","Data":"8d5ff31220628b8a0d429dfe94cf613bd9e9a64a57f5adba39cf8c4f34783565"} Jun 03 21:37:53.285481 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.285433 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gzhx5" event={"ID":"0e7626cf-83d8-42c0-b139-475266086ac1","Type":"ContainerStarted","Data":"dcc933145a79c2c7a56468f4b010377e5f45de415bdc69224abf4ed9feb297ce"} Jun 03 21:37:53.293382 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.293325 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pdbgn" podStartSLOduration=3.313300914 podStartE2EDuration="21.293305802s" totalImagesPullingTime="17.980004888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:53.292555124 +0000 UTC m=+21.628648391" watchObservedRunningTime="2026-06-03 21:37:53.293305802 +0000 UTC m=+21.629399069" Jun 03 21:37:53.293514 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.293487 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" podStartSLOduration=20.293478137 podStartE2EDuration="20.293478137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:37.252963801 +0000 UTC m=+5.589057068" watchObservedRunningTime="2026-06-03 21:37:53.293478137 +0000 UTC m=+21.629571408" Jun 03 21:37:53.306245 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.306175 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-59744" podStartSLOduration=3.3261540800000002 podStartE2EDuration="21.306164197s" totalImagesPullingTime="17.980010117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:53.306008388 +0000 UTC m=+21.642101674" watchObservedRunningTime="2026-06-03 21:37:53.306164197 +0000 UTC m=+21.642257497" Jun 03 21:37:53.321095 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.321053 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vwh67" podStartSLOduration=3.331552529 podStartE2EDuration="21.32104212s" totalImagesPullingTime="17.989489591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:53.320866318 +0000 UTC m=+21.656959592" watchObservedRunningTime="2026-06-03 21:37:53.32104212 +0000 UTC m=+21.657135387" Jun 03 21:37:53.406558 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.406518 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:53.407130 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.407111 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:53.425472 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:53.425418 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gzhx5" podStartSLOduration=3.445036111 podStartE2EDuration="21.425403527s" totalImagesPullingTime="17.980367416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:53.334091683 +0000 UTC m=+21.670184951" watchObservedRunningTime="2026-06-03 21:37:53.425403527 +0000 UTC m=+21.761496793" Jun 03 21:37:54.164465 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.164318 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:54.164565 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.164376 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:54.164565 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:54.164538 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:54.164647 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:54.164610 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:54.288593 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.288561 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zg9r8" event={"ID":"0452a347-97c3-4fe2-a9ec-569a6d21417c","Type":"ContainerStarted","Data":"820b8bee539b96490a7fd45e9f61e284eca0b8c08c0b0f5f5730e769bc217df6"} Jun 03 21:37:54.290291 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.290260 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-85p29" event={"ID":"d6f93c4a-1d32-4e31-9341-dfbe0361a1a2","Type":"ContainerStarted","Data":"9b7ca8a57009413d96c59ce7d5def3b726ef3b60b0b4fce8b7020360e98f0983"} Jun 03 21:37:54.293797 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.293770 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 21:37:54.294136 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.294108 2554 generic.go:356] "Generic (PLEG): container finished" podID="2c252b44-3310-435c-8e02-3211754c50bb" containerID="e384c05f2443430751f94e0038c812a0ff52bea5799c348aaedd081c0fd28c39" exitCode=1 Jun 03 21:37:54.294245 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.294191 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" event={"ID":"2c252b44-3310-435c-8e02-3211754c50bb","Type":"ContainerStarted","Data":"e38c16cc7bdc6720e01aba53a326e40898f300c1103d6c5df3b05e5c97c9fbe6"} Jun 03 21:37:54.294309 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.294267 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" event={"ID":"2c252b44-3310-435c-8e02-3211754c50bb","Type":"ContainerStarted","Data":"b8214006811633346598fcabccdde277d74b066c3dd1f6ea1822114435bc1ef1"} Jun 03 21:37:54.294371 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.294321 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" event={"ID":"2c252b44-3310-435c-8e02-3211754c50bb","Type":"ContainerStarted","Data":"c5c29b2ef02082682093f293bbcc3f505a1375e09a18e8c68db688c3d3193d41"} Jun 03 21:37:54.294425 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.294378 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" event={"ID":"2c252b44-3310-435c-8e02-3211754c50bb","Type":"ContainerStarted","Data":"e7d2890c0a1430d76030de8229e98302972838ae4939ae3c94df7c703bff99d0"} Jun 03 21:37:54.294475 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.294425 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" event={"ID":"2c252b44-3310-435c-8e02-3211754c50bb","Type":"ContainerDied","Data":"e384c05f2443430751f94e0038c812a0ff52bea5799c348aaedd081c0fd28c39"} Jun 03 21:37:54.294532 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.294474 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" event={"ID":"2c252b44-3310-435c-8e02-3211754c50bb","Type":"ContainerStarted","Data":"b6175416cb3b218da4d1f5f54491eec79b1bf030f665e51fba36e66cdfd63465"} Jun 03 21:37:54.295821 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.295797 2554 generic.go:356] "Generic (PLEG): container finished" podID="7f52dda5-0477-4720-ab55-06360a6c69ab" containerID="7d889d8eee9cd57ef5eab7d5fe2e980d29cc8cbacdc80f6ebbd89b3f8216aa85" exitCode=0 Jun 03 21:37:54.295914 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.295871 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmnf2" event={"ID":"7f52dda5-0477-4720-ab55-06360a6c69ab","Type":"ContainerDied","Data":"7d889d8eee9cd57ef5eab7d5fe2e980d29cc8cbacdc80f6ebbd89b3f8216aa85"} Jun 03 21:37:54.296035 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.296020 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:54.296438 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.296422 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gzhx5" Jun 03 21:37:54.306750 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.306715 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zg9r8" podStartSLOduration=4.307217465 podStartE2EDuration="22.306704494s" totalImagesPullingTime="17.999487029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:54.306303535 +0000 UTC m=+22.642396801" watchObservedRunningTime="2026-06-03 21:37:54.306704494 +0000 UTC m=+22.642797771" Jun 03 21:37:54.360751 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.360712 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-85p29" podStartSLOduration=4.383621302 podStartE2EDuration="22.360697668s" totalImagesPullingTime="17.977076366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:54.360018678 +0000 UTC m=+22.696111955" watchObservedRunningTime="2026-06-03 21:37:54.360697668 +0000 UTC m=+22.696790946" Jun 03 21:37:54.364153 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:54.364128 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 21:37:55.161964 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:55.161935 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:55.162146 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:55.162047 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:55.163014 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:55.162898 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T21:37:54.364143049Z","UUID":"8071019a-a0c8-4999-a9d1-269a52726e48","Handler":null,"Name":"","Endpoint":""} Jun 03 21:37:55.164753 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:55.164639 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 21:37:55.164753 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:55.164678 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 21:37:55.300189 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:55.300151 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" event={"ID":"cc2c17c4-779e-414c-a3d5-bf101678097f","Type":"ContainerStarted","Data":"31d8f756a9b03c0ba303ec90aa97e798ef4f1871a2c2b0b979324caa339826e4"} Jun 03 21:37:56.161774 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:56.161530 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:56.161945 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:56.161603 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:56.161945 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:56.161814 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:56.161945 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:56.161918 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:56.305265 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:56.305239 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 21:37:56.305656 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:56.305635 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" event={"ID":"2c252b44-3310-435c-8e02-3211754c50bb","Type":"ContainerStarted","Data":"f0085c4fe61e8222aa20216d387c12046baa285a60b2ab1e04566f2bce5b2cbc"} Jun 03 21:37:56.307615 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:56.307591 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" event={"ID":"cc2c17c4-779e-414c-a3d5-bf101678097f","Type":"ContainerStarted","Data":"3b8b95423657e976648153fc5586953a0c788b87e18f60e9cb29b9dd2712ea5c"} Jun 03 21:37:56.325519 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:56.325475 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7njs4" podStartSLOduration=4.247957223 podStartE2EDuration="24.325460988s" totalImagesPullingTime="20.077503765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:56.325046284 +0000 UTC m=+24.661139551" watchObservedRunningTime="2026-06-03 21:37:56.325460988 +0000 UTC m=+24.661554255" Jun 03 21:37:57.161213 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:57.161185 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:57.161384 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:57.161296 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:58.161712 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:58.161676 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:37:58.162402 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:58.161720 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:37:58.162402 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:58.161851 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:37:58.162402 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:58.161951 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:37:59.161426 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:59.161268 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:37:59.161556 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:37:59.161488 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:37:59.316730 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:59.316704 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 21:37:59.317200 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:59.317033 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" event={"ID":"2c252b44-3310-435c-8e02-3211754c50bb","Type":"ContainerStarted","Data":"53f1c71d9bc761f12667b9ba7fa0ce0d3c4b60f23094fa8558fed1d45489db67"} Jun 03 21:37:59.317298 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:59.317272 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:59.317368 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:59.317355 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:59.317415 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:59.317404 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:59.317481 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:59.317466 2554 scope.go:117] "RemoveContainer" containerID="e384c05f2443430751f94e0038c812a0ff52bea5799c348aaedd081c0fd28c39" Jun 03 21:37:59.319160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:59.319136 2554 generic.go:356] "Generic (PLEG): container finished" podID="7f52dda5-0477-4720-ab55-06360a6c69ab" containerID="df67feebc25dfbe7de86f3fbe338f819f345db59f2771b7af71571a35b9b560c" exitCode=0 Jun 03 21:37:59.319274 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:59.319177 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmnf2" event={"ID":"7f52dda5-0477-4720-ab55-06360a6c69ab","Type":"ContainerDied","Data":"df67feebc25dfbe7de86f3fbe338f819f345db59f2771b7af71571a35b9b560c"} Jun 03 21:37:59.334811 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:59.334746 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:37:59.335769 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:37:59.335752 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:38:00.161364 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.161324 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:38:00.161509 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:00.161438 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:38:00.161589 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.161552 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:38:00.161716 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:00.161690 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:38:00.326355 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.326287 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 21:38:00.326782 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.326745 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" event={"ID":"2c252b44-3310-435c-8e02-3211754c50bb","Type":"ContainerStarted","Data":"072c8d10e545cd5e5cdf3613e4b9f2c9022bebf0b0c53c4611087842966cb953"} Jun 03 21:38:00.329252 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.329222 2554 generic.go:356] "Generic (PLEG): container finished" podID="7f52dda5-0477-4720-ab55-06360a6c69ab" containerID="c66c8b4d31676ff5e2de2e990cefe9ca5ce662c3bbd29f65109e814f092147f4" exitCode=0 Jun 03 21:38:00.329376 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.329269 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmnf2" event={"ID":"7f52dda5-0477-4720-ab55-06360a6c69ab","Type":"ContainerDied","Data":"c66c8b4d31676ff5e2de2e990cefe9ca5ce662c3bbd29f65109e814f092147f4"} Jun 03 21:38:00.353765 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.353721 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" podStartSLOduration=10.322916129 podStartE2EDuration="28.35370704s" totalImagesPullingTime="18.030790911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:00.352222548 +0000 UTC m=+28.688315852" watchObservedRunningTime="2026-06-03 21:38:00.35370704 +0000 UTC m=+28.689800301" Jun 03 21:38:00.576550 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.576474 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mzrjj"] Jun 03 21:38:00.576689 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.576573 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:38:00.576689 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:00.576675 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:38:00.579881 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.579670 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-52vl2"] Jun 03 21:38:00.579881 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.579779 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:38:00.580067 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:00.579881 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:38:00.580319 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.580301 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v8b9n"] Jun 03 21:38:00.580388 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:00.580375 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:38:00.580475 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:00.580459 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:38:01.333127 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:01.333052 2554 generic.go:356] "Generic (PLEG): container finished" podID="7f52dda5-0477-4720-ab55-06360a6c69ab" containerID="ec6d1d0a8518ea19a0f42a1e4fb3204b4071dffbfadbef6bb0c1950fb6413fb1" exitCode=0 Jun 03 21:38:01.333444 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:01.333125 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmnf2" event={"ID":"7f52dda5-0477-4720-ab55-06360a6c69ab","Type":"ContainerDied","Data":"ec6d1d0a8518ea19a0f42a1e4fb3204b4071dffbfadbef6bb0c1950fb6413fb1"} Jun 03 21:38:02.162905 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:02.162875 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:38:02.163046 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:02.162883 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:38:02.163046 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:02.162981 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:38:02.163046 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:02.163038 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:38:02.163218 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:02.163122 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:38:02.163218 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:02.163184 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:38:04.161454 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:04.161286 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:38:04.161981 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:04.161293 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:38:04.161981 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:04.161557 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-52vl2" podUID="25404632-e1bc-40f4-a8f0-cad642b1c212" Jun 03 21:38:04.161981 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:04.161306 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:38:04.161981 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:04.161594 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mzrjj" podUID="4c182030-5598-4bed-910d-78da9cd3dc27" Jun 03 21:38:04.161981 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:04.161724 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:38:05.845512 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:05.845442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:38:05.845512 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:05.845477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fk6\" (UniqueName: \"kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6\") pod \"network-check-target-52vl2\" (UID: \"25404632-e1bc-40f4-a8f0-cad642b1c212\") " pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:38:05.846073 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:05.845572 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:38:05.846073 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:05.845581 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 21:38:05.846073 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:05.845594 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 21:38:05.846073 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:05.845603 2554 projected.go:196] Error preparing data for projected volume kube-api-access-p9fk6 for pod openshift-network-diagnostics/network-check-target-52vl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:38:05.846073 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:05.845627 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs podName:733dc558-703e-4ee8-b7e3-5c3d39841574 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:37.845613058 +0000 UTC m=+66.181706304 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs") pod "network-metrics-daemon-v8b9n" (UID: "733dc558-703e-4ee8-b7e3-5c3d39841574") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 21:38:05.846073 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:05.845642 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6 podName:25404632-e1bc-40f4-a8f0-cad642b1c212 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:37.845635357 +0000 UTC m=+66.181728603 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9fk6" (UniqueName: "kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6") pod "network-check-target-52vl2" (UID: "25404632-e1bc-40f4-a8f0-cad642b1c212") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 21:38:05.945777 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:05.945753 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:38:05.945919 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:05.945863 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 21:38:05.945919 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:05.945910 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret podName:4c182030-5598-4bed-910d-78da9cd3dc27 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:37.945897822 +0000 UTC m=+66.281991067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret") pod "global-pull-secret-syncer-mzrjj" (UID: "4c182030-5598-4bed-910d-78da9cd3dc27") : object "kube-system"/"original-pull-secret" not registered Jun 03 21:38:06.002932 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.002909 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeReady" Jun 03 21:38:06.003038 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.003008 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 21:38:06.035272 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.035246 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c48b9b7f7-zssj2"] Jun 03 21:38:06.037880 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.037866 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.040126 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.040106 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 21:38:06.040239 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.040208 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 21:38:06.040239 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.040209 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8v2xb\"" Jun 03 21:38:06.040466 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.040450 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 21:38:06.045475 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.045445 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 21:38:06.048475 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.048457 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7jrlc"] Jun 03 21:38:06.051156 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.051142 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.053143 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.053124 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c48b9b7f7-zssj2"] Jun 03 21:38:06.054027 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.054013 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 21:38:06.054156 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.054142 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 21:38:06.054226 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.054200 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kqdlc\"" Jun 03 21:38:06.055343 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.055322 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lxll4"] Jun 03 21:38:06.057949 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.057932 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lxll4" Jun 03 21:38:06.060453 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.060431 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zhsnd\"" Jun 03 21:38:06.060556 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.060473 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 21:38:06.060556 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.060488 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 21:38:06.060708 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.060696 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 21:38:06.063209 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.063157 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7jrlc"] Jun 03 21:38:06.065950 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.065931 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lxll4"] Jun 03 21:38:06.146542 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146481 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-bound-sa-token\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.146542 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146512 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.146542 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146528 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxxvt\" (UniqueName: \"kubernetes.io/projected/e35196ec-35b9-4f12-9060-008ff886a985-kube-api-access-mxxvt\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.146698 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146575 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8rlq\" (UniqueName: \"kubernetes.io/projected/ac0b00dd-b1a9-437c-a081-6bc90a267324-kube-api-access-z8rlq\") pod \"ingress-canary-lxll4\" (UID: \"ac0b00dd-b1a9-437c-a081-6bc90a267324\") " pod="openshift-ingress-canary/ingress-canary-lxll4" Jun 03 21:38:06.146698 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146600 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-image-registry-private-configuration\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.146698 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146618 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.146698 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146680 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-registry-certificates\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.146698 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146696 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-installation-pull-secrets\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.146943 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac0b00dd-b1a9-437c-a081-6bc90a267324-cert\") pod \"ingress-canary-lxll4\" (UID: \"ac0b00dd-b1a9-437c-a081-6bc90a267324\") " pod="openshift-ingress-canary/ingress-canary-lxll4" Jun 03 21:38:06.146943 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146729 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e35196ec-35b9-4f12-9060-008ff886a985-config-volume\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.146943 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146748 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c00e098-f253-4e47-8f46-853ad399fe27-ca-trust-extracted\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.146943 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146764 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-trusted-ca\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.146943 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35196ec-35b9-4f12-9060-008ff886a985-tmp-dir\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.146943 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.146889 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgc9s\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-kube-api-access-qgc9s\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.161743 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.161722 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:38:06.161847 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.161815 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:38:06.161904 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.161867 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:38:06.164450 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.164427 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 21:38:06.164450 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.164436 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 21:38:06.164607 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.164486 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d7z2v\"" Jun 03 21:38:06.164607 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.164513 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 21:38:06.164607 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.164556 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 21:38:06.164820 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.164807 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zqjnq\"" Jun 03 21:38:06.247378 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-bound-sa-token\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.247489 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247388 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.247489 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247405 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxxvt\" (UniqueName: \"kubernetes.io/projected/e35196ec-35b9-4f12-9060-008ff886a985-kube-api-access-mxxvt\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.247489 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247434 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8rlq\" (UniqueName: \"kubernetes.io/projected/ac0b00dd-b1a9-437c-a081-6bc90a267324-kube-api-access-z8rlq\") pod \"ingress-canary-lxll4\" (UID: \"ac0b00dd-b1a9-437c-a081-6bc90a267324\") " pod="openshift-ingress-canary/ingress-canary-lxll4" Jun 03 21:38:06.247489 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247459 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-image-registry-private-configuration\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.247489 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.247734 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-registry-certificates\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.247734 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:06.247527 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:38:06.247734 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:06.247583 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls podName:e35196ec-35b9-4f12-9060-008ff886a985 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:06.747564657 +0000 UTC m=+35.083657912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls") pod "dns-default-7jrlc" (UID: "e35196ec-35b9-4f12-9060-008ff886a985") : secret "dns-default-metrics-tls" not found Jun 03 21:38:06.247734 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:06.247630 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:38:06.247734 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:06.247649 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c48b9b7f7-zssj2: secret "image-registry-tls" not found Jun 03 21:38:06.247734 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:06.247697 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls podName:2c00e098-f253-4e47-8f46-853ad399fe27 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:06.74768113 +0000 UTC m=+35.083774375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls") pod "image-registry-7c48b9b7f7-zssj2" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27") : secret "image-registry-tls" not found Jun 03 21:38:06.247734 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247692 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-installation-pull-secrets\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.247734 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247736 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac0b00dd-b1a9-437c-a081-6bc90a267324-cert\") pod \"ingress-canary-lxll4\" (UID: \"ac0b00dd-b1a9-437c-a081-6bc90a267324\") " pod="openshift-ingress-canary/ingress-canary-lxll4" Jun 03 21:38:06.248162 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247763 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e35196ec-35b9-4f12-9060-008ff886a985-config-volume\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.248162 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247848 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c00e098-f253-4e47-8f46-853ad399fe27-ca-trust-extracted\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.248162 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.247962 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-trusted-ca\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.248162 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.248002 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35196ec-35b9-4f12-9060-008ff886a985-tmp-dir\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.248162 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.248066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgc9s\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-kube-api-access-qgc9s\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.248162 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.248102 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-registry-certificates\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.248162 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.248144 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c00e098-f253-4e47-8f46-853ad399fe27-ca-trust-extracted\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.248473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.248390 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e35196ec-35b9-4f12-9060-008ff886a985-config-volume\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.248473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.248408 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35196ec-35b9-4f12-9060-008ff886a985-tmp-dir\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.248947 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.248928 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-trusted-ca\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.251554 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.251531 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-installation-pull-secrets\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.251654 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.251534 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-image-registry-private-configuration\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.251654 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.251595 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac0b00dd-b1a9-437c-a081-6bc90a267324-cert\") pod \"ingress-canary-lxll4\" (UID: \"ac0b00dd-b1a9-437c-a081-6bc90a267324\") " pod="openshift-ingress-canary/ingress-canary-lxll4" Jun 03 21:38:06.257969 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.257947 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxxvt\" (UniqueName: \"kubernetes.io/projected/e35196ec-35b9-4f12-9060-008ff886a985-kube-api-access-mxxvt\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.258405 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.258379 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-bound-sa-token\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.258596 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.258580 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8rlq\" (UniqueName: \"kubernetes.io/projected/ac0b00dd-b1a9-437c-a081-6bc90a267324-kube-api-access-z8rlq\") pod \"ingress-canary-lxll4\" (UID: \"ac0b00dd-b1a9-437c-a081-6bc90a267324\") " pod="openshift-ingress-canary/ingress-canary-lxll4" Jun 03 21:38:06.258776 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.258761 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgc9s\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-kube-api-access-qgc9s\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.348438 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.348413 2554 generic.go:356] "Generic (PLEG): container finished" podID="7f52dda5-0477-4720-ab55-06360a6c69ab" containerID="85c4215df9cb6d800b94cfa657d24762c307ac918ff8ef882dce366edfd4dc8c" exitCode=0 Jun 03 21:38:06.348535 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.348445 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmnf2" event={"ID":"7f52dda5-0477-4720-ab55-06360a6c69ab","Type":"ContainerDied","Data":"85c4215df9cb6d800b94cfa657d24762c307ac918ff8ef882dce366edfd4dc8c"} Jun 03 21:38:06.367361 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.367340 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lxll4" Jun 03 21:38:06.506672 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.506529 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lxll4"] Jun 03 21:38:06.511580 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:38:06.511554 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac0b00dd_b1a9_437c_a081_6bc90a267324.slice/crio-e3c0916e7fcd5fa689eea8b85279f8503ce4a1f4b07285878df1ca55399bd729 WatchSource:0}: Error finding container e3c0916e7fcd5fa689eea8b85279f8503ce4a1f4b07285878df1ca55399bd729: Status 404 returned error can't find the container with id e3c0916e7fcd5fa689eea8b85279f8503ce4a1f4b07285878df1ca55399bd729 Jun 03 21:38:06.751156 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.751134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:06.751292 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:06.751198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:06.751292 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:06.751277 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:38:06.751360 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:06.751321 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls podName:e35196ec-35b9-4f12-9060-008ff886a985 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:07.751308486 +0000 UTC m=+36.087401730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls") pod "dns-default-7jrlc" (UID: "e35196ec-35b9-4f12-9060-008ff886a985") : secret "dns-default-metrics-tls" not found Jun 03 21:38:06.751400 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:06.751368 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:38:06.751400 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:06.751383 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c48b9b7f7-zssj2: secret "image-registry-tls" not found Jun 03 21:38:06.751463 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:06.751428 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls podName:2c00e098-f253-4e47-8f46-853ad399fe27 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:07.751413822 +0000 UTC m=+36.087507086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls") pod "image-registry-7c48b9b7f7-zssj2" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27") : secret "image-registry-tls" not found Jun 03 21:38:07.353755 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:07.353719 2554 generic.go:356] "Generic (PLEG): container finished" podID="7f52dda5-0477-4720-ab55-06360a6c69ab" containerID="9e0826e2d5b9b0e8b68feb995ceb856f0f52b102ac847b28426d42d641a18237" exitCode=0 Jun 03 21:38:07.354309 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:07.353799 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmnf2" event={"ID":"7f52dda5-0477-4720-ab55-06360a6c69ab","Type":"ContainerDied","Data":"9e0826e2d5b9b0e8b68feb995ceb856f0f52b102ac847b28426d42d641a18237"} Jun 03 21:38:07.354977 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:07.354956 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lxll4" event={"ID":"ac0b00dd-b1a9-437c-a081-6bc90a267324","Type":"ContainerStarted","Data":"e3c0916e7fcd5fa689eea8b85279f8503ce4a1f4b07285878df1ca55399bd729"} Jun 03 21:38:07.759451 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:07.759415 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:07.759627 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:07.759470 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:07.759627 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:07.759567 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:38:07.759627 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:07.759608 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:38:07.759627 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:07.759622 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c48b9b7f7-zssj2: secret "image-registry-tls" not found Jun 03 21:38:07.759768 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:07.759641 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls podName:e35196ec-35b9-4f12-9060-008ff886a985 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:09.759621608 +0000 UTC m=+38.095714872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls") pod "dns-default-7jrlc" (UID: "e35196ec-35b9-4f12-9060-008ff886a985") : secret "dns-default-metrics-tls" not found Jun 03 21:38:07.759768 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:07.759657 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls podName:2c00e098-f253-4e47-8f46-853ad399fe27 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:09.759647162 +0000 UTC m=+38.095740415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls") pod "image-registry-7c48b9b7f7-zssj2" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27") : secret "image-registry-tls" not found Jun 03 21:38:08.360272 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:08.360231 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cmnf2" event={"ID":"7f52dda5-0477-4720-ab55-06360a6c69ab","Type":"ContainerStarted","Data":"666fc509eefadeea2b40d190140fc09f9f4c82fd41cd08799846912d4f1aca57"} Jun 03 21:38:08.384457 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:08.384410 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cmnf2" podStartSLOduration=8.622342474 podStartE2EDuration="36.384394261s" totalImagesPullingTime="27.762051787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:08.382299176 +0000 UTC m=+36.718392445" watchObservedRunningTime="2026-06-03 21:38:08.384394261 +0000 UTC m=+36.720487527" Jun 03 21:38:09.363692 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:09.363491 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lxll4" event={"ID":"ac0b00dd-b1a9-437c-a081-6bc90a267324","Type":"ContainerStarted","Data":"e31814177952db18dfebe55d48c8b167bb17dc9b371a03715c05c7739b28dc7d"} Jun 03 21:38:09.379246 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:09.379201 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lxll4" podStartSLOduration=0.782260266 podStartE2EDuration="3.37918705s" totalImagesPullingTime="2.596926784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:09.378621764 +0000 UTC m=+37.714715031" watchObservedRunningTime="2026-06-03 21:38:09.37918705 +0000 UTC m=+37.715280316" Jun 03 21:38:09.774253 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:09.774225 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:09.774414 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:09.774265 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:09.774414 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:09.774369 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:38:09.774414 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:09.774387 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:38:09.774414 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:09.774398 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c48b9b7f7-zssj2: secret "image-registry-tls" not found Jun 03 21:38:09.774577 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:09.774441 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls podName:e35196ec-35b9-4f12-9060-008ff886a985 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:13.774426356 +0000 UTC m=+42.110519602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls") pod "dns-default-7jrlc" (UID: "e35196ec-35b9-4f12-9060-008ff886a985") : secret "dns-default-metrics-tls" not found Jun 03 21:38:09.774577 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:09.774472 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls podName:2c00e098-f253-4e47-8f46-853ad399fe27 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:13.774452982 +0000 UTC m=+42.110546231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls") pod "image-registry-7c48b9b7f7-zssj2" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27") : secret "image-registry-tls" not found Jun 03 21:38:13.804293 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:13.804259 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:13.804784 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:13.804307 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:13.804784 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:13.804420 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:38:13.804784 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:13.804481 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls podName:e35196ec-35b9-4f12-9060-008ff886a985 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:21.804467156 +0000 UTC m=+50.140560404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls") pod "dns-default-7jrlc" (UID: "e35196ec-35b9-4f12-9060-008ff886a985") : secret "dns-default-metrics-tls" not found Jun 03 21:38:13.804784 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:13.804423 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:38:13.804784 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:13.804524 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c48b9b7f7-zssj2: secret "image-registry-tls" not found Jun 03 21:38:13.804784 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:13.804563 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls podName:2c00e098-f253-4e47-8f46-853ad399fe27 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:21.804552119 +0000 UTC m=+50.140645368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls") pod "image-registry-7c48b9b7f7-zssj2" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27") : secret "image-registry-tls" not found Jun 03 21:38:21.857459 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:21.857428 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:21.857972 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:21.857473 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:21.857972 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:21.857626 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:38:21.857972 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:21.857645 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:38:21.857972 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:21.857656 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c48b9b7f7-zssj2: secret "image-registry-tls" not found Jun 03 21:38:21.857972 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:21.857742 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls podName:2c00e098-f253-4e47-8f46-853ad399fe27 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:37.857708745 +0000 UTC m=+66.193802004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls") pod "image-registry-7c48b9b7f7-zssj2" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27") : secret "image-registry-tls" not found Jun 03 21:38:21.857972 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:21.857756 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls podName:e35196ec-35b9-4f12-9060-008ff886a985 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:37.857749594 +0000 UTC m=+66.193842840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls") pod "dns-default-7jrlc" (UID: "e35196ec-35b9-4f12-9060-008ff886a985") : secret "dns-default-metrics-tls" not found Jun 03 21:38:31.343951 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:31.343922 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z576l" Jun 03 21:38:37.867714 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.867671 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:38:37.867714 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.867717 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:38:37.868159 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.867737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fk6\" (UniqueName: \"kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6\") pod \"network-check-target-52vl2\" (UID: \"25404632-e1bc-40f4-a8f0-cad642b1c212\") " pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:38:37.868159 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.867755 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:38:37.868159 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:37.867857 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:38:37.868159 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:37.867902 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:38:37.868159 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:37.867914 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c48b9b7f7-zssj2: secret "image-registry-tls" not found Jun 03 21:38:37.868159 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:37.867945 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls podName:e35196ec-35b9-4f12-9060-008ff886a985 nodeName:}" failed. No retries permitted until 2026-06-03 21:39:09.867924961 +0000 UTC m=+98.204018205 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls") pod "dns-default-7jrlc" (UID: "e35196ec-35b9-4f12-9060-008ff886a985") : secret "dns-default-metrics-tls" not found Jun 03 21:38:37.868159 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:37.867965 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls podName:2c00e098-f253-4e47-8f46-853ad399fe27 nodeName:}" failed. No retries permitted until 2026-06-03 21:39:09.867956249 +0000 UTC m=+98.204049496 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls") pod "image-registry-7c48b9b7f7-zssj2" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27") : secret "image-registry-tls" not found Jun 03 21:38:37.870556 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.870540 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 21:38:37.870556 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.870550 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 21:38:37.878748 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:37.878732 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 21:38:37.878852 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:38:37.878779 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs podName:733dc558-703e-4ee8-b7e3-5c3d39841574 nodeName:}" failed. No retries permitted until 2026-06-03 21:39:41.878767293 +0000 UTC m=+130.214860541 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs") pod "network-metrics-daemon-v8b9n" (UID: "733dc558-703e-4ee8-b7e3-5c3d39841574") : secret "metrics-daemon-secret" not found Jun 03 21:38:37.881732 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.881036 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 21:38:37.893664 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.893638 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9fk6\" (UniqueName: \"kubernetes.io/projected/25404632-e1bc-40f4-a8f0-cad642b1c212-kube-api-access-p9fk6\") pod \"network-check-target-52vl2\" (UID: \"25404632-e1bc-40f4-a8f0-cad642b1c212\") " pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:38:37.968156 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.968136 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:38:37.970925 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.970910 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 21:38:37.972931 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.972919 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d7z2v\"" Jun 03 21:38:37.980668 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.980648 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c182030-5598-4bed-910d-78da9cd3dc27-original-pull-secret\") pod \"global-pull-secret-syncer-mzrjj\" (UID: \"4c182030-5598-4bed-910d-78da9cd3dc27\") " pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:38:37.981541 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.981524 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:38:37.983794 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:37.983771 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mzrjj" Jun 03 21:38:38.121435 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:38.121410 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mzrjj"] Jun 03 21:38:38.123954 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:38:38.123930 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c182030_5598_4bed_910d_78da9cd3dc27.slice/crio-9181bbf505b75317e0bee50211bc1db7326e64eddf2a137fa40bb9b44aaae5c2 WatchSource:0}: Error finding container 9181bbf505b75317e0bee50211bc1db7326e64eddf2a137fa40bb9b44aaae5c2: Status 404 returned error can't find the container with id 9181bbf505b75317e0bee50211bc1db7326e64eddf2a137fa40bb9b44aaae5c2 Jun 03 21:38:38.133815 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:38.133792 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-52vl2"] Jun 03 21:38:38.137147 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:38:38.137124 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25404632_e1bc_40f4_a8f0_cad642b1c212.slice/crio-2e701075140574cc6dfb13c01e63c0dbbdc0967b5ead27be56c2721701e6f305 WatchSource:0}: Error finding container 2e701075140574cc6dfb13c01e63c0dbbdc0967b5ead27be56c2721701e6f305: Status 404 returned error can't find the container with id 2e701075140574cc6dfb13c01e63c0dbbdc0967b5ead27be56c2721701e6f305 Jun 03 21:38:38.426155 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:38.426078 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mzrjj" event={"ID":"4c182030-5598-4bed-910d-78da9cd3dc27","Type":"ContainerStarted","Data":"9181bbf505b75317e0bee50211bc1db7326e64eddf2a137fa40bb9b44aaae5c2"} Jun 03 21:38:38.427136 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:38.427114 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-52vl2" event={"ID":"25404632-e1bc-40f4-a8f0-cad642b1c212","Type":"ContainerStarted","Data":"2e701075140574cc6dfb13c01e63c0dbbdc0967b5ead27be56c2721701e6f305"} Jun 03 21:38:42.439942 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:42.439903 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-52vl2" event={"ID":"25404632-e1bc-40f4-a8f0-cad642b1c212","Type":"ContainerStarted","Data":"f34ee3e7b27af40077efe51d858f039a883dbb19c3a8228a041ff04d9123ae57"} Jun 03 21:38:42.440365 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:42.440051 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:38:42.459983 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:42.457525 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-52vl2" podStartSLOduration=67.173215251 podStartE2EDuration="1m10.457506459s" totalImagesPullingTime="3.284291208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:42.457202182 +0000 UTC m=+70.793295448" watchObservedRunningTime="2026-06-03 21:38:42.457506459 +0000 UTC m=+70.793599725" Jun 03 21:38:43.443554 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:43.443513 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mzrjj" event={"ID":"4c182030-5598-4bed-910d-78da9cd3dc27","Type":"ContainerStarted","Data":"acf0d3c7f81080ffa6feaa338c48d7d0d39351f40c0a9112afefcee3a56c4b9e"} Jun 03 21:38:43.458065 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:38:43.458025 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mzrjj" podStartSLOduration=66.54600464 podStartE2EDuration="1m11.458011507s" totalImagesPullingTime="4.912006867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:43.457405875 +0000 UTC m=+71.793499158" watchObservedRunningTime="2026-06-03 21:38:43.458011507 +0000 UTC m=+71.794104804" Jun 03 21:39:09.881978 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:39:09.881860 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:39:09.881978 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:39:09.881906 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:39:09.882428 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:39:09.882015 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:39:09.882428 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:39:09.882089 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls podName:e35196ec-35b9-4f12-9060-008ff886a985 nodeName:}" failed. No retries permitted until 2026-06-03 21:40:13.882073509 +0000 UTC m=+162.218166755 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls") pod "dns-default-7jrlc" (UID: "e35196ec-35b9-4f12-9060-008ff886a985") : secret "dns-default-metrics-tls" not found Jun 03 21:39:09.882428 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:39:09.882018 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:39:09.882428 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:39:09.882124 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c48b9b7f7-zssj2: secret "image-registry-tls" not found Jun 03 21:39:09.882428 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:39:09.882174 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls podName:2c00e098-f253-4e47-8f46-853ad399fe27 nodeName:}" failed. No retries permitted until 2026-06-03 21:40:13.882162554 +0000 UTC m=+162.218255803 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls") pod "image-registry-7c48b9b7f7-zssj2" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27") : secret "image-registry-tls" not found Jun 03 21:39:13.445929 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:39:13.445896 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-52vl2" Jun 03 21:39:41.892884 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:39:41.892846 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:39:41.893360 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:39:41.892982 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 21:39:41.893360 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:39:41.893060 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs podName:733dc558-703e-4ee8-b7e3-5c3d39841574 nodeName:}" failed. No retries permitted until 2026-06-03 21:41:43.893042213 +0000 UTC m=+252.229135458 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs") pod "network-metrics-daemon-v8b9n" (UID: "733dc558-703e-4ee8-b7e3-5c3d39841574") : secret "metrics-daemon-secret" not found Jun 03 21:40:09.046690 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:40:09.046648 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" podUID="2c00e098-f253-4e47-8f46-853ad399fe27" Jun 03 21:40:09.059792 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:40:09.059763 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7jrlc" podUID="e35196ec-35b9-4f12-9060-008ff886a985" Jun 03 21:40:09.179742 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:40:09.179712 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:40:09.636903 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:40:09.636873 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:40:09.637065 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:40:09.636873 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7jrlc" Jun 03 21:40:13.907567 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:40:13.907520 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:40:13.908004 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:40:13.907578 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:40:13.908004 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:40:13.907658 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 21:40:13.908004 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:40:13.907667 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:40:13.908004 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:40:13.907698 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c48b9b7f7-zssj2: secret "image-registry-tls" not found Jun 03 21:40:13.908004 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:40:13.907735 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls podName:e35196ec-35b9-4f12-9060-008ff886a985 nodeName:}" failed. No retries permitted until 2026-06-03 21:42:15.907717842 +0000 UTC m=+284.243811087 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls") pod "dns-default-7jrlc" (UID: "e35196ec-35b9-4f12-9060-008ff886a985") : secret "dns-default-metrics-tls" not found Jun 03 21:40:13.908004 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:40:13.907749 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls podName:2c00e098-f253-4e47-8f46-853ad399fe27 nodeName:}" failed. No retries permitted until 2026-06-03 21:42:15.907742781 +0000 UTC m=+284.243836025 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls") pod "image-registry-7c48b9b7f7-zssj2" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27") : secret "image-registry-tls" not found Jun 03 21:40:20.161478 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:40:20.161388 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:41:43.902678 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:41:43.902642 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:41:43.903158 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:41:43.902806 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 21:41:43.903158 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:41:43.902893 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs podName:733dc558-703e-4ee8-b7e3-5c3d39841574 nodeName:}" failed. No retries permitted until 2026-06-03 21:43:45.902876736 +0000 UTC m=+374.238969980 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs") pod "network-metrics-daemon-v8b9n" (UID: "733dc558-703e-4ee8-b7e3-5c3d39841574") : secret "metrics-daemon-secret" not found Jun 03 21:42:03.022413 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.022340 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg"] Jun 03 21:42:03.025151 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.025130 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:03.028043 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.028022 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 21:42:03.028157 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.028024 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:42:03.029139 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.029124 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 21:42:03.029216 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.029125 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-g5z8v\"" Jun 03 21:42:03.044598 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.044572 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg"] Jun 03 21:42:03.126137 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.126114 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-n7gfg\" (UID: \"793f4175-9c71-42a9-b0f1-3797f4347b4f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:03.126255 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.126163 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj4b4\" (UniqueName: \"kubernetes.io/projected/793f4175-9c71-42a9-b0f1-3797f4347b4f-kube-api-access-qj4b4\") pod \"cluster-samples-operator-9f6f677f5-n7gfg\" (UID: \"793f4175-9c71-42a9-b0f1-3797f4347b4f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:03.134486 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.134453 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb"] Jun 03 21:42:03.137149 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.137135 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" Jun 03 21:42:03.139635 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.139612 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 21:42:03.139635 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.139626 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:42:03.139798 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.139633 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 21:42:03.140017 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.139998 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-64scj\"" Jun 03 21:42:03.140140 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.140124 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 21:42:03.148463 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.148443 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb"] Jun 03 21:42:03.226645 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.226621 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj4b4\" (UniqueName: \"kubernetes.io/projected/793f4175-9c71-42a9-b0f1-3797f4347b4f-kube-api-access-qj4b4\") pod \"cluster-samples-operator-9f6f677f5-n7gfg\" (UID: \"793f4175-9c71-42a9-b0f1-3797f4347b4f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:03.226791 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.226663 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3935b29d-8bb0-48c6-93c1-82c2b9b2198a-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb\" (UID: \"3935b29d-8bb0-48c6-93c1-82c2b9b2198a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" Jun 03 21:42:03.226791 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.226743 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3935b29d-8bb0-48c6-93c1-82c2b9b2198a-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb\" (UID: \"3935b29d-8bb0-48c6-93c1-82c2b9b2198a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" Jun 03 21:42:03.226897 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.226807 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-n7gfg\" (UID: \"793f4175-9c71-42a9-b0f1-3797f4347b4f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:03.226897 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.226873 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrtmt\" (UniqueName: \"kubernetes.io/projected/3935b29d-8bb0-48c6-93c1-82c2b9b2198a-kube-api-access-hrtmt\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb\" (UID: \"3935b29d-8bb0-48c6-93c1-82c2b9b2198a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" Jun 03 21:42:03.226990 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:03.226975 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 21:42:03.227043 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:03.227034 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls podName:793f4175-9c71-42a9-b0f1-3797f4347b4f nodeName:}" failed. No retries permitted until 2026-06-03 21:42:03.727015649 +0000 UTC m=+272.063108904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-n7gfg" (UID: "793f4175-9c71-42a9-b0f1-3797f4347b4f") : secret "samples-operator-tls" not found Jun 03 21:42:03.236610 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.236587 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj4b4\" (UniqueName: \"kubernetes.io/projected/793f4175-9c71-42a9-b0f1-3797f4347b4f-kube-api-access-qj4b4\") pod \"cluster-samples-operator-9f6f677f5-n7gfg\" (UID: \"793f4175-9c71-42a9-b0f1-3797f4347b4f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:03.327889 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.327791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrtmt\" (UniqueName: \"kubernetes.io/projected/3935b29d-8bb0-48c6-93c1-82c2b9b2198a-kube-api-access-hrtmt\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb\" (UID: \"3935b29d-8bb0-48c6-93c1-82c2b9b2198a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" Jun 03 21:42:03.327889 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.327863 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3935b29d-8bb0-48c6-93c1-82c2b9b2198a-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb\" (UID: \"3935b29d-8bb0-48c6-93c1-82c2b9b2198a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" Jun 03 21:42:03.328066 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.327891 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3935b29d-8bb0-48c6-93c1-82c2b9b2198a-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb\" (UID: \"3935b29d-8bb0-48c6-93c1-82c2b9b2198a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" Jun 03 21:42:03.328359 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.328342 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3935b29d-8bb0-48c6-93c1-82c2b9b2198a-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb\" (UID: \"3935b29d-8bb0-48c6-93c1-82c2b9b2198a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" Jun 03 21:42:03.330041 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.330021 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3935b29d-8bb0-48c6-93c1-82c2b9b2198a-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb\" (UID: \"3935b29d-8bb0-48c6-93c1-82c2b9b2198a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" Jun 03 21:42:03.335471 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.335450 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrtmt\" (UniqueName: \"kubernetes.io/projected/3935b29d-8bb0-48c6-93c1-82c2b9b2198a-kube-api-access-hrtmt\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb\" (UID: \"3935b29d-8bb0-48c6-93c1-82c2b9b2198a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" Jun 03 21:42:03.445828 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.445798 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" Jun 03 21:42:03.562550 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.562524 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb"] Jun 03 21:42:03.565773 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:03.565743 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3935b29d_8bb0_48c6_93c1_82c2b9b2198a.slice/crio-067072be037173cd90d748d5ba0421b95fe590f71ef2623d603e47083ecd01f3 WatchSource:0}: Error finding container 067072be037173cd90d748d5ba0421b95fe590f71ef2623d603e47083ecd01f3: Status 404 returned error can't find the container with id 067072be037173cd90d748d5ba0421b95fe590f71ef2623d603e47083ecd01f3 Jun 03 21:42:03.731433 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.731398 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-n7gfg\" (UID: \"793f4175-9c71-42a9-b0f1-3797f4347b4f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:03.731630 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:03.731521 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 21:42:03.731630 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:03.731587 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls podName:793f4175-9c71-42a9-b0f1-3797f4347b4f nodeName:}" failed. No retries permitted until 2026-06-03 21:42:04.731567669 +0000 UTC m=+273.067660930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-n7gfg" (UID: "793f4175-9c71-42a9-b0f1-3797f4347b4f") : secret "samples-operator-tls" not found Jun 03 21:42:03.905063 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:03.905028 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" event={"ID":"3935b29d-8bb0-48c6-93c1-82c2b9b2198a","Type":"ContainerStarted","Data":"067072be037173cd90d748d5ba0421b95fe590f71ef2623d603e47083ecd01f3"} Jun 03 21:42:04.739162 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:04.739120 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-n7gfg\" (UID: \"793f4175-9c71-42a9-b0f1-3797f4347b4f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:04.739548 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:04.739281 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 21:42:04.739548 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:04.739347 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls podName:793f4175-9c71-42a9-b0f1-3797f4347b4f nodeName:}" failed. No retries permitted until 2026-06-03 21:42:06.739331433 +0000 UTC m=+275.075424678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-n7gfg" (UID: "793f4175-9c71-42a9-b0f1-3797f4347b4f") : secret "samples-operator-tls" not found Jun 03 21:42:05.912016 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:05.911929 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" event={"ID":"3935b29d-8bb0-48c6-93c1-82c2b9b2198a","Type":"ContainerStarted","Data":"e9a19ce2a4d9816f2b98784dfa4e0cc6442720fc4d189c41f84f8475f23097e0"} Jun 03 21:42:05.927848 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:05.927788 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" podStartSLOduration=1.059676151 podStartE2EDuration="2.927773987s" totalImagesPullingTime="1.868097836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:05.926230924 +0000 UTC m=+274.262324190" watchObservedRunningTime="2026-06-03 21:42:05.927773987 +0000 UTC m=+274.263867253" Jun 03 21:42:06.756393 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:06.756357 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-n7gfg\" (UID: \"793f4175-9c71-42a9-b0f1-3797f4347b4f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:06.756564 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:06.756469 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 21:42:06.756564 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:06.756521 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls podName:793f4175-9c71-42a9-b0f1-3797f4347b4f nodeName:}" failed. No retries permitted until 2026-06-03 21:42:10.756507717 +0000 UTC m=+279.092600963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-n7gfg" (UID: "793f4175-9c71-42a9-b0f1-3797f4347b4f") : secret "samples-operator-tls" not found Jun 03 21:42:09.387625 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.387596 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-r2rvz"] Jun 03 21:42:09.390661 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.390644 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" Jun 03 21:42:09.393113 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.393093 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 21:42:09.393310 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.393292 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 21:42:09.394163 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.394146 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 21:42:09.394262 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.394172 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 21:42:09.394262 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.394172 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mcbnw\"" Jun 03 21:42:09.397177 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.397158 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-r2rvz"] Jun 03 21:42:09.477800 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.477777 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f244945-f599-466a-b0e5-7c9b8924865e-signing-cabundle\") pod \"service-ca-7d74d578b8-r2rvz\" (UID: \"4f244945-f599-466a-b0e5-7c9b8924865e\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" Jun 03 21:42:09.477911 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.477823 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f244945-f599-466a-b0e5-7c9b8924865e-signing-key\") pod \"service-ca-7d74d578b8-r2rvz\" (UID: \"4f244945-f599-466a-b0e5-7c9b8924865e\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" Jun 03 21:42:09.477911 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.477891 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4cvm\" (UniqueName: \"kubernetes.io/projected/4f244945-f599-466a-b0e5-7c9b8924865e-kube-api-access-f4cvm\") pod \"service-ca-7d74d578b8-r2rvz\" (UID: \"4f244945-f599-466a-b0e5-7c9b8924865e\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" Jun 03 21:42:09.578877 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.578853 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4cvm\" (UniqueName: \"kubernetes.io/projected/4f244945-f599-466a-b0e5-7c9b8924865e-kube-api-access-f4cvm\") pod \"service-ca-7d74d578b8-r2rvz\" (UID: \"4f244945-f599-466a-b0e5-7c9b8924865e\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" Jun 03 21:42:09.578972 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.578893 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f244945-f599-466a-b0e5-7c9b8924865e-signing-cabundle\") pod \"service-ca-7d74d578b8-r2rvz\" (UID: \"4f244945-f599-466a-b0e5-7c9b8924865e\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" Jun 03 21:42:09.578972 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.578932 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f244945-f599-466a-b0e5-7c9b8924865e-signing-key\") pod \"service-ca-7d74d578b8-r2rvz\" (UID: \"4f244945-f599-466a-b0e5-7c9b8924865e\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" Jun 03 21:42:09.579485 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.579467 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f244945-f599-466a-b0e5-7c9b8924865e-signing-cabundle\") pod \"service-ca-7d74d578b8-r2rvz\" (UID: \"4f244945-f599-466a-b0e5-7c9b8924865e\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" Jun 03 21:42:09.581364 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.581342 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f244945-f599-466a-b0e5-7c9b8924865e-signing-key\") pod \"service-ca-7d74d578b8-r2rvz\" (UID: \"4f244945-f599-466a-b0e5-7c9b8924865e\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" Jun 03 21:42:09.586909 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.586891 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4cvm\" (UniqueName: \"kubernetes.io/projected/4f244945-f599-466a-b0e5-7c9b8924865e-kube-api-access-f4cvm\") pod \"service-ca-7d74d578b8-r2rvz\" (UID: \"4f244945-f599-466a-b0e5-7c9b8924865e\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" Jun 03 21:42:09.699408 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.699390 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" Jun 03 21:42:09.815607 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.815584 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-r2rvz"] Jun 03 21:42:09.817965 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:09.817940 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f244945_f599_466a_b0e5_7c9b8924865e.slice/crio-75a7edec087b59dcea8d909e93587b2cc2901b56f263f534c1d7b19b93c1ec75 WatchSource:0}: Error finding container 75a7edec087b59dcea8d909e93587b2cc2901b56f263f534c1d7b19b93c1ec75: Status 404 returned error can't find the container with id 75a7edec087b59dcea8d909e93587b2cc2901b56f263f534c1d7b19b93c1ec75 Jun 03 21:42:09.922411 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:09.922382 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" event={"ID":"4f244945-f599-466a-b0e5-7c9b8924865e","Type":"ContainerStarted","Data":"75a7edec087b59dcea8d909e93587b2cc2901b56f263f534c1d7b19b93c1ec75"} Jun 03 21:42:10.011542 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:10.011481 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pdbgn_66677f28-c099-4884-a43f-30a1d25d2a1f/dns-node-resolver/0.log" Jun 03 21:42:10.789743 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:10.789704 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-n7gfg\" (UID: \"793f4175-9c71-42a9-b0f1-3797f4347b4f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:10.790100 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:10.789880 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 21:42:10.790100 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:10.789954 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls podName:793f4175-9c71-42a9-b0f1-3797f4347b4f nodeName:}" failed. No retries permitted until 2026-06-03 21:42:18.789937994 +0000 UTC m=+287.126031239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-n7gfg" (UID: "793f4175-9c71-42a9-b0f1-3797f4347b4f") : secret "samples-operator-tls" not found Jun 03 21:42:11.011467 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:11.011440 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-59744_b9009d27-4ec0-4368-9eaa-568a95fd3b9d/node-ca/0.log" Jun 03 21:42:11.810955 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:11.810897 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lxll4_ac0b00dd-b1a9-437c-a081-6bc90a267324/serve-healthcheck-canary/0.log" Jun 03 21:42:11.930415 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:11.930375 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" event={"ID":"4f244945-f599-466a-b0e5-7c9b8924865e","Type":"ContainerStarted","Data":"f72e71cfc79b25b242a3f1ed2dedd1e6f879672240919721d72f7d6a6ea338b3"} Jun 03 21:42:11.947942 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:11.947893 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-r2rvz" podStartSLOduration=1.024961572 podStartE2EDuration="2.947873364s" totalImagesPullingTime="1.922911792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:11.946248329 +0000 UTC m=+280.282341595" watchObservedRunningTime="2026-06-03 21:42:11.947873364 +0000 UTC m=+280.283966630" Jun 03 21:42:12.638198 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:12.638153 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7jrlc" podUID="e35196ec-35b9-4f12-9060-008ff886a985" Jun 03 21:42:12.638198 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:12.638192 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" podUID="2c00e098-f253-4e47-8f46-853ad399fe27" Jun 03 21:42:12.812119 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:12.812091 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb_3935b29d-8bb0-48c6-93c1-82c2b9b2198a/kube-storage-version-migrator-operator/0.log" Jun 03 21:42:12.937172 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:12.937145 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:42:12.937354 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:12.937335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7jrlc" Jun 03 21:42:15.929305 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:15.929273 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:42:15.929305 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:15.929316 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") pod \"image-registry-7c48b9b7f7-zssj2\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:42:15.929854 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:15.929415 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 21:42:15.929854 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:15.929428 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c48b9b7f7-zssj2: secret "image-registry-tls" not found Jun 03 21:42:15.929854 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:15.929482 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls podName:2c00e098-f253-4e47-8f46-853ad399fe27 nodeName:}" failed. No retries permitted until 2026-06-03 21:44:17.929469765 +0000 UTC m=+406.265563011 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls") pod "image-registry-7c48b9b7f7-zssj2" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27") : secret "image-registry-tls" not found Jun 03 21:42:15.931600 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:15.931573 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35196ec-35b9-4f12-9060-008ff886a985-metrics-tls\") pod \"dns-default-7jrlc\" (UID: \"e35196ec-35b9-4f12-9060-008ff886a985\") " pod="openshift-dns/dns-default-7jrlc" Jun 03 21:42:15.940401 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:15.940384 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kqdlc\"" Jun 03 21:42:15.948788 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:15.948766 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7jrlc" Jun 03 21:42:16.066668 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:16.066635 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7jrlc"] Jun 03 21:42:16.069047 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:16.069018 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35196ec_35b9_4f12_9060_008ff886a985.slice/crio-8d79cc1f0e04784a7fbcb3f4c31a499e812948a970c9156d591292dd300676fe WatchSource:0}: Error finding container 8d79cc1f0e04784a7fbcb3f4c31a499e812948a970c9156d591292dd300676fe: Status 404 returned error can't find the container with id 8d79cc1f0e04784a7fbcb3f4c31a499e812948a970c9156d591292dd300676fe Jun 03 21:42:16.949744 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:16.949672 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jrlc" event={"ID":"e35196ec-35b9-4f12-9060-008ff886a985","Type":"ContainerStarted","Data":"8d79cc1f0e04784a7fbcb3f4c31a499e812948a970c9156d591292dd300676fe"} Jun 03 21:42:18.852299 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:18.852262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-n7gfg\" (UID: \"793f4175-9c71-42a9-b0f1-3797f4347b4f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:18.854704 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:18.854663 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/793f4175-9c71-42a9-b0f1-3797f4347b4f-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-n7gfg\" (UID: \"793f4175-9c71-42a9-b0f1-3797f4347b4f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:18.933167 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:18.933129 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" Jun 03 21:42:18.958615 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:18.958560 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jrlc" event={"ID":"e35196ec-35b9-4f12-9060-008ff886a985","Type":"ContainerStarted","Data":"36aa908cb0bab7b9421750604a613e0da86b513f5138f5017c400365b05624af"} Jun 03 21:42:18.958743 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:18.958620 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jrlc" event={"ID":"e35196ec-35b9-4f12-9060-008ff886a985","Type":"ContainerStarted","Data":"a1dd3dd575bb4348f7e4a104da49c478f6881a7a6168bb4d3202e02196123e87"} Jun 03 21:42:18.958743 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:18.958698 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7jrlc" Jun 03 21:42:18.976146 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:18.976096 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7jrlc" podStartSLOduration=251.104107712 podStartE2EDuration="4m12.976080921s" totalImagesPullingTime="1.871973209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:18.975003915 +0000 UTC m=+287.311097195" watchObservedRunningTime="2026-06-03 21:42:18.976080921 +0000 UTC m=+287.312174187" Jun 03 21:42:19.067321 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:19.067295 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg"] Jun 03 21:42:19.963669 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:19.963611 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" event={"ID":"793f4175-9c71-42a9-b0f1-3797f4347b4f","Type":"ContainerStarted","Data":"d3c077901d49c6ac1384177cde7c797f2ecac89e058a464be814b40ba75ce231"} Jun 03 21:42:21.972311 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:21.972274 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" event={"ID":"793f4175-9c71-42a9-b0f1-3797f4347b4f","Type":"ContainerStarted","Data":"40ac3292f99e3c82b588c1d95944bdd5a0438af258b6e4fbbbce696456ead1fd"} Jun 03 21:42:21.972761 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:21.972348 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" event={"ID":"793f4175-9c71-42a9-b0f1-3797f4347b4f","Type":"ContainerStarted","Data":"cb6f85d8bd1582decc48750ede5ff38bc4a2fcc3fe606404b96fab39e95792f2"} Jun 03 21:42:21.987938 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:21.987895 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-n7gfg" podStartSLOduration=16.858734557 podStartE2EDuration="18.987880922s" totalImagesPullingTime="2.129146365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:21.987198646 +0000 UTC m=+290.323291915" watchObservedRunningTime="2026-06-03 21:42:21.987880922 +0000 UTC m=+290.323974167" Jun 03 21:42:23.162371 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:23.162335 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-v8b9n" podUID="733dc558-703e-4ee8-b7e3-5c3d39841574" Jun 03 21:42:28.965921 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:28.965893 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7jrlc" Jun 03 21:42:30.556753 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.556724 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-56b467f5ff-lnqmj"] Jun 03 21:42:30.560051 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.560030 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-lnqmj" Jun 03 21:42:30.562862 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.562824 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 21:42:30.563023 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.562892 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-z6w2j\"" Jun 03 21:42:30.563181 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.562960 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 21:42:30.573521 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.573500 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-lnqmj"] Jun 03 21:42:30.587740 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.587719 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gbtdm"] Jun 03 21:42:30.590641 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.590627 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.593200 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.593181 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 21:42:30.593487 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.593471 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 21:42:30.593562 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.593472 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 21:42:30.593752 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.593736 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 21:42:30.593913 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.593898 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sh79x\"" Jun 03 21:42:30.605984 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.605965 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gbtdm"] Jun 03 21:42:30.630302 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.630278 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfa0dad1-134e-47eb-8386-7b7bdf221925-crio-socket\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.630390 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.630315 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfa0dad1-134e-47eb-8386-7b7bdf221925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.630390 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.630350 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfa0dad1-134e-47eb-8386-7b7bdf221925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.630390 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.630374 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfa0dad1-134e-47eb-8386-7b7bdf221925-data-volume\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.630496 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.630393 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tth6t\" (UniqueName: \"kubernetes.io/projected/cfa0dad1-134e-47eb-8386-7b7bdf221925-kube-api-access-tth6t\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.731259 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.731232 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfa0dad1-134e-47eb-8386-7b7bdf221925-data-volume\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.731344 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.731273 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tth6t\" (UniqueName: \"kubernetes.io/projected/cfa0dad1-134e-47eb-8386-7b7bdf221925-kube-api-access-tth6t\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.731344 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.731329 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz9f9\" (UniqueName: \"kubernetes.io/projected/4672dc87-b35a-45b2-b9b7-97022a1ed37b-kube-api-access-dz9f9\") pod \"downloads-56b467f5ff-lnqmj\" (UID: \"4672dc87-b35a-45b2-b9b7-97022a1ed37b\") " pod="openshift-console/downloads-56b467f5ff-lnqmj" Jun 03 21:42:30.731434 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.731382 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfa0dad1-134e-47eb-8386-7b7bdf221925-crio-socket\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.731434 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.731420 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfa0dad1-134e-47eb-8386-7b7bdf221925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.731593 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.731448 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfa0dad1-134e-47eb-8386-7b7bdf221925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.731593 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.731522 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfa0dad1-134e-47eb-8386-7b7bdf221925-crio-socket\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.731693 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.731640 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfa0dad1-134e-47eb-8386-7b7bdf221925-data-volume\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.731961 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.731943 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfa0dad1-134e-47eb-8386-7b7bdf221925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.733599 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.733574 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfa0dad1-134e-47eb-8386-7b7bdf221925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.739695 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.739678 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tth6t\" (UniqueName: \"kubernetes.io/projected/cfa0dad1-134e-47eb-8386-7b7bdf221925-kube-api-access-tth6t\") pod \"insights-runtime-extractor-gbtdm\" (UID: \"cfa0dad1-134e-47eb-8386-7b7bdf221925\") " pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.832640 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.832578 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz9f9\" (UniqueName: \"kubernetes.io/projected/4672dc87-b35a-45b2-b9b7-97022a1ed37b-kube-api-access-dz9f9\") pod \"downloads-56b467f5ff-lnqmj\" (UID: \"4672dc87-b35a-45b2-b9b7-97022a1ed37b\") " pod="openshift-console/downloads-56b467f5ff-lnqmj" Jun 03 21:42:30.839846 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.839811 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz9f9\" (UniqueName: \"kubernetes.io/projected/4672dc87-b35a-45b2-b9b7-97022a1ed37b-kube-api-access-dz9f9\") pod \"downloads-56b467f5ff-lnqmj\" (UID: \"4672dc87-b35a-45b2-b9b7-97022a1ed37b\") " pod="openshift-console/downloads-56b467f5ff-lnqmj" Jun 03 21:42:30.869136 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.869107 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-lnqmj" Jun 03 21:42:30.898638 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.898615 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gbtdm" Jun 03 21:42:30.996037 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:30.996010 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-lnqmj"] Jun 03 21:42:30.999279 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:30.999246 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4672dc87_b35a_45b2_b9b7_97022a1ed37b.slice/crio-0774bfaeece22a26979e17bb795d3446ae1b58ff2e7cb0a67cdeeb3d06cb2098 WatchSource:0}: Error finding container 0774bfaeece22a26979e17bb795d3446ae1b58ff2e7cb0a67cdeeb3d06cb2098: Status 404 returned error can't find the container with id 0774bfaeece22a26979e17bb795d3446ae1b58ff2e7cb0a67cdeeb3d06cb2098 Jun 03 21:42:31.021400 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:31.021376 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gbtdm"] Jun 03 21:42:31.023881 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:31.023860 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa0dad1_134e_47eb_8386_7b7bdf221925.slice/crio-bf675b6969783a1c3742b7b34a5103b3462e66d2e8ee70ec13bd19ad592e599d WatchSource:0}: Error finding container bf675b6969783a1c3742b7b34a5103b3462e66d2e8ee70ec13bd19ad592e599d: Status 404 returned error can't find the container with id bf675b6969783a1c3742b7b34a5103b3462e66d2e8ee70ec13bd19ad592e599d Jun 03 21:42:32.008560 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:32.008527 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gbtdm" event={"ID":"cfa0dad1-134e-47eb-8386-7b7bdf221925","Type":"ContainerStarted","Data":"4c14ed4e0d88707048cc460340330ad9a79361e140f90dd7b4663ba170d96659"} Jun 03 21:42:32.008964 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:32.008621 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gbtdm" event={"ID":"cfa0dad1-134e-47eb-8386-7b7bdf221925","Type":"ContainerStarted","Data":"6cee2f534106b8d88d10ef7e7241d5268a2be6d0f23e536678030da8f8443136"} Jun 03 21:42:32.008964 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:32.008655 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gbtdm" event={"ID":"cfa0dad1-134e-47eb-8386-7b7bdf221925","Type":"ContainerStarted","Data":"bf675b6969783a1c3742b7b34a5103b3462e66d2e8ee70ec13bd19ad592e599d"} Jun 03 21:42:32.009861 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:32.009823 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-lnqmj" event={"ID":"4672dc87-b35a-45b2-b9b7-97022a1ed37b","Type":"ContainerStarted","Data":"0774bfaeece22a26979e17bb795d3446ae1b58ff2e7cb0a67cdeeb3d06cb2098"} Jun 03 21:42:32.102553 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:32.102528 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 21:42:32.103141 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:32.103115 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 21:42:32.109559 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:32.109539 2554 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 21:42:34.018443 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:34.018398 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gbtdm" event={"ID":"cfa0dad1-134e-47eb-8386-7b7bdf221925","Type":"ContainerStarted","Data":"0862365fda2196fa7fef28fdcc2ec8d97e7d5bdd1bb82ff9730dbc74ba277e5a"} Jun 03 21:42:34.039422 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:34.039368 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gbtdm" podStartSLOduration=1.531266059 podStartE2EDuration="4.039347527s" totalImagesPullingTime="2.508081468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:42:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:34.03799985 +0000 UTC m=+302.374093124" watchObservedRunningTime="2026-06-03 21:42:34.039347527 +0000 UTC m=+302.375440800" Jun 03 21:42:34.161849 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:34.161804 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:42:38.251089 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:38.251056 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq"] Jun 03 21:42:38.255108 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:38.255084 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" Jun 03 21:42:38.257667 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:38.257645 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 21:42:38.257805 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:38.257687 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cvptq\"" Jun 03 21:42:38.265624 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:38.265566 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq"] Jun 03 21:42:38.286275 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:38.286250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c6cbf0d-4744-439b-9977-7c9a801768c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xjsfq\" (UID: \"3c6cbf0d-4744-439b-9977-7c9a801768c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" Jun 03 21:42:38.386863 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:38.386820 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c6cbf0d-4744-439b-9977-7c9a801768c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xjsfq\" (UID: \"3c6cbf0d-4744-439b-9977-7c9a801768c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" Jun 03 21:42:38.387002 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:38.386974 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 03 21:42:38.387046 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:38.387033 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c6cbf0d-4744-439b-9977-7c9a801768c7-tls-certificates podName:3c6cbf0d-4744-439b-9977-7c9a801768c7 nodeName:}" failed. No retries permitted until 2026-06-03 21:42:38.887018101 +0000 UTC m=+307.223111346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3c6cbf0d-4744-439b-9977-7c9a801768c7-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-xjsfq" (UID: "3c6cbf0d-4744-439b-9977-7c9a801768c7") : secret "prometheus-operator-admission-webhook-tls" not found Jun 03 21:42:38.891005 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:38.890967 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c6cbf0d-4744-439b-9977-7c9a801768c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xjsfq\" (UID: \"3c6cbf0d-4744-439b-9977-7c9a801768c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" Jun 03 21:42:38.891193 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:38.891134 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 03 21:42:38.891247 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:38.891214 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c6cbf0d-4744-439b-9977-7c9a801768c7-tls-certificates podName:3c6cbf0d-4744-439b-9977-7c9a801768c7 nodeName:}" failed. No retries permitted until 2026-06-03 21:42:39.891194493 +0000 UTC m=+308.227287746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3c6cbf0d-4744-439b-9977-7c9a801768c7-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-xjsfq" (UID: "3c6cbf0d-4744-439b-9977-7c9a801768c7") : secret "prometheus-operator-admission-webhook-tls" not found Jun 03 21:42:39.897996 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:39.897957 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c6cbf0d-4744-439b-9977-7c9a801768c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xjsfq\" (UID: \"3c6cbf0d-4744-439b-9977-7c9a801768c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" Jun 03 21:42:39.900733 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:39.900702 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c6cbf0d-4744-439b-9977-7c9a801768c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-xjsfq\" (UID: \"3c6cbf0d-4744-439b-9977-7c9a801768c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" Jun 03 21:42:40.067639 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:40.067607 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" Jun 03 21:42:40.186924 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:40.186899 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq"] Jun 03 21:42:40.189883 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:40.189856 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6cbf0d_4744_439b_9977_7c9a801768c7.slice/crio-899d093aebfd0c0a28a4b47a84afdc84adf673e1aa72d0e2021b8c9d7e7133dc WatchSource:0}: Error finding container 899d093aebfd0c0a28a4b47a84afdc84adf673e1aa72d0e2021b8c9d7e7133dc: Status 404 returned error can't find the container with id 899d093aebfd0c0a28a4b47a84afdc84adf673e1aa72d0e2021b8c9d7e7133dc Jun 03 21:42:40.192282 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:40.192260 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:42:41.045311 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:41.045278 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" event={"ID":"3c6cbf0d-4744-439b-9977-7c9a801768c7","Type":"ContainerStarted","Data":"899d093aebfd0c0a28a4b47a84afdc84adf673e1aa72d0e2021b8c9d7e7133dc"} Jun 03 21:42:42.049917 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.049876 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" event={"ID":"3c6cbf0d-4744-439b-9977-7c9a801768c7","Type":"ContainerStarted","Data":"d226ffcf9170a9fb841e29c990d25e24bfa10e5341d6e096ab2e5ecf8f6e41a5"} Jun 03 21:42:42.050378 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.050106 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" Jun 03 21:42:42.055389 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.055355 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" Jun 03 21:42:42.064222 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.064180 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-xjsfq" podStartSLOduration=3.0695937620000002 podStartE2EDuration="4.064167134s" totalImagesPullingTime="994.573372ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:42.063504552 +0000 UTC m=+310.399597841" watchObservedRunningTime="2026-06-03 21:42:42.064167134 +0000 UTC m=+310.400260379" Jun 03 21:42:42.301434 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.301356 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-2plcn"] Jun 03 21:42:42.303995 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.303971 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.307730 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.307707 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 21:42:42.307869 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.307780 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 21:42:42.308243 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.308010 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 21:42:42.308243 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.308051 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 21:42:42.308243 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.308057 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 21:42:42.308243 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.308017 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dtqqq\"" Jun 03 21:42:42.312396 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.312373 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-2plcn"] Jun 03 21:42:42.316761 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.316736 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/73ccdd62-56a1-449f-b6c8-36cfcb26938c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.316873 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.316776 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73ccdd62-56a1-449f-b6c8-36cfcb26938c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.316873 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.316795 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pn84\" (UniqueName: \"kubernetes.io/projected/73ccdd62-56a1-449f-b6c8-36cfcb26938c-kube-api-access-5pn84\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.316967 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.316870 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73ccdd62-56a1-449f-b6c8-36cfcb26938c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.417806 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.417760 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/73ccdd62-56a1-449f-b6c8-36cfcb26938c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.417988 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.417893 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73ccdd62-56a1-449f-b6c8-36cfcb26938c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.417988 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.417929 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pn84\" (UniqueName: \"kubernetes.io/projected/73ccdd62-56a1-449f-b6c8-36cfcb26938c-kube-api-access-5pn84\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.417988 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.417958 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73ccdd62-56a1-449f-b6c8-36cfcb26938c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.418648 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.418622 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73ccdd62-56a1-449f-b6c8-36cfcb26938c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.420597 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.420563 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73ccdd62-56a1-449f-b6c8-36cfcb26938c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.420706 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.420605 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/73ccdd62-56a1-449f-b6c8-36cfcb26938c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.426276 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.426232 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pn84\" (UniqueName: \"kubernetes.io/projected/73ccdd62-56a1-449f-b6c8-36cfcb26938c-kube-api-access-5pn84\") pod \"prometheus-operator-7f7d445d84-2plcn\" (UID: \"73ccdd62-56a1-449f-b6c8-36cfcb26938c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:42.614862 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:42.614762 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" Jun 03 21:42:48.810998 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:48.810965 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-2plcn"] Jun 03 21:42:48.813394 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:48.813366 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ccdd62_56a1_449f_b6c8_36cfcb26938c.slice/crio-6d092a7bc0ca61b90611071303f07248a4f9d73639311f9d2081c68fae37062d WatchSource:0}: Error finding container 6d092a7bc0ca61b90611071303f07248a4f9d73639311f9d2081c68fae37062d: Status 404 returned error can't find the container with id 6d092a7bc0ca61b90611071303f07248a4f9d73639311f9d2081c68fae37062d Jun 03 21:42:49.075038 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:49.074859 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-lnqmj" event={"ID":"4672dc87-b35a-45b2-b9b7-97022a1ed37b","Type":"ContainerStarted","Data":"860ad84e1d10e1c08e65c818393bf669fc9fef8bee3ab33b49e9d2bacb7c62e0"} Jun 03 21:42:49.075378 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:49.075320 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-56b467f5ff-lnqmj" Jun 03 21:42:49.076401 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:49.076363 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" event={"ID":"73ccdd62-56a1-449f-b6c8-36cfcb26938c","Type":"ContainerStarted","Data":"6d092a7bc0ca61b90611071303f07248a4f9d73639311f9d2081c68fae37062d"} Jun 03 21:42:49.090119 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:49.090095 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-56b467f5ff-lnqmj" Jun 03 21:42:49.092160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:49.092118 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-56b467f5ff-lnqmj" podStartSLOduration=1.319087965 podStartE2EDuration="19.092104845s" totalImagesPullingTime="17.77301688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:49.090804082 +0000 UTC m=+317.426897351" watchObservedRunningTime="2026-06-03 21:42:49.092104845 +0000 UTC m=+317.428198156" Jun 03 21:42:51.090094 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:51.090062 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" event={"ID":"73ccdd62-56a1-449f-b6c8-36cfcb26938c","Type":"ContainerStarted","Data":"071ee6dc9dc8cd84b5291e325d396c3e952117dbbe16e43cb33100a0b179448b"} Jun 03 21:42:51.090564 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:51.090124 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" event={"ID":"73ccdd62-56a1-449f-b6c8-36cfcb26938c","Type":"ContainerStarted","Data":"c61fa25ccf2c8661d0f1ad5e8da34cd549866c29758c418405b793107e3d3d5a"} Jun 03 21:42:51.105967 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:51.105921 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-2plcn" podStartSLOduration=7.782039479 podStartE2EDuration="9.105905922s" totalImagesPullingTime="1.323866443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:51.104818222 +0000 UTC m=+319.440911517" watchObservedRunningTime="2026-06-03 21:42:51.105905922 +0000 UTC m=+319.441999192" Jun 03 21:42:52.630500 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.630453 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr"] Jun 03 21:42:52.664991 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.664965 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.666057 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.666030 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx"] Jun 03 21:42:52.669723 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.669701 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 21:42:52.669994 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.669969 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 21:42:52.670340 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.670319 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qb5xm\"" Jun 03 21:42:52.688002 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.687981 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-prcsx"] Jun 03 21:42:52.688371 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.688348 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.691068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.691051 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 21:42:52.691498 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.691479 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 21:42:52.691659 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.691636 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 21:42:52.691864 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.691821 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hk6sj\"" Jun 03 21:42:52.699139 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.699115 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nxgr\" (UniqueName: \"kubernetes.io/projected/139fe141-3fcc-48fd-915d-baf64a26a389-kube-api-access-8nxgr\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.710442 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.699242 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/139fe141-3fcc-48fd-915d-baf64a26a389-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.710442 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.699313 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/139fe141-3fcc-48fd-915d-baf64a26a389-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.710442 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.699340 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/139fe141-3fcc-48fd-915d-baf64a26a389-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.710442 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.709014 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr"] Jun 03 21:42:52.710442 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.709063 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx"] Jun 03 21:42:52.710442 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.709138 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.711814 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.711798 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q2jfc\"" Jun 03 21:42:52.712579 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.712530 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 21:42:52.712717 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.712447 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 21:42:52.712813 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.712464 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 21:42:52.716048 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.716029 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c48b9b7f7-zssj2"] Jun 03 21:42:52.716372 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:52.716351 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" podUID="2c00e098-f253-4e47-8f46-853ad399fe27" Jun 03 21:42:52.799659 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.799629 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-wtmp\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.799786 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.799670 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e751bb6-b586-4037-b3de-0ab2d87887bc-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.799786 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.799733 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nxgr\" (UniqueName: \"kubernetes.io/projected/139fe141-3fcc-48fd-915d-baf64a26a389-kube-api-access-8nxgr\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.799786 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.799760 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/139fe141-3fcc-48fd-915d-baf64a26a389-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.799988 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.799789 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-accelerators-collector-config\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.799988 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.799875 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c81632d6-f775-4420-9569-c7c890c7c50d-sys\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.799988 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.799914 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c81632d6-f775-4420-9569-c7c890c7c50d-metrics-client-ca\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.799988 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.799977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.800191 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.800007 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e751bb6-b586-4037-b3de-0ab2d87887bc-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.800191 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.800051 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-tls\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.800191 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.800107 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/139fe141-3fcc-48fd-915d-baf64a26a389-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.800191 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.800144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/139fe141-3fcc-48fd-915d-baf64a26a389-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.800191 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.800183 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.800465 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.800212 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c81632d6-f775-4420-9569-c7c890c7c50d-root\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.800465 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.800238 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwdtq\" (UniqueName: \"kubernetes.io/projected/c81632d6-f775-4420-9569-c7c890c7c50d-kube-api-access-rwdtq\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.800465 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.800269 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.800465 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.800302 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.800465 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.800328 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48nbp\" (UniqueName: \"kubernetes.io/projected/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-api-access-48nbp\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.800465 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.800360 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-textfile\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.801062 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.801042 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/139fe141-3fcc-48fd-915d-baf64a26a389-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.803071 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.803049 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/139fe141-3fcc-48fd-915d-baf64a26a389-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.803626 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.803592 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/139fe141-3fcc-48fd-915d-baf64a26a389-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.814053 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.814029 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nxgr\" (UniqueName: \"kubernetes.io/projected/139fe141-3fcc-48fd-915d-baf64a26a389-kube-api-access-8nxgr\") pod \"openshift-state-metrics-65f78d5c66-67kgr\" (UID: \"139fe141-3fcc-48fd-915d-baf64a26a389\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:52.901625 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.901625 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901583 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c81632d6-f775-4420-9569-c7c890c7c50d-root\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.901625 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901611 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwdtq\" (UniqueName: \"kubernetes.io/projected/c81632d6-f775-4420-9569-c7c890c7c50d-kube-api-access-rwdtq\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.901913 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901641 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.901913 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.901913 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48nbp\" (UniqueName: \"kubernetes.io/projected/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-api-access-48nbp\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.901913 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901735 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-textfile\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.901913 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-wtmp\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.901913 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901795 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e751bb6-b586-4037-b3de-0ab2d87887bc-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.901913 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-accelerators-collector-config\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.901913 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901899 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c81632d6-f775-4420-9569-c7c890c7c50d-sys\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.902294 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901923 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c81632d6-f775-4420-9569-c7c890c7c50d-metrics-client-ca\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.902294 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.901977 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.902294 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.902005 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e751bb6-b586-4037-b3de-0ab2d87887bc-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.902294 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.902035 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-tls\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.902294 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:52.902187 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 21:42:52.902294 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.902230 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c81632d6-f775-4420-9569-c7c890c7c50d-root\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.902294 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:42:52.902248 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-tls podName:c81632d6-f775-4420-9569-c7c890c7c50d nodeName:}" failed. No retries permitted until 2026-06-03 21:42:53.402229351 +0000 UTC m=+321.738322617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-tls") pod "node-exporter-prcsx" (UID: "c81632d6-f775-4420-9569-c7c890c7c50d") : secret "node-exporter-tls" not found Jun 03 21:42:52.903376 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.903274 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.903376 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.903311 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c81632d6-f775-4420-9569-c7c890c7c50d-sys\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.903376 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.902184 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-wtmp\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.903586 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.903431 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e751bb6-b586-4037-b3de-0ab2d87887bc-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.903961 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.903749 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e751bb6-b586-4037-b3de-0ab2d87887bc-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.903961 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.903928 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-textfile\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.906157 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.906124 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.907196 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.906785 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.908297 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.908274 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.910448 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.910401 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-accelerators-collector-config\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.910448 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.910411 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c81632d6-f775-4420-9569-c7c890c7c50d-metrics-client-ca\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.917078 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.917031 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwdtq\" (UniqueName: \"kubernetes.io/projected/c81632d6-f775-4420-9569-c7c890c7c50d-kube-api-access-rwdtq\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:52.918780 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.918760 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48nbp\" (UniqueName: \"kubernetes.io/projected/7e751bb6-b586-4037-b3de-0ab2d87887bc-kube-api-access-48nbp\") pod \"kube-state-metrics-79fb7d47d4-4vsrx\" (UID: \"7e751bb6-b586-4037-b3de-0ab2d87887bc\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:52.979575 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:52.979548 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" Jun 03 21:42:53.001428 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.001400 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" Jun 03 21:42:53.098607 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.098572 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:42:53.122601 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.122312 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:42:53.176228 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.176122 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr"] Jun 03 21:42:53.179138 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:53.179108 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139fe141_3fcc_48fd_915d_baf64a26a389.slice/crio-a52a6bbdcd138547593e9a03bb3b9d8c2f92ee4cafc188193f9b34e0b4f07baf WatchSource:0}: Error finding container a52a6bbdcd138547593e9a03bb3b9d8c2f92ee4cafc188193f9b34e0b4f07baf: Status 404 returned error can't find the container with id a52a6bbdcd138547593e9a03bb3b9d8c2f92ee4cafc188193f9b34e0b4f07baf Jun 03 21:42:53.197660 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.197607 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx"] Jun 03 21:42:53.200083 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:53.200053 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e751bb6_b586_4037_b3de_0ab2d87887bc.slice/crio-c5aadd11626e2ebee6221228eb44cec25a872ae516235d81d2b2932ecc94f43e WatchSource:0}: Error finding container c5aadd11626e2ebee6221228eb44cec25a872ae516235d81d2b2932ecc94f43e: Status 404 returned error can't find the container with id c5aadd11626e2ebee6221228eb44cec25a872ae516235d81d2b2932ecc94f43e Jun 03 21:42:53.206382 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.206356 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-trusted-ca\") pod \"2c00e098-f253-4e47-8f46-853ad399fe27\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " Jun 03 21:42:53.206489 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.206398 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c00e098-f253-4e47-8f46-853ad399fe27-ca-trust-extracted\") pod \"2c00e098-f253-4e47-8f46-853ad399fe27\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " Jun 03 21:42:53.206489 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.206431 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-installation-pull-secrets\") pod \"2c00e098-f253-4e47-8f46-853ad399fe27\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " Jun 03 21:42:53.206489 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.206482 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgc9s\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-kube-api-access-qgc9s\") pod \"2c00e098-f253-4e47-8f46-853ad399fe27\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " Jun 03 21:42:53.206643 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.206521 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-registry-certificates\") pod \"2c00e098-f253-4e47-8f46-853ad399fe27\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " Jun 03 21:42:53.206643 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.206550 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-bound-sa-token\") pod \"2c00e098-f253-4e47-8f46-853ad399fe27\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " Jun 03 21:42:53.206643 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.206581 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-image-registry-private-configuration\") pod \"2c00e098-f253-4e47-8f46-853ad399fe27\" (UID: \"2c00e098-f253-4e47-8f46-853ad399fe27\") " Jun 03 21:42:53.207544 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.207197 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c00e098-f253-4e47-8f46-853ad399fe27-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2c00e098-f253-4e47-8f46-853ad399fe27" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 21:42:53.207544 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.207461 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2c00e098-f253-4e47-8f46-853ad399fe27" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:42:53.207743 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.207724 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2c00e098-f253-4e47-8f46-853ad399fe27" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:42:53.210094 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.210068 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-kube-api-access-qgc9s" (OuterVolumeSpecName: "kube-api-access-qgc9s") pod "2c00e098-f253-4e47-8f46-853ad399fe27" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27"). InnerVolumeSpecName "kube-api-access-qgc9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:42:53.210195 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.210138 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2c00e098-f253-4e47-8f46-853ad399fe27" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:42:53.210286 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.210265 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2c00e098-f253-4e47-8f46-853ad399fe27" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:42:53.211615 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.211593 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2c00e098-f253-4e47-8f46-853ad399fe27" (UID: "2c00e098-f253-4e47-8f46-853ad399fe27"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:42:53.307458 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.307414 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-installation-pull-secrets\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:42:53.307458 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.307446 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgc9s\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-kube-api-access-qgc9s\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:42:53.307458 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.307459 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-registry-certificates\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:42:53.307644 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.307467 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-bound-sa-token\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:42:53.307644 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.307478 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c00e098-f253-4e47-8f46-853ad399fe27-image-registry-private-configuration\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:42:53.307644 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.307490 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c00e098-f253-4e47-8f46-853ad399fe27-trusted-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:42:53.307644 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.307502 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c00e098-f253-4e47-8f46-853ad399fe27-ca-trust-extracted\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:42:53.408311 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.408280 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-tls\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:53.410603 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.410576 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c81632d6-f775-4420-9569-c7c890c7c50d-node-exporter-tls\") pod \"node-exporter-prcsx\" (UID: \"c81632d6-f775-4420-9569-c7c890c7c50d\") " pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:53.620822 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:53.620788 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-prcsx" Jun 03 21:42:53.648287 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:53.648257 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81632d6_f775_4420_9569_c7c890c7c50d.slice/crio-873c45dc68a0e23d6439068ca68c9092541f2e54f7d57140ffa6355b5dd75f98 WatchSource:0}: Error finding container 873c45dc68a0e23d6439068ca68c9092541f2e54f7d57140ffa6355b5dd75f98: Status 404 returned error can't find the container with id 873c45dc68a0e23d6439068ca68c9092541f2e54f7d57140ffa6355b5dd75f98 Jun 03 21:42:54.110904 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.110782 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prcsx" event={"ID":"c81632d6-f775-4420-9569-c7c890c7c50d","Type":"ContainerStarted","Data":"873c45dc68a0e23d6439068ca68c9092541f2e54f7d57140ffa6355b5dd75f98"} Jun 03 21:42:54.112996 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.112870 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" event={"ID":"7e751bb6-b586-4037-b3de-0ab2d87887bc","Type":"ContainerStarted","Data":"c5aadd11626e2ebee6221228eb44cec25a872ae516235d81d2b2932ecc94f43e"} Jun 03 21:42:54.116736 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.116711 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c48b9b7f7-zssj2" Jun 03 21:42:54.119186 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.118882 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" event={"ID":"139fe141-3fcc-48fd-915d-baf64a26a389","Type":"ContainerStarted","Data":"12a86212299ef0bbea8b5ac4d11fe05584f580a2d484680c383efebd86fd5714"} Jun 03 21:42:54.119186 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.118933 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" event={"ID":"139fe141-3fcc-48fd-915d-baf64a26a389","Type":"ContainerStarted","Data":"917a03dd3811f9ba1ea629298b4dd52a7239ebc3d9b7cc171812b0f7c8412f51"} Jun 03 21:42:54.119186 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.118962 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" event={"ID":"139fe141-3fcc-48fd-915d-baf64a26a389","Type":"ContainerStarted","Data":"a52a6bbdcd138547593e9a03bb3b9d8c2f92ee4cafc188193f9b34e0b4f07baf"} Jun 03 21:42:54.152101 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.152049 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c48b9b7f7-zssj2"] Jun 03 21:42:54.157094 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.157048 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c48b9b7f7-zssj2"] Jun 03 21:42:54.170058 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.169984 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c00e098-f253-4e47-8f46-853ad399fe27" path="/var/lib/kubelet/pods/2c00e098-f253-4e47-8f46-853ad399fe27/volumes" Jun 03 21:42:54.219642 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.219608 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c00e098-f253-4e47-8f46-853ad399fe27-registry-tls\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:42:54.638216 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.637408 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz"] Jun 03 21:42:54.656310 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.656253 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz"] Jun 03 21:42:54.656737 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.656407 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.659110 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.659087 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vldfs\"" Jun 03 21:42:54.659331 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.659316 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 21:42:54.659543 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.659522 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 21:42:54.659628 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.659546 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 21:42:54.659628 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.659567 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7i9sfb9dsfuf5\"" Jun 03 21:42:54.659628 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.659598 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 21:42:54.660090 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.660023 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 21:42:54.724355 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.724324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.724503 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.724380 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.724503 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.724470 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.724621 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.724511 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-grpc-tls\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.724621 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.724578 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcjrs\" (UniqueName: \"kubernetes.io/projected/10332e7d-da20-4ed3-bb69-785b275002b2-kube-api-access-lcjrs\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.724713 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.724636 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.724713 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.724669 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10332e7d-da20-4ed3-bb69-785b275002b2-metrics-client-ca\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.724713 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.724693 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-tls\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.825633 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.825596 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.825807 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.825657 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10332e7d-da20-4ed3-bb69-785b275002b2-metrics-client-ca\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.825807 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.825685 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-tls\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.825807 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.825735 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.825807 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.825774 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.826276 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.826245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.826844 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.826812 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-grpc-tls\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.827006 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.826893 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10332e7d-da20-4ed3-bb69-785b275002b2-metrics-client-ca\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.827006 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.826919 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcjrs\" (UniqueName: \"kubernetes.io/projected/10332e7d-da20-4ed3-bb69-785b275002b2-kube-api-access-lcjrs\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.830124 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.830076 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.830492 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.830468 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.831937 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.831904 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-grpc-tls\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.832441 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.832401 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-tls\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.832802 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.832777 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.833609 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.833505 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/10332e7d-da20-4ed3-bb69-785b275002b2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.838138 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.838066 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcjrs\" (UniqueName: \"kubernetes.io/projected/10332e7d-da20-4ed3-bb69-785b275002b2-kube-api-access-lcjrs\") pod \"thanos-querier-6bb7dbcc4-7dhwz\" (UID: \"10332e7d-da20-4ed3-bb69-785b275002b2\") " pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:54.971718 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:54.971681 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:42:56.303702 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:56.303592 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz"] Jun 03 21:42:56.309512 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:56.309480 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10332e7d_da20_4ed3_bb69_785b275002b2.slice/crio-158598fec42ca1cad0cd37e196e569d9e6c63dc7ea2d5dd4e672868c361afa36 WatchSource:0}: Error finding container 158598fec42ca1cad0cd37e196e569d9e6c63dc7ea2d5dd4e672868c361afa36: Status 404 returned error can't find the container with id 158598fec42ca1cad0cd37e196e569d9e6c63dc7ea2d5dd4e672868c361afa36 Jun 03 21:42:56.949330 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:56.947549 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-ccf47479-9hw8t"] Jun 03 21:42:56.963963 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:56.963932 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-ccf47479-9hw8t"] Jun 03 21:42:56.964268 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:56.964039 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:56.968469 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:56.968441 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 21:42:56.968625 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:56.968561 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 21:42:56.968954 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:56.968772 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 21:42:56.971885 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:56.970949 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 21:42:56.971885 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:56.971003 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nl5gx\"" Jun 03 21:42:56.971885 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:56.971212 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-atlm6toqi5i6e\"" Jun 03 21:42:57.049694 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.049660 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-metrics-server-audit-profiles\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.049694 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.049702 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-client-ca-bundle\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.049944 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.049732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.049944 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.049757 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-secret-metrics-server-tls\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.049944 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.049888 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2vwt\" (UniqueName: \"kubernetes.io/projected/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-kube-api-access-d2vwt\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.049944 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.049935 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-secret-metrics-server-client-certs\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.050136 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.050007 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-audit-log\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.132570 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.132533 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" event={"ID":"7e751bb6-b586-4037-b3de-0ab2d87887bc","Type":"ContainerStarted","Data":"3d8609901185b4a94b1db762ee37799917d88b637b6a1db3b693ad2cd74270ca"} Jun 03 21:42:57.132725 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.132594 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" event={"ID":"7e751bb6-b586-4037-b3de-0ab2d87887bc","Type":"ContainerStarted","Data":"35dc3f1d575b482c0de5537b7488c48f62b6f1b97d302b1cf13fcabaf25b0848"} Jun 03 21:42:57.132725 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.132617 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" event={"ID":"7e751bb6-b586-4037-b3de-0ab2d87887bc","Type":"ContainerStarted","Data":"15d690dfaae095878ed787aa11eaa98af6c4f4f36b2e67b7a7be16f2fee57f8a"} Jun 03 21:42:57.135673 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.135641 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" event={"ID":"139fe141-3fcc-48fd-915d-baf64a26a389","Type":"ContainerStarted","Data":"01443747dc1e8d69b6851f2b6a3df6008887790ac14681a1cc4306f1089b70d7"} Jun 03 21:42:57.137679 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.137461 2554 generic.go:356] "Generic (PLEG): container finished" podID="c81632d6-f775-4420-9569-c7c890c7c50d" containerID="6f5500e3f630aef0b6ab4b113ff9bd584628a2b9d16bb20df437b2b7edc83b82" exitCode=0 Jun 03 21:42:57.137679 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.137560 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prcsx" event={"ID":"c81632d6-f775-4420-9569-c7c890c7c50d","Type":"ContainerDied","Data":"6f5500e3f630aef0b6ab4b113ff9bd584628a2b9d16bb20df437b2b7edc83b82"} Jun 03 21:42:57.138994 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.138972 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" event={"ID":"10332e7d-da20-4ed3-bb69-785b275002b2","Type":"ContainerStarted","Data":"158598fec42ca1cad0cd37e196e569d9e6c63dc7ea2d5dd4e672868c361afa36"} Jun 03 21:42:57.151305 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.150667 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2vwt\" (UniqueName: \"kubernetes.io/projected/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-kube-api-access-d2vwt\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.151305 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.150712 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-secret-metrics-server-client-certs\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.151305 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.150750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-audit-log\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.151305 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.150793 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-metrics-server-audit-profiles\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.151305 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.150821 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-client-ca-bundle\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.151305 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.150868 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.151305 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.150897 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-secret-metrics-server-tls\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.153112 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.152711 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-4vsrx" podStartSLOduration=2.231170727 podStartE2EDuration="5.152693957s" totalImagesPullingTime="2.92152323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:57.150876021 +0000 UTC m=+325.486969300" watchObservedRunningTime="2026-06-03 21:42:57.152693957 +0000 UTC m=+325.488787225" Jun 03 21:42:57.153112 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.152785 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-audit-log\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.153286 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.153152 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.153580 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.153513 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-metrics-server-audit-profiles\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.154379 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.154312 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-secret-metrics-server-tls\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.155365 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.155323 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-secret-metrics-server-client-certs\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.156289 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.156263 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-client-ca-bundle\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.163781 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.163739 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2vwt\" (UniqueName: \"kubernetes.io/projected/1b992d59-17d0-4d9d-83a2-d4777c12cd5a-kube-api-access-d2vwt\") pod \"metrics-server-ccf47479-9hw8t\" (UID: \"1b992d59-17d0-4d9d-83a2-d4777c12cd5a\") " pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.186430 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.186379 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-67kgr" podStartSLOduration=2.503058392 podStartE2EDuration="5.186363149s" totalImagesPullingTime="2.683304757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:57.184760635 +0000 UTC m=+325.520853900" watchObservedRunningTime="2026-06-03 21:42:57.186363149 +0000 UTC m=+325.522456417" Jun 03 21:42:57.281503 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.281476 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:42:57.483757 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:57.483676 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-ccf47479-9hw8t"] Jun 03 21:42:57.488245 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:42:57.488209 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b992d59_17d0_4d9d_83a2_d4777c12cd5a.slice/crio-4f350e6d25ecd1b821d22822e30ff8b0efd6157aa40db887e4a83251bff690c9 WatchSource:0}: Error finding container 4f350e6d25ecd1b821d22822e30ff8b0efd6157aa40db887e4a83251bff690c9: Status 404 returned error can't find the container with id 4f350e6d25ecd1b821d22822e30ff8b0efd6157aa40db887e4a83251bff690c9 Jun 03 21:42:58.145722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:58.145654 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prcsx" event={"ID":"c81632d6-f775-4420-9569-c7c890c7c50d","Type":"ContainerStarted","Data":"e57c4788d706bc148457272e8c504bb68f1ab8164f8020a6a7054d62849e3795"} Jun 03 21:42:58.145722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:58.145719 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prcsx" event={"ID":"c81632d6-f775-4420-9569-c7c890c7c50d","Type":"ContainerStarted","Data":"e775e37ed9e4f12f8493df3df89473ae460ea9b0dda0e61ea53f6fb9daad9148"} Jun 03 21:42:58.147196 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:58.147166 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" event={"ID":"1b992d59-17d0-4d9d-83a2-d4777c12cd5a","Type":"ContainerStarted","Data":"4f350e6d25ecd1b821d22822e30ff8b0efd6157aa40db887e4a83251bff690c9"} Jun 03 21:42:58.165145 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:42:58.165096 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-prcsx" podStartSLOduration=3.5514336 podStartE2EDuration="6.165076933s" totalImagesPullingTime="2.475853829s" totalInitContainerRuntime="137.789504ms" isStatefulPod=true podCreationTimestamp="2026-06-03 21:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:58.163881129 +0000 UTC m=+326.499974398" watchObservedRunningTime="2026-06-03 21:42:58.165076933 +0000 UTC m=+326.501170201" Jun 03 21:43:00.158186 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:00.158144 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" event={"ID":"10332e7d-da20-4ed3-bb69-785b275002b2","Type":"ContainerStarted","Data":"07eac5d129955270d6abb3ea97e611c791d3dc1af187ad620f601f861999dc58"} Jun 03 21:43:00.158565 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:00.158257 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" event={"ID":"10332e7d-da20-4ed3-bb69-785b275002b2","Type":"ContainerStarted","Data":"4a72edef4357a0d465c63e234a726da840946225cf0b0432497a80ee3f20085c"} Jun 03 21:43:00.158565 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:00.158301 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" event={"ID":"10332e7d-da20-4ed3-bb69-785b275002b2","Type":"ContainerStarted","Data":"9b97ea96417bf8736ce91365eeb48f79afccaf7042c45cf67cc64f41cc92959f"} Jun 03 21:43:00.159884 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:00.159849 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" event={"ID":"1b992d59-17d0-4d9d-83a2-d4777c12cd5a","Type":"ContainerStarted","Data":"1b6bf1fa370a638a2fc2b04a9167cb6c76339eb135ff2c066c52a4692fa764da"} Jun 03 21:43:00.177545 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:00.177501 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" podStartSLOduration=1.928453297 podStartE2EDuration="4.177487693s" totalImagesPullingTime="2.249034396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:43:00.176352769 +0000 UTC m=+328.512446063" watchObservedRunningTime="2026-06-03 21:43:00.177487693 +0000 UTC m=+328.513580960" Jun 03 21:43:02.169861 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:02.169812 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" event={"ID":"10332e7d-da20-4ed3-bb69-785b275002b2","Type":"ContainerStarted","Data":"7b7a1d6ab69ec2cf6291134d7318b353a8de8fb2516d01cf3f60c93582964f33"} Jun 03 21:43:02.170282 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:02.169896 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" event={"ID":"10332e7d-da20-4ed3-bb69-785b275002b2","Type":"ContainerStarted","Data":"7c300a253c1a30be8a135eae2f21841708f71c917641c11d046b274fa845428a"} Jun 03 21:43:02.170282 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:02.169928 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" event={"ID":"10332e7d-da20-4ed3-bb69-785b275002b2","Type":"ContainerStarted","Data":"3ef9679f911fbbf8620205f8fe25a5cc7d36d1130c852cfe116bb4252665888c"} Jun 03 21:43:02.170282 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:02.169957 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:43:02.191729 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:02.191675 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" podStartSLOduration=3.567838259 podStartE2EDuration="8.191658909s" totalImagesPullingTime="4.62382065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:43:02.191402643 +0000 UTC m=+330.527495910" watchObservedRunningTime="2026-06-03 21:43:02.191658909 +0000 UTC m=+330.527752173" Jun 03 21:43:08.180672 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:08.180644 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6bb7dbcc4-7dhwz" Jun 03 21:43:17.220654 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:17.220619 2554 generic.go:356] "Generic (PLEG): container finished" podID="3935b29d-8bb0-48c6-93c1-82c2b9b2198a" containerID="e9a19ce2a4d9816f2b98784dfa4e0cc6442720fc4d189c41f84f8475f23097e0" exitCode=0 Jun 03 21:43:17.220654 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:17.220656 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" event={"ID":"3935b29d-8bb0-48c6-93c1-82c2b9b2198a","Type":"ContainerDied","Data":"e9a19ce2a4d9816f2b98784dfa4e0cc6442720fc4d189c41f84f8475f23097e0"} Jun 03 21:43:17.221076 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:17.220956 2554 scope.go:117] "RemoveContainer" containerID="e9a19ce2a4d9816f2b98784dfa4e0cc6442720fc4d189c41f84f8475f23097e0" Jun 03 21:43:17.281930 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:17.281899 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:43:17.282043 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:17.281951 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:43:18.226463 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:18.226413 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb" event={"ID":"3935b29d-8bb0-48c6-93c1-82c2b9b2198a","Type":"ContainerStarted","Data":"0a9b9fc4e03f40097e9482ba9e318ab514544330c90454ae0820e2933dd62511"} Jun 03 21:43:37.288421 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:37.288386 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:43:37.292183 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:37.292147 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-ccf47479-9hw8t" Jun 03 21:43:45.968751 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:45.968716 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:43:45.970967 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:45.970946 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/733dc558-703e-4ee8-b7e3-5c3d39841574-metrics-certs\") pod \"network-metrics-daemon-v8b9n\" (UID: \"733dc558-703e-4ee8-b7e3-5c3d39841574\") " pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:43:46.164771 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:46.164748 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zqjnq\"" Jun 03 21:43:46.172822 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:46.172805 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v8b9n" Jun 03 21:43:46.297008 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:46.296984 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v8b9n"] Jun 03 21:43:46.299464 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:43:46.299439 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733dc558_703e_4ee8_b7e3_5c3d39841574.slice/crio-96f3401f582fd1567734d7151e824b01fa6eb0a4f1863a011303f757d2a8ae9a WatchSource:0}: Error finding container 96f3401f582fd1567734d7151e824b01fa6eb0a4f1863a011303f757d2a8ae9a: Status 404 returned error can't find the container with id 96f3401f582fd1567734d7151e824b01fa6eb0a4f1863a011303f757d2a8ae9a Jun 03 21:43:46.327226 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:46.327202 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v8b9n" event={"ID":"733dc558-703e-4ee8-b7e3-5c3d39841574","Type":"ContainerStarted","Data":"96f3401f582fd1567734d7151e824b01fa6eb0a4f1863a011303f757d2a8ae9a"} Jun 03 21:43:47.332714 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:47.332633 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v8b9n" event={"ID":"733dc558-703e-4ee8-b7e3-5c3d39841574","Type":"ContainerStarted","Data":"0919a0800bf9504dabf22bc92f5c1b9d85ed288fa067a4361550d907af71f4ba"} Jun 03 21:43:47.332714 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:47.332714 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v8b9n" event={"ID":"733dc558-703e-4ee8-b7e3-5c3d39841574","Type":"ContainerStarted","Data":"59b4fff4a7357eb79787b487332aac9803d51849e84288270a1194f729ed0071"} Jun 03 21:43:47.349793 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:43:47.349747 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v8b9n" podStartSLOduration=374.635946526 podStartE2EDuration="6m15.349733414s" totalImagesPullingTime="713.786888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:43:47.348346997 +0000 UTC m=+375.684440263" watchObservedRunningTime="2026-06-03 21:43:47.349733414 +0000 UTC m=+375.685826681" Jun 03 21:45:26.007803 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.007768 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s"] Jun 03 21:45:26.009719 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.009702 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s" Jun 03 21:45:26.013243 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.013220 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 21:45:26.013243 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.013237 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 21:45:26.013428 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.013246 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 21:45:26.013428 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.013296 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 21:45:26.013428 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.013348 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vcrg5\"" Jun 03 21:45:26.018458 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.018436 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s"] Jun 03 21:45:26.098872 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.098849 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvknj\" (UniqueName: \"kubernetes.io/projected/21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4-kube-api-access-cvknj\") pod \"managed-serviceaccount-addon-agent-6657f86854-j726s\" (UID: \"21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s" Jun 03 21:45:26.098985 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.098892 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6657f86854-j726s\" (UID: \"21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s" Jun 03 21:45:26.102731 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.102708 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp"] Jun 03 21:45:26.110230 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.110211 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.112812 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.112785 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 21:45:26.112987 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.112858 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 21:45:26.112987 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.112909 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 21:45:26.113133 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.113115 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 21:45:26.116141 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.116120 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp"] Jun 03 21:45:26.200231 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.200205 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f222t\" (UniqueName: \"kubernetes.io/projected/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-kube-api-access-f222t\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.200346 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.200235 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.200346 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.200257 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.200346 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.200287 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvknj\" (UniqueName: \"kubernetes.io/projected/21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4-kube-api-access-cvknj\") pod \"managed-serviceaccount-addon-agent-6657f86854-j726s\" (UID: \"21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s" Jun 03 21:45:26.200346 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.200308 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-hub\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.200346 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.200329 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.200503 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.200351 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6657f86854-j726s\" (UID: \"21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s" Jun 03 21:45:26.200503 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.200402 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-ca\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.202871 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.202852 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6657f86854-j726s\" (UID: \"21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s" Jun 03 21:45:26.209145 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.209125 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvknj\" (UniqueName: \"kubernetes.io/projected/21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4-kube-api-access-cvknj\") pod \"managed-serviceaccount-addon-agent-6657f86854-j726s\" (UID: \"21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s" Jun 03 21:45:26.301159 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.301103 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.301159 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.301141 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-ca\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.301300 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.301173 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f222t\" (UniqueName: \"kubernetes.io/projected/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-kube-api-access-f222t\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.301300 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.301203 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.301300 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.301239 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.301300 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.301282 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-hub\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.301982 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.301944 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.303341 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.303320 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-ca\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.303516 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.303499 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-hub\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.303701 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.303678 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.303746 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.303733 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.309644 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.309623 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f222t\" (UniqueName: \"kubernetes.io/projected/bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd-kube-api-access-f222t\") pod \"cluster-proxy-proxy-agent-57855584bc-hjkcp\" (UID: \"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.335420 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.335397 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s" Jun 03 21:45:26.421355 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.421324 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" Jun 03 21:45:26.456163 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.456140 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s"] Jun 03 21:45:26.458523 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:45:26.458463 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21acf81b_3ab7_4efe_b25b_1c9f9e62b1c4.slice/crio-cee5cd2cf7c5b3340e8684a01943a82dd72dd03d71b64ee5528dacac0116e62a WatchSource:0}: Error finding container cee5cd2cf7c5b3340e8684a01943a82dd72dd03d71b64ee5528dacac0116e62a: Status 404 returned error can't find the container with id cee5cd2cf7c5b3340e8684a01943a82dd72dd03d71b64ee5528dacac0116e62a Jun 03 21:45:26.543569 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.543546 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp"] Jun 03 21:45:26.545930 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:45:26.545905 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb9ec1a0_a08d_4b1e_a2c0_0c60dcb2c5cd.slice/crio-29aa61525c4a11bb0041de47ac5e430eaafc2df8aca55bc4a732e5234d65c41b WatchSource:0}: Error finding container 29aa61525c4a11bb0041de47ac5e430eaafc2df8aca55bc4a732e5234d65c41b: Status 404 returned error can't find the container with id 29aa61525c4a11bb0041de47ac5e430eaafc2df8aca55bc4a732e5234d65c41b Jun 03 21:45:26.693803 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.693773 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" event={"ID":"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd","Type":"ContainerStarted","Data":"29aa61525c4a11bb0041de47ac5e430eaafc2df8aca55bc4a732e5234d65c41b"} Jun 03 21:45:26.694814 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:26.694784 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s" event={"ID":"21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4","Type":"ContainerStarted","Data":"cee5cd2cf7c5b3340e8684a01943a82dd72dd03d71b64ee5528dacac0116e62a"} Jun 03 21:45:32.721514 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:32.721460 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s" event={"ID":"21acf81b-3ab7-4efe-b25b-1c9f9e62b1c4","Type":"ContainerStarted","Data":"c04afe6a03c18febbc57a1ca80b90bd048ebf71362f551dad54a0a154f5fc282"} Jun 03 21:45:32.723420 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:32.723395 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" event={"ID":"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd","Type":"ContainerStarted","Data":"999c02717db91ee57e3588e594759e8d7ea364cdc75b489b2092571cd7e928dc"} Jun 03 21:45:32.723535 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:32.723428 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" event={"ID":"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd","Type":"ContainerStarted","Data":"dc6ec4376f52c7313b9b05e430ceb6e054dea3a017788170ccea991da2dd2be4"} Jun 03 21:45:32.723535 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:32.723448 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" event={"ID":"bb9ec1a0-a08d-4b1e-a2c0-0c60dcb2c5cd","Type":"ContainerStarted","Data":"0c5decd7fdea7e3c7a01b54b012233ff37f890cb7e6494fa89d0526cc8bd2472"} Jun 03 21:45:32.736357 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:32.736310 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6657f86854-j726s" podStartSLOduration=2.200729285 podStartE2EDuration="7.736293948s" totalImagesPullingTime="5.535564663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:45:32.735723493 +0000 UTC m=+481.071816762" watchObservedRunningTime="2026-06-03 21:45:32.736293948 +0000 UTC m=+481.072387217" Jun 03 21:45:32.754962 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:45:32.754924 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57855584bc-hjkcp" podStartSLOduration=1.300637587 podStartE2EDuration="6.754910303s" totalImagesPullingTime="5.454272716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:45:32.753453629 +0000 UTC m=+481.089546917" watchObservedRunningTime="2026-06-03 21:45:32.754910303 +0000 UTC m=+481.091003570" Jun 03 21:46:34.044164 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.044093 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m"] Jun 03 21:46:34.046450 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.046419 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.049370 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.049331 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 21:46:34.049693 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.049672 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 21:46:34.049792 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.049672 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7gb7k\"" Jun 03 21:46:34.050005 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.049985 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 21:46:34.050088 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.050041 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 21:46:34.067176 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.067153 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m"] Jun 03 21:46:34.099511 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.099486 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b3545b4-72f0-4630-9491-f5f615b818ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.099617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.099517 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b3545b4-72f0-4630-9491-f5f615b818ec-tmp\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.099617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.099541 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sv24\" (UniqueName: \"kubernetes.io/projected/3b3545b4-72f0-4630-9491-f5f615b818ec-kube-api-access-4sv24\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.099617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.099560 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b3545b4-72f0-4630-9491-f5f615b818ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.099617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.099605 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b3545b4-72f0-4630-9491-f5f615b818ec-manifests\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.200433 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.200405 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b3545b4-72f0-4630-9491-f5f615b818ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.200433 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.200436 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b3545b4-72f0-4630-9491-f5f615b818ec-tmp\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.200666 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.200460 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sv24\" (UniqueName: \"kubernetes.io/projected/3b3545b4-72f0-4630-9491-f5f615b818ec-kube-api-access-4sv24\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.200782 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.200762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b3545b4-72f0-4630-9491-f5f615b818ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.200893 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.200812 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b3545b4-72f0-4630-9491-f5f615b818ec-manifests\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.201170 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.201151 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b3545b4-72f0-4630-9491-f5f615b818ec-manifests\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.202824 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.202803 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b3545b4-72f0-4630-9491-f5f615b818ec-tmp\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.202944 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.202929 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b3545b4-72f0-4630-9491-f5f615b818ec-webhook-cert\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.203137 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.203119 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b3545b4-72f0-4630-9491-f5f615b818ec-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.209439 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.209418 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sv24\" (UniqueName: \"kubernetes.io/projected/3b3545b4-72f0-4630-9491-f5f615b818ec-kube-api-access-4sv24\") pod \"opendatahub-operator-controller-manager-6df88c9dc9-92h4m\" (UID: \"3b3545b4-72f0-4630-9491-f5f615b818ec\") " pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.357407 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.357346 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:34.485968 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.485922 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m"] Jun 03 21:46:34.488185 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:46:34.488160 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3545b4_72f0_4630_9491_f5f615b818ec.slice/crio-7361c8cdb6cd75e485f0ba12c278d54b25f3b02d1ae4cd040a7d0fb0d8ca26d0 WatchSource:0}: Error finding container 7361c8cdb6cd75e485f0ba12c278d54b25f3b02d1ae4cd040a7d0fb0d8ca26d0: Status 404 returned error can't find the container with id 7361c8cdb6cd75e485f0ba12c278d54b25f3b02d1ae4cd040a7d0fb0d8ca26d0 Jun 03 21:46:34.958527 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:34.958492 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" event={"ID":"3b3545b4-72f0-4630-9491-f5f615b818ec","Type":"ContainerStarted","Data":"7361c8cdb6cd75e485f0ba12c278d54b25f3b02d1ae4cd040a7d0fb0d8ca26d0"} Jun 03 21:46:37.975365 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:37.975331 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" event={"ID":"3b3545b4-72f0-4630-9491-f5f615b818ec","Type":"ContainerStarted","Data":"7373dafcb5ca866740f609bd815e83151886609780a3e5b01419207896394c0f"} Jun 03 21:46:38.981270 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:38.981232 2554 generic.go:356] "Generic (PLEG): container finished" podID="3b3545b4-72f0-4630-9491-f5f615b818ec" containerID="7373dafcb5ca866740f609bd815e83151886609780a3e5b01419207896394c0f" exitCode=0 Jun 03 21:46:38.981662 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:38.981300 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" event={"ID":"3b3545b4-72f0-4630-9491-f5f615b818ec","Type":"ContainerDied","Data":"7373dafcb5ca866740f609bd815e83151886609780a3e5b01419207896394c0f"} Jun 03 21:46:39.987616 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:39.987585 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" event={"ID":"3b3545b4-72f0-4630-9491-f5f615b818ec","Type":"ContainerStarted","Data":"2cbf0cebb1d441203f5c020877ea45f34e89efa2d47a4ebb7416c6d0b241ea1b"} Jun 03 21:46:39.988081 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:39.987718 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:40.009315 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:40.009265 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" podStartSLOduration=1.943688419 podStartE2EDuration="6.009252583s" totalImagesPullingTime="3.071205531s" totalInitContainerRuntime="994.358633ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:46:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:46:40.007026572 +0000 UTC m=+548.343119849" watchObservedRunningTime="2026-06-03 21:46:40.009252583 +0000 UTC m=+548.345345850" Jun 03 21:46:50.993997 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:50.993961 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6df88c9dc9-92h4m" Jun 03 21:46:53.315643 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.315612 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k"] Jun 03 21:46:53.321472 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.321445 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:53.324447 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.324414 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 21:46:53.324447 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.324435 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 21:46:53.324630 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.324416 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rrlcg\"" Jun 03 21:46:53.325506 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.325490 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 21:46:53.325593 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.325512 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 21:46:53.332383 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.332366 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k"] Jun 03 21:46:53.444939 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.444898 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-tls-certs\") pod \"kube-auth-proxy-7f8f4cf549-ftd4k\" (UID: \"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e\") " pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:53.445148 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.444958 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-tmp\") pod \"kube-auth-proxy-7f8f4cf549-ftd4k\" (UID: \"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e\") " pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:53.445148 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.445009 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7fsq\" (UniqueName: \"kubernetes.io/projected/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-kube-api-access-p7fsq\") pod \"kube-auth-proxy-7f8f4cf549-ftd4k\" (UID: \"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e\") " pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:53.546252 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.546217 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-tls-certs\") pod \"kube-auth-proxy-7f8f4cf549-ftd4k\" (UID: \"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e\") " pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:53.546252 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.546249 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-tmp\") pod \"kube-auth-proxy-7f8f4cf549-ftd4k\" (UID: \"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e\") " pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:53.546492 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.546277 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7fsq\" (UniqueName: \"kubernetes.io/projected/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-kube-api-access-p7fsq\") pod \"kube-auth-proxy-7f8f4cf549-ftd4k\" (UID: \"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e\") " pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:53.546492 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:46:53.546384 2554 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 03 21:46:53.546492 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:46:53.546478 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-tls-certs podName:aa0bad36-c190-423d-a7cc-cfd4f38c0e3e nodeName:}" failed. No retries permitted until 2026-06-03 21:46:54.0464543 +0000 UTC m=+562.382547563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-tls-certs") pod "kube-auth-proxy-7f8f4cf549-ftd4k" (UID: "aa0bad36-c190-423d-a7cc-cfd4f38c0e3e") : secret "kube-auth-proxy-tls" not found Jun 03 21:46:53.548396 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.548377 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-tmp\") pod \"kube-auth-proxy-7f8f4cf549-ftd4k\" (UID: \"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e\") " pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:53.555281 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:53.555234 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7fsq\" (UniqueName: \"kubernetes.io/projected/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-kube-api-access-p7fsq\") pod \"kube-auth-proxy-7f8f4cf549-ftd4k\" (UID: \"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e\") " pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:54.001135 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.001102 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dt8fg"] Jun 03 21:46:54.003418 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.003389 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" Jun 03 21:46:54.011047 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.011019 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wzbll\"" Jun 03 21:46:54.012665 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.012642 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 21:46:54.015871 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.015825 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dt8fg"] Jun 03 21:46:54.050606 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.050558 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-tls-certs\") pod \"kube-auth-proxy-7f8f4cf549-ftd4k\" (UID: \"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e\") " pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:54.052980 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.052949 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0bad36-c190-423d-a7cc-cfd4f38c0e3e-tls-certs\") pod \"kube-auth-proxy-7f8f4cf549-ftd4k\" (UID: \"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e\") " pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:54.151762 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.151731 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4q49\" (UniqueName: \"kubernetes.io/projected/c2779017-32b0-4f0c-b796-93134d540019-kube-api-access-k4q49\") pod \"model-serving-api-5dd488fc48-dt8fg\" (UID: \"c2779017-32b0-4f0c-b796-93134d540019\") " pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" Jun 03 21:46:54.151920 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.151785 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2779017-32b0-4f0c-b796-93134d540019-tls-certs\") pod \"model-serving-api-5dd488fc48-dt8fg\" (UID: \"c2779017-32b0-4f0c-b796-93134d540019\") " pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" Jun 03 21:46:54.231945 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.231920 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" Jun 03 21:46:54.253160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.253104 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4q49\" (UniqueName: \"kubernetes.io/projected/c2779017-32b0-4f0c-b796-93134d540019-kube-api-access-k4q49\") pod \"model-serving-api-5dd488fc48-dt8fg\" (UID: \"c2779017-32b0-4f0c-b796-93134d540019\") " pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" Jun 03 21:46:54.253160 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.253144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2779017-32b0-4f0c-b796-93134d540019-tls-certs\") pod \"model-serving-api-5dd488fc48-dt8fg\" (UID: \"c2779017-32b0-4f0c-b796-93134d540019\") " pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" Jun 03 21:46:54.253321 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:46:54.253247 2554 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 03 21:46:54.253321 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:46:54.253296 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2779017-32b0-4f0c-b796-93134d540019-tls-certs podName:c2779017-32b0-4f0c-b796-93134d540019 nodeName:}" failed. No retries permitted until 2026-06-03 21:46:54.753281643 +0000 UTC m=+563.089374888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c2779017-32b0-4f0c-b796-93134d540019-tls-certs") pod "model-serving-api-5dd488fc48-dt8fg" (UID: "c2779017-32b0-4f0c-b796-93134d540019") : secret "model-serving-api-tls" not found Jun 03 21:46:54.261198 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.261177 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4q49\" (UniqueName: \"kubernetes.io/projected/c2779017-32b0-4f0c-b796-93134d540019-kube-api-access-k4q49\") pod \"model-serving-api-5dd488fc48-dt8fg\" (UID: \"c2779017-32b0-4f0c-b796-93134d540019\") " pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" Jun 03 21:46:54.356433 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.356404 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k"] Jun 03 21:46:54.360453 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:46:54.360426 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0bad36_c190_423d_a7cc_cfd4f38c0e3e.slice/crio-5d339e3ec332d976bce18b76a0ad44f44dc76ac4982a65df13b07221f611612f WatchSource:0}: Error finding container 5d339e3ec332d976bce18b76a0ad44f44dc76ac4982a65df13b07221f611612f: Status 404 returned error can't find the container with id 5d339e3ec332d976bce18b76a0ad44f44dc76ac4982a65df13b07221f611612f Jun 03 21:46:54.757931 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.757900 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2779017-32b0-4f0c-b796-93134d540019-tls-certs\") pod \"model-serving-api-5dd488fc48-dt8fg\" (UID: \"c2779017-32b0-4f0c-b796-93134d540019\") " pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" Jun 03 21:46:54.760227 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.760202 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2779017-32b0-4f0c-b796-93134d540019-tls-certs\") pod \"model-serving-api-5dd488fc48-dt8fg\" (UID: \"c2779017-32b0-4f0c-b796-93134d540019\") " pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" Jun 03 21:46:54.917053 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:54.917029 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" Jun 03 21:46:55.054608 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:55.054573 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dt8fg"] Jun 03 21:46:55.056346 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:55.056305 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" event={"ID":"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e","Type":"ContainerStarted","Data":"5d339e3ec332d976bce18b76a0ad44f44dc76ac4982a65df13b07221f611612f"} Jun 03 21:46:55.058026 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:46:55.057994 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2779017_32b0_4f0c_b796_93134d540019.slice/crio-9407360bb91c1ee443aab347c55a055d33ba92ffc3c1ffaa0b742414fc7631a7 WatchSource:0}: Error finding container 9407360bb91c1ee443aab347c55a055d33ba92ffc3c1ffaa0b742414fc7631a7: Status 404 returned error can't find the container with id 9407360bb91c1ee443aab347c55a055d33ba92ffc3c1ffaa0b742414fc7631a7 Jun 03 21:46:56.065362 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:56.065318 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" event={"ID":"c2779017-32b0-4f0c-b796-93134d540019","Type":"ContainerStarted","Data":"9407360bb91c1ee443aab347c55a055d33ba92ffc3c1ffaa0b742414fc7631a7"} Jun 03 21:46:58.075691 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:58.075653 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" event={"ID":"c2779017-32b0-4f0c-b796-93134d540019","Type":"ContainerStarted","Data":"ff04ce403d70432b5d6ec7afd4e2e0d9196bd373eae59f7a7e5329d2a5fe5462"} Jun 03 21:46:58.076154 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:58.075758 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" Jun 03 21:46:58.077183 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:58.077163 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" event={"ID":"aa0bad36-c190-423d-a7cc-cfd4f38c0e3e","Type":"ContainerStarted","Data":"c0887e8f4d66773af6d2adc262f4fbef96c16b7237ef6dbbe64e66a896cae6c7"} Jun 03 21:46:58.091901 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:58.091855 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" podStartSLOduration=2.61392498 podStartE2EDuration="5.09182746s" totalImagesPullingTime="2.47790248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:46:58.091121378 +0000 UTC m=+566.427214643" watchObservedRunningTime="2026-06-03 21:46:58.09182746 +0000 UTC m=+566.427920726" Jun 03 21:46:58.106620 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:46:58.106578 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f8f4cf549-ftd4k" podStartSLOduration=1.929110508 podStartE2EDuration="5.106562848s" totalImagesPullingTime="3.17745234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:46:58.105186794 +0000 UTC m=+566.441280053" watchObservedRunningTime="2026-06-03 21:46:58.106562848 +0000 UTC m=+566.442656115" Jun 03 21:47:01.028316 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.028283 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc"] Jun 03 21:47:01.031966 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.031948 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.035494 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.035470 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 21:47:01.035494 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.035485 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 21:47:01.035683 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.035513 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 21:47:01.035683 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.035542 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pqspg\"" Jun 03 21:47:01.035683 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.035579 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 21:47:01.035683 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.035619 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 21:47:01.038618 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.038597 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc"] Jun 03 21:47:01.215249 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.215219 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08ea370a-3a95-4d4a-aad1-28f11d494f79-cert\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.215249 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.215252 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/08ea370a-3a95-4d4a-aad1-28f11d494f79-manager-config\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.215442 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.215285 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/08ea370a-3a95-4d4a-aad1-28f11d494f79-metrics-cert\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.215442 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.215346 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2fn5\" (UniqueName: \"kubernetes.io/projected/08ea370a-3a95-4d4a-aad1-28f11d494f79-kube-api-access-h2fn5\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.315982 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.315908 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08ea370a-3a95-4d4a-aad1-28f11d494f79-cert\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.315982 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.315941 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/08ea370a-3a95-4d4a-aad1-28f11d494f79-manager-config\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.316178 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.315985 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/08ea370a-3a95-4d4a-aad1-28f11d494f79-metrics-cert\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.316178 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.316018 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fn5\" (UniqueName: \"kubernetes.io/projected/08ea370a-3a95-4d4a-aad1-28f11d494f79-kube-api-access-h2fn5\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.316579 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.316561 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/08ea370a-3a95-4d4a-aad1-28f11d494f79-manager-config\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.318341 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.318314 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08ea370a-3a95-4d4a-aad1-28f11d494f79-cert\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.318431 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.318348 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/08ea370a-3a95-4d4a-aad1-28f11d494f79-metrics-cert\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.323687 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.323667 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2fn5\" (UniqueName: \"kubernetes.io/projected/08ea370a-3a95-4d4a-aad1-28f11d494f79-kube-api-access-h2fn5\") pod \"lws-controller-manager-58895f6957-2q9mc\" (UID: \"08ea370a-3a95-4d4a-aad1-28f11d494f79\") " pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.342021 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.342003 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:01.475446 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:01.475414 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc"] Jun 03 21:47:01.479073 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:47:01.479045 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ea370a_3a95_4d4a_aad1_28f11d494f79.slice/crio-638b0b105d0aeb2ebef8258f72bc3b2416346a7834acae23c5007bc7c8dc1e5f WatchSource:0}: Error finding container 638b0b105d0aeb2ebef8258f72bc3b2416346a7834acae23c5007bc7c8dc1e5f: Status 404 returned error can't find the container with id 638b0b105d0aeb2ebef8258f72bc3b2416346a7834acae23c5007bc7c8dc1e5f Jun 03 21:47:02.095346 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:02.095309 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" event={"ID":"08ea370a-3a95-4d4a-aad1-28f11d494f79","Type":"ContainerStarted","Data":"638b0b105d0aeb2ebef8258f72bc3b2416346a7834acae23c5007bc7c8dc1e5f"} Jun 03 21:47:05.111961 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:05.111925 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" event={"ID":"08ea370a-3a95-4d4a-aad1-28f11d494f79","Type":"ContainerStarted","Data":"ff742737cfc5c548e0a4d469635abbf1b502ba8cf96617d15880292cb52d85eb"} Jun 03 21:47:05.112316 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:05.112033 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:05.130456 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:05.130408 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" podStartSLOduration=2.426127934 podStartE2EDuration="5.130395222s" totalImagesPullingTime="2.704267288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:47:05.128910948 +0000 UTC m=+573.465004205" watchObservedRunningTime="2026-06-03 21:47:05.130395222 +0000 UTC m=+573.466488486" Jun 03 21:47:09.086365 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:09.086332 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-dt8fg" Jun 03 21:47:16.118102 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:16.118073 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58895f6957-2q9mc" Jun 03 21:47:32.129392 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:32.129362 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 21:47:32.130122 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:47:32.130096 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 21:49:15.610106 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.610023 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl"] Jun 03 21:49:15.613473 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.613450 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 21:49:15.615991 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.615969 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 21:49:15.616084 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.615991 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 21:49:15.616084 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.615992 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-srv7r\"" Jun 03 21:49:15.625125 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.625106 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl"] Jun 03 21:49:15.717123 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.717091 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtlp7\" (UniqueName: \"kubernetes.io/projected/be7dff14-cd51-48ff-b526-2d0d5316d8f6-kube-api-access-mtlp7\") pod \"kuadrant-operator-controller-manager-86878c769f-r29tl\" (UID: \"be7dff14-cd51-48ff-b526-2d0d5316d8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 21:49:15.717293 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.717134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be7dff14-cd51-48ff-b526-2d0d5316d8f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r29tl\" (UID: \"be7dff14-cd51-48ff-b526-2d0d5316d8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 21:49:15.818466 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.818427 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtlp7\" (UniqueName: \"kubernetes.io/projected/be7dff14-cd51-48ff-b526-2d0d5316d8f6-kube-api-access-mtlp7\") pod \"kuadrant-operator-controller-manager-86878c769f-r29tl\" (UID: \"be7dff14-cd51-48ff-b526-2d0d5316d8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 21:49:15.818616 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.818483 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be7dff14-cd51-48ff-b526-2d0d5316d8f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r29tl\" (UID: \"be7dff14-cd51-48ff-b526-2d0d5316d8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 21:49:15.818881 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.818860 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be7dff14-cd51-48ff-b526-2d0d5316d8f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r29tl\" (UID: \"be7dff14-cd51-48ff-b526-2d0d5316d8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 21:49:15.826562 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.826533 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtlp7\" (UniqueName: \"kubernetes.io/projected/be7dff14-cd51-48ff-b526-2d0d5316d8f6-kube-api-access-mtlp7\") pod \"kuadrant-operator-controller-manager-86878c769f-r29tl\" (UID: \"be7dff14-cd51-48ff-b526-2d0d5316d8f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 21:49:15.924712 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:15.924646 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 21:49:16.075119 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:16.075094 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl"] Jun 03 21:49:16.077187 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:49:16.077154 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe7dff14_cd51_48ff_b526_2d0d5316d8f6.slice/crio-e05c2e6cdcf96d246f3f32b118bcdb4f7f98a6f4aec3b85c3ecb0bb75453d51b WatchSource:0}: Error finding container e05c2e6cdcf96d246f3f32b118bcdb4f7f98a6f4aec3b85c3ecb0bb75453d51b: Status 404 returned error can't find the container with id e05c2e6cdcf96d246f3f32b118bcdb4f7f98a6f4aec3b85c3ecb0bb75453d51b Jun 03 21:49:16.079763 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:16.079745 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:49:16.665623 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:16.665590 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" event={"ID":"be7dff14-cd51-48ff-b526-2d0d5316d8f6","Type":"ContainerStarted","Data":"e05c2e6cdcf96d246f3f32b118bcdb4f7f98a6f4aec3b85c3ecb0bb75453d51b"} Jun 03 21:49:20.688197 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:20.688166 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" event={"ID":"be7dff14-cd51-48ff-b526-2d0d5316d8f6","Type":"ContainerStarted","Data":"7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963"} Jun 03 21:49:20.688555 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:20.688307 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 21:49:20.710477 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:20.710423 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" podStartSLOduration=1.583457828 podStartE2EDuration="5.710409702s" totalImagesPullingTime="4.126951874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:49:20.707994281 +0000 UTC m=+709.044087549" watchObservedRunningTime="2026-06-03 21:49:20.710409702 +0000 UTC m=+709.046503031" Jun 03 21:49:31.694907 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:31.694873 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 21:49:53.086012 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.085981 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6qts7"] Jun 03 21:49:53.130296 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.130267 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6qts7"] Jun 03 21:49:53.130431 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.130357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6qts7" Jun 03 21:49:53.132920 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.132897 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5vwnk\"" Jun 03 21:49:53.237918 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.237889 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj4ms\" (UniqueName: \"kubernetes.io/projected/a900b186-d304-42ae-8b31-e3833771d56d-kube-api-access-lj4ms\") pod \"authorino-58cd955675-6qts7\" (UID: \"a900b186-d304-42ae-8b31-e3833771d56d\") " pod="kuadrant-system/authorino-58cd955675-6qts7" Jun 03 21:49:53.249640 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.249615 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-mht6r"] Jun 03 21:49:53.251699 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.251683 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mht6r" Jun 03 21:49:53.259677 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.259658 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mht6r"] Jun 03 21:49:53.338937 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.338864 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj4ms\" (UniqueName: \"kubernetes.io/projected/a900b186-d304-42ae-8b31-e3833771d56d-kube-api-access-lj4ms\") pod \"authorino-58cd955675-6qts7\" (UID: \"a900b186-d304-42ae-8b31-e3833771d56d\") " pod="kuadrant-system/authorino-58cd955675-6qts7" Jun 03 21:49:53.348295 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.348268 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj4ms\" (UniqueName: \"kubernetes.io/projected/a900b186-d304-42ae-8b31-e3833771d56d-kube-api-access-lj4ms\") pod \"authorino-58cd955675-6qts7\" (UID: \"a900b186-d304-42ae-8b31-e3833771d56d\") " pod="kuadrant-system/authorino-58cd955675-6qts7" Jun 03 21:49:53.438672 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.438648 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6qts7" Jun 03 21:49:53.439968 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.439943 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pj26\" (UniqueName: \"kubernetes.io/projected/b6713db2-dbd6-4d05-a8ce-5df2b58b3c66-kube-api-access-7pj26\") pod \"authorino-75d556bd77-mht6r\" (UID: \"b6713db2-dbd6-4d05-a8ce-5df2b58b3c66\") " pod="kuadrant-system/authorino-75d556bd77-mht6r" Jun 03 21:49:53.541397 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.541366 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pj26\" (UniqueName: \"kubernetes.io/projected/b6713db2-dbd6-4d05-a8ce-5df2b58b3c66-kube-api-access-7pj26\") pod \"authorino-75d556bd77-mht6r\" (UID: \"b6713db2-dbd6-4d05-a8ce-5df2b58b3c66\") " pod="kuadrant-system/authorino-75d556bd77-mht6r" Jun 03 21:49:53.550040 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.550013 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pj26\" (UniqueName: \"kubernetes.io/projected/b6713db2-dbd6-4d05-a8ce-5df2b58b3c66-kube-api-access-7pj26\") pod \"authorino-75d556bd77-mht6r\" (UID: \"b6713db2-dbd6-4d05-a8ce-5df2b58b3c66\") " pod="kuadrant-system/authorino-75d556bd77-mht6r" Jun 03 21:49:53.560759 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.560700 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6qts7"] Jun 03 21:49:53.560759 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.560745 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mht6r" Jun 03 21:49:53.563604 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:49:53.563584 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda900b186_d304_42ae_8b31_e3833771d56d.slice/crio-7b8c262aa4f74ec5a0d4ef6cf382843320d938eeb31fccaa24b4bfedf1e9eca1 WatchSource:0}: Error finding container 7b8c262aa4f74ec5a0d4ef6cf382843320d938eeb31fccaa24b4bfedf1e9eca1: Status 404 returned error can't find the container with id 7b8c262aa4f74ec5a0d4ef6cf382843320d938eeb31fccaa24b4bfedf1e9eca1 Jun 03 21:49:53.683210 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.683183 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mht6r"] Jun 03 21:49:53.684530 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:49:53.684504 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6713db2_dbd6_4d05_a8ce_5df2b58b3c66.slice/crio-a50ed1b5241d8d53b27cf01006c1a106d5ac473d6911c45a8390e314e80e6cb9 WatchSource:0}: Error finding container a50ed1b5241d8d53b27cf01006c1a106d5ac473d6911c45a8390e314e80e6cb9: Status 404 returned error can't find the container with id a50ed1b5241d8d53b27cf01006c1a106d5ac473d6911c45a8390e314e80e6cb9 Jun 03 21:49:53.838009 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.837969 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6qts7" event={"ID":"a900b186-d304-42ae-8b31-e3833771d56d","Type":"ContainerStarted","Data":"7b8c262aa4f74ec5a0d4ef6cf382843320d938eeb31fccaa24b4bfedf1e9eca1"} Jun 03 21:49:53.839099 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:53.839076 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mht6r" event={"ID":"b6713db2-dbd6-4d05-a8ce-5df2b58b3c66","Type":"ContainerStarted","Data":"a50ed1b5241d8d53b27cf01006c1a106d5ac473d6911c45a8390e314e80e6cb9"} Jun 03 21:49:57.868149 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:57.868114 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mht6r" event={"ID":"b6713db2-dbd6-4d05-a8ce-5df2b58b3c66","Type":"ContainerStarted","Data":"5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34"} Jun 03 21:49:57.869426 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:57.869402 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6qts7" event={"ID":"a900b186-d304-42ae-8b31-e3833771d56d","Type":"ContainerStarted","Data":"7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d"} Jun 03 21:49:57.881445 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:57.881398 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-mht6r" podStartSLOduration=1.41117323 podStartE2EDuration="4.881384628s" totalImagesPullingTime="3.470211398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:49:57.880896858 +0000 UTC m=+746.216990124" watchObservedRunningTime="2026-06-03 21:49:57.881384628 +0000 UTC m=+746.217477889" Jun 03 21:49:57.897190 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:57.897147 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6qts7" podStartSLOduration=1.317070277 podStartE2EDuration="4.897134515s" totalImagesPullingTime="3.580064238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:49:57.895870618 +0000 UTC m=+746.231963890" watchObservedRunningTime="2026-06-03 21:49:57.897134515 +0000 UTC m=+746.233227781" Jun 03 21:49:57.910250 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:57.910226 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6qts7"] Jun 03 21:49:59.878148 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:49:59.878110 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6qts7" podUID="a900b186-d304-42ae-8b31-e3833771d56d" containerName="authorino" containerID="cri-o://7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d" gracePeriod=30 Jun 03 21:50:00.125035 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.125008 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6qts7" Jun 03 21:50:00.196851 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.196807 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj4ms\" (UniqueName: \"kubernetes.io/projected/a900b186-d304-42ae-8b31-e3833771d56d-kube-api-access-lj4ms\") pod \"a900b186-d304-42ae-8b31-e3833771d56d\" (UID: \"a900b186-d304-42ae-8b31-e3833771d56d\") " Jun 03 21:50:00.198846 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.198813 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a900b186-d304-42ae-8b31-e3833771d56d-kube-api-access-lj4ms" (OuterVolumeSpecName: "kube-api-access-lj4ms") pod "a900b186-d304-42ae-8b31-e3833771d56d" (UID: "a900b186-d304-42ae-8b31-e3833771d56d"). InnerVolumeSpecName "kube-api-access-lj4ms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:50:00.297326 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.297299 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj4ms\" (UniqueName: \"kubernetes.io/projected/a900b186-d304-42ae-8b31-e3833771d56d-kube-api-access-lj4ms\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:50:00.883705 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.883666 2554 generic.go:356] "Generic (PLEG): container finished" podID="a900b186-d304-42ae-8b31-e3833771d56d" containerID="7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d" exitCode=0 Jun 03 21:50:00.884122 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.883710 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6qts7" event={"ID":"a900b186-d304-42ae-8b31-e3833771d56d","Type":"ContainerDied","Data":"7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d"} Jun 03 21:50:00.884122 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.883722 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6qts7" Jun 03 21:50:00.884122 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.883747 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6qts7" event={"ID":"a900b186-d304-42ae-8b31-e3833771d56d","Type":"ContainerDied","Data":"7b8c262aa4f74ec5a0d4ef6cf382843320d938eeb31fccaa24b4bfedf1e9eca1"} Jun 03 21:50:00.884122 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.883770 2554 scope.go:117] "RemoveContainer" containerID="7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d" Jun 03 21:50:00.892559 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.892539 2554 scope.go:117] "RemoveContainer" containerID="7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d" Jun 03 21:50:00.892807 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:50:00.892786 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d\": container with ID starting with 7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d not found: ID does not exist" containerID="7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d" Jun 03 21:50:00.892889 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.892818 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d"} err="failed to get container status \"7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d\": rpc error: code = NotFound desc = could not find container \"7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d\": container with ID starting with 7af51694d7b395f5ddd5c00e63e92253c5bd5143c0f9b5a04c344b0e81ec3d7d not found: ID does not exist" Jun 03 21:50:00.904508 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.904486 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6qts7"] Jun 03 21:50:00.908297 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:00.908271 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6qts7"] Jun 03 21:50:02.166729 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:50:02.166698 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a900b186-d304-42ae-8b31-e3833771d56d" path="/var/lib/kubelet/pods/a900b186-d304-42ae-8b31-e3833771d56d/volumes" Jun 03 21:51:17.004844 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.004807 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-stprj"] Jun 03 21:51:17.005322 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.005306 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a900b186-d304-42ae-8b31-e3833771d56d" containerName="authorino" Jun 03 21:51:17.005369 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.005325 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a900b186-d304-42ae-8b31-e3833771d56d" containerName="authorino" Jun 03 21:51:17.005438 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.005428 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a900b186-d304-42ae-8b31-e3833771d56d" containerName="authorino" Jun 03 21:51:17.008705 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.008683 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-stprj" Jun 03 21:51:17.012602 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.012579 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-stprj"] Jun 03 21:51:17.096230 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.096195 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phptp\" (UniqueName: \"kubernetes.io/projected/11c1d34f-16af-44aa-a0c9-ad7277a4cea9-kube-api-access-phptp\") pod \"authorino-5d4b67c446-stprj\" (UID: \"11c1d34f-16af-44aa-a0c9-ad7277a4cea9\") " pod="kuadrant-system/authorino-5d4b67c446-stprj" Jun 03 21:51:17.197206 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.197176 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phptp\" (UniqueName: \"kubernetes.io/projected/11c1d34f-16af-44aa-a0c9-ad7277a4cea9-kube-api-access-phptp\") pod \"authorino-5d4b67c446-stprj\" (UID: \"11c1d34f-16af-44aa-a0c9-ad7277a4cea9\") " pod="kuadrant-system/authorino-5d4b67c446-stprj" Jun 03 21:51:17.204846 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.204815 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phptp\" (UniqueName: \"kubernetes.io/projected/11c1d34f-16af-44aa-a0c9-ad7277a4cea9-kube-api-access-phptp\") pod \"authorino-5d4b67c446-stprj\" (UID: \"11c1d34f-16af-44aa-a0c9-ad7277a4cea9\") " pod="kuadrant-system/authorino-5d4b67c446-stprj" Jun 03 21:51:17.225713 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.225681 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-stprj"] Jun 03 21:51:17.225986 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.225970 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-stprj" Jun 03 21:51:17.249163 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.249139 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-765b65b96c-s868r"] Jun 03 21:51:17.252511 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.252485 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765b65b96c-s868r" Jun 03 21:51:17.263440 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.263417 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-765b65b96c-s868r"] Jun 03 21:51:17.297764 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.297714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-629qd\" (UniqueName: \"kubernetes.io/projected/ca44ae65-1559-44dd-b1b0-3f32720b50c4-kube-api-access-629qd\") pod \"authorino-765b65b96c-s868r\" (UID: \"ca44ae65-1559-44dd-b1b0-3f32720b50c4\") " pod="kuadrant-system/authorino-765b65b96c-s868r" Jun 03 21:51:17.356853 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.356813 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-stprj"] Jun 03 21:51:17.359424 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:51:17.359394 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11c1d34f_16af_44aa_a0c9_ad7277a4cea9.slice/crio-0b2c49630f24279d03bc0229bbc8af7b2f5fc31b6faf6f8221bc3664d9394588 WatchSource:0}: Error finding container 0b2c49630f24279d03bc0229bbc8af7b2f5fc31b6faf6f8221bc3664d9394588: Status 404 returned error can't find the container with id 0b2c49630f24279d03bc0229bbc8af7b2f5fc31b6faf6f8221bc3664d9394588 Jun 03 21:51:17.372748 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.372717 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-765b65b96c-s868r"] Jun 03 21:51:17.373032 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:51:17.373007 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-629qd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-765b65b96c-s868r" podUID="ca44ae65-1559-44dd-b1b0-3f32720b50c4" Jun 03 21:51:17.395807 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.395779 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dfcbc6955-d6qp6"] Jun 03 21:51:17.398550 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.398528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-629qd\" (UniqueName: \"kubernetes.io/projected/ca44ae65-1559-44dd-b1b0-3f32720b50c4-kube-api-access-629qd\") pod \"authorino-765b65b96c-s868r\" (UID: \"ca44ae65-1559-44dd-b1b0-3f32720b50c4\") " pod="kuadrant-system/authorino-765b65b96c-s868r" Jun 03 21:51:17.400075 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.400058 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" Jun 03 21:51:17.402437 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.402409 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 21:51:17.405537 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.405505 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dfcbc6955-d6qp6"] Jun 03 21:51:17.408732 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.408710 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-629qd\" (UniqueName: \"kubernetes.io/projected/ca44ae65-1559-44dd-b1b0-3f32720b50c4-kube-api-access-629qd\") pod \"authorino-765b65b96c-s868r\" (UID: \"ca44ae65-1559-44dd-b1b0-3f32720b50c4\") " pod="kuadrant-system/authorino-765b65b96c-s868r" Jun 03 21:51:17.499006 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.498974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a378a6ec-3fdf-4d54-86c1-510560eeeb66-tls-cert\") pod \"authorino-5dfcbc6955-d6qp6\" (UID: \"a378a6ec-3fdf-4d54-86c1-510560eeeb66\") " pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" Jun 03 21:51:17.499171 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.499017 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgzsh\" (UniqueName: \"kubernetes.io/projected/a378a6ec-3fdf-4d54-86c1-510560eeeb66-kube-api-access-lgzsh\") pod \"authorino-5dfcbc6955-d6qp6\" (UID: \"a378a6ec-3fdf-4d54-86c1-510560eeeb66\") " pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" Jun 03 21:51:17.599526 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.599445 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgzsh\" (UniqueName: \"kubernetes.io/projected/a378a6ec-3fdf-4d54-86c1-510560eeeb66-kube-api-access-lgzsh\") pod \"authorino-5dfcbc6955-d6qp6\" (UID: \"a378a6ec-3fdf-4d54-86c1-510560eeeb66\") " pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" Jun 03 21:51:17.599663 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.599528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a378a6ec-3fdf-4d54-86c1-510560eeeb66-tls-cert\") pod \"authorino-5dfcbc6955-d6qp6\" (UID: \"a378a6ec-3fdf-4d54-86c1-510560eeeb66\") " pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" Jun 03 21:51:17.601925 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.601902 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a378a6ec-3fdf-4d54-86c1-510560eeeb66-tls-cert\") pod \"authorino-5dfcbc6955-d6qp6\" (UID: \"a378a6ec-3fdf-4d54-86c1-510560eeeb66\") " pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" Jun 03 21:51:17.606819 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.606795 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgzsh\" (UniqueName: \"kubernetes.io/projected/a378a6ec-3fdf-4d54-86c1-510560eeeb66-kube-api-access-lgzsh\") pod \"authorino-5dfcbc6955-d6qp6\" (UID: \"a378a6ec-3fdf-4d54-86c1-510560eeeb66\") " pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" Jun 03 21:51:17.718340 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.718304 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" Jun 03 21:51:17.853913 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:17.853857 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dfcbc6955-d6qp6"] Jun 03 21:51:17.856762 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:51:17.856734 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda378a6ec_3fdf_4d54_86c1_510560eeeb66.slice/crio-a89fd21eed1f514c8cb3c400604ab2608c2ef39d1e872a3744ce9ca11bdf2af4 WatchSource:0}: Error finding container a89fd21eed1f514c8cb3c400604ab2608c2ef39d1e872a3744ce9ca11bdf2af4: Status 404 returned error can't find the container with id a89fd21eed1f514c8cb3c400604ab2608c2ef39d1e872a3744ce9ca11bdf2af4 Jun 03 21:51:18.227972 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.227933 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" event={"ID":"a378a6ec-3fdf-4d54-86c1-510560eeeb66","Type":"ContainerStarted","Data":"70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5"} Jun 03 21:51:18.228378 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.227992 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" event={"ID":"a378a6ec-3fdf-4d54-86c1-510560eeeb66","Type":"ContainerStarted","Data":"a89fd21eed1f514c8cb3c400604ab2608c2ef39d1e872a3744ce9ca11bdf2af4"} Jun 03 21:51:18.229634 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.229606 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-stprj" event={"ID":"11c1d34f-16af-44aa-a0c9-ad7277a4cea9","Type":"ContainerStarted","Data":"3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63"} Jun 03 21:51:18.229752 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.229640 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-stprj" event={"ID":"11c1d34f-16af-44aa-a0c9-ad7277a4cea9","Type":"ContainerStarted","Data":"0b2c49630f24279d03bc0229bbc8af7b2f5fc31b6faf6f8221bc3664d9394588"} Jun 03 21:51:18.229752 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.229658 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765b65b96c-s868r" Jun 03 21:51:18.229752 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.229636 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-stprj" podUID="11c1d34f-16af-44aa-a0c9-ad7277a4cea9" containerName="authorino" containerID="cri-o://3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63" gracePeriod=30 Jun 03 21:51:18.238116 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.238098 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765b65b96c-s868r" Jun 03 21:51:18.245361 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.245316 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" podStartSLOduration=0.977509223 podStartE2EDuration="1.245299354s" totalImagesPullingTime="267.790131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:51:18.242406321 +0000 UTC m=+826.578499590" watchObservedRunningTime="2026-06-03 21:51:18.245299354 +0000 UTC m=+826.581392623" Jun 03 21:51:18.259879 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.259811 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-stprj" podStartSLOduration=1.8466357740000001 podStartE2EDuration="2.25979177s" totalImagesPullingTime="413.155996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:51:18.258087621 +0000 UTC m=+826.594180908" watchObservedRunningTime="2026-06-03 21:51:18.25979177 +0000 UTC m=+826.595885039" Jun 03 21:51:18.273067 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.273042 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mht6r"] Jun 03 21:51:18.273221 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.273200 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-mht6r" podUID="b6713db2-dbd6-4d05-a8ce-5df2b58b3c66" containerName="authorino" containerID="cri-o://5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34" gracePeriod=30 Jun 03 21:51:18.303598 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.303576 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-629qd\" (UniqueName: \"kubernetes.io/projected/ca44ae65-1559-44dd-b1b0-3f32720b50c4-kube-api-access-629qd\") pod \"ca44ae65-1559-44dd-b1b0-3f32720b50c4\" (UID: \"ca44ae65-1559-44dd-b1b0-3f32720b50c4\") " Jun 03 21:51:18.305415 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.305393 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca44ae65-1559-44dd-b1b0-3f32720b50c4-kube-api-access-629qd" (OuterVolumeSpecName: "kube-api-access-629qd") pod "ca44ae65-1559-44dd-b1b0-3f32720b50c4" (UID: "ca44ae65-1559-44dd-b1b0-3f32720b50c4"). InnerVolumeSpecName "kube-api-access-629qd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:51:18.404812 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.404780 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-629qd\" (UniqueName: \"kubernetes.io/projected/ca44ae65-1559-44dd-b1b0-3f32720b50c4-kube-api-access-629qd\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:51:18.536388 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.536364 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-stprj" Jun 03 21:51:18.538822 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.538803 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mht6r" Jun 03 21:51:18.606100 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.606068 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phptp\" (UniqueName: \"kubernetes.io/projected/11c1d34f-16af-44aa-a0c9-ad7277a4cea9-kube-api-access-phptp\") pod \"11c1d34f-16af-44aa-a0c9-ad7277a4cea9\" (UID: \"11c1d34f-16af-44aa-a0c9-ad7277a4cea9\") " Jun 03 21:51:18.606258 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.606109 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pj26\" (UniqueName: \"kubernetes.io/projected/b6713db2-dbd6-4d05-a8ce-5df2b58b3c66-kube-api-access-7pj26\") pod \"b6713db2-dbd6-4d05-a8ce-5df2b58b3c66\" (UID: \"b6713db2-dbd6-4d05-a8ce-5df2b58b3c66\") " Jun 03 21:51:18.608091 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.608061 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11c1d34f-16af-44aa-a0c9-ad7277a4cea9-kube-api-access-phptp" (OuterVolumeSpecName: "kube-api-access-phptp") pod "11c1d34f-16af-44aa-a0c9-ad7277a4cea9" (UID: "11c1d34f-16af-44aa-a0c9-ad7277a4cea9"). InnerVolumeSpecName "kube-api-access-phptp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:51:18.608199 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.608120 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6713db2-dbd6-4d05-a8ce-5df2b58b3c66-kube-api-access-7pj26" (OuterVolumeSpecName: "kube-api-access-7pj26") pod "b6713db2-dbd6-4d05-a8ce-5df2b58b3c66" (UID: "b6713db2-dbd6-4d05-a8ce-5df2b58b3c66"). InnerVolumeSpecName "kube-api-access-7pj26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:51:18.706759 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.706730 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phptp\" (UniqueName: \"kubernetes.io/projected/11c1d34f-16af-44aa-a0c9-ad7277a4cea9-kube-api-access-phptp\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:51:18.706759 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:18.706756 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pj26\" (UniqueName: \"kubernetes.io/projected/b6713db2-dbd6-4d05-a8ce-5df2b58b3c66-kube-api-access-7pj26\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:51:19.235633 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.235596 2554 generic.go:356] "Generic (PLEG): container finished" podID="11c1d34f-16af-44aa-a0c9-ad7277a4cea9" containerID="3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63" exitCode=0 Jun 03 21:51:19.236002 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.235636 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-stprj" Jun 03 21:51:19.236002 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.235660 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-stprj" event={"ID":"11c1d34f-16af-44aa-a0c9-ad7277a4cea9","Type":"ContainerDied","Data":"3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63"} Jun 03 21:51:19.236002 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.235702 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-stprj" event={"ID":"11c1d34f-16af-44aa-a0c9-ad7277a4cea9","Type":"ContainerDied","Data":"0b2c49630f24279d03bc0229bbc8af7b2f5fc31b6faf6f8221bc3664d9394588"} Jun 03 21:51:19.236002 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.235721 2554 scope.go:117] "RemoveContainer" containerID="3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63" Jun 03 21:51:19.237210 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.237184 2554 generic.go:356] "Generic (PLEG): container finished" podID="b6713db2-dbd6-4d05-a8ce-5df2b58b3c66" containerID="5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34" exitCode=0 Jun 03 21:51:19.237295 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.237227 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mht6r" Jun 03 21:51:19.237408 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.237369 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mht6r" event={"ID":"b6713db2-dbd6-4d05-a8ce-5df2b58b3c66","Type":"ContainerDied","Data":"5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34"} Jun 03 21:51:19.237408 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.237396 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765b65b96c-s868r" Jun 03 21:51:19.237568 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.237422 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mht6r" event={"ID":"b6713db2-dbd6-4d05-a8ce-5df2b58b3c66","Type":"ContainerDied","Data":"a50ed1b5241d8d53b27cf01006c1a106d5ac473d6911c45a8390e314e80e6cb9"} Jun 03 21:51:19.244745 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.244728 2554 scope.go:117] "RemoveContainer" containerID="3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63" Jun 03 21:51:19.245059 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:51:19.245040 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63\": container with ID starting with 3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63 not found: ID does not exist" containerID="3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63" Jun 03 21:51:19.245131 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.245069 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63"} err="failed to get container status \"3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63\": rpc error: code = NotFound desc = could not find container \"3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63\": container with ID starting with 3ed1255c0fd4a4c1fae4c25762bc174b5a37e5081128eed11aa1d76435440f63 not found: ID does not exist" Jun 03 21:51:19.245131 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.245092 2554 scope.go:117] "RemoveContainer" containerID="5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34" Jun 03 21:51:19.252690 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.252676 2554 scope.go:117] "RemoveContainer" containerID="5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34" Jun 03 21:51:19.252936 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:51:19.252919 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34\": container with ID starting with 5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34 not found: ID does not exist" containerID="5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34" Jun 03 21:51:19.252976 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.252943 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34"} err="failed to get container status \"5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34\": rpc error: code = NotFound desc = could not find container \"5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34\": container with ID starting with 5a2791c17b708a5bed77c03bfdff4d52d2c8df2d9c39a7ae6e3c53513b4ada34 not found: ID does not exist" Jun 03 21:51:19.267213 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.267194 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-765b65b96c-s868r"] Jun 03 21:51:19.271421 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.271400 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-765b65b96c-s868r"] Jun 03 21:51:19.281699 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.281682 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mht6r"] Jun 03 21:51:19.287292 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.287274 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mht6r"] Jun 03 21:51:19.297547 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.297528 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-stprj"] Jun 03 21:51:19.301701 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:19.301684 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-stprj"] Jun 03 21:51:20.168044 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:20.168014 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11c1d34f-16af-44aa-a0c9-ad7277a4cea9" path="/var/lib/kubelet/pods/11c1d34f-16af-44aa-a0c9-ad7277a4cea9/volumes" Jun 03 21:51:20.168341 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:20.168328 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6713db2-dbd6-4d05-a8ce-5df2b58b3c66" path="/var/lib/kubelet/pods/b6713db2-dbd6-4d05-a8ce-5df2b58b3c66/volumes" Jun 03 21:51:20.168599 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:20.168588 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca44ae65-1559-44dd-b1b0-3f32720b50c4" path="/var/lib/kubelet/pods/ca44ae65-1559-44dd-b1b0-3f32720b50c4/volumes" Jun 03 21:51:59.591227 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.591187 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-t27s2"] Jun 03 21:51:59.591697 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.591521 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6713db2-dbd6-4d05-a8ce-5df2b58b3c66" containerName="authorino" Jun 03 21:51:59.591697 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.591531 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6713db2-dbd6-4d05-a8ce-5df2b58b3c66" containerName="authorino" Jun 03 21:51:59.591697 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.591554 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11c1d34f-16af-44aa-a0c9-ad7277a4cea9" containerName="authorino" Jun 03 21:51:59.591697 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.591560 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c1d34f-16af-44aa-a0c9-ad7277a4cea9" containerName="authorino" Jun 03 21:51:59.591697 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.591615 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="11c1d34f-16af-44aa-a0c9-ad7277a4cea9" containerName="authorino" Jun 03 21:51:59.591697 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.591625 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6713db2-dbd6-4d05-a8ce-5df2b58b3c66" containerName="authorino" Jun 03 21:51:59.594593 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.594575 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-t27s2" Jun 03 21:51:59.596963 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.596939 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 21:51:59.603187 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.603161 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-t27s2"] Jun 03 21:51:59.651222 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.651185 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm9n8\" (UniqueName: \"kubernetes.io/projected/86202efc-02ff-4b41-98f2-202348a644a6-kube-api-access-dm9n8\") pod \"payload-processing-7c6c859784-t27s2\" (UID: \"86202efc-02ff-4b41-98f2-202348a644a6\") " pod="openshift-ingress/payload-processing-7c6c859784-t27s2" Jun 03 21:51:59.752000 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.751961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm9n8\" (UniqueName: \"kubernetes.io/projected/86202efc-02ff-4b41-98f2-202348a644a6-kube-api-access-dm9n8\") pod \"payload-processing-7c6c859784-t27s2\" (UID: \"86202efc-02ff-4b41-98f2-202348a644a6\") " pod="openshift-ingress/payload-processing-7c6c859784-t27s2" Jun 03 21:51:59.760375 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.760343 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm9n8\" (UniqueName: \"kubernetes.io/projected/86202efc-02ff-4b41-98f2-202348a644a6-kube-api-access-dm9n8\") pod \"payload-processing-7c6c859784-t27s2\" (UID: \"86202efc-02ff-4b41-98f2-202348a644a6\") " pod="openshift-ingress/payload-processing-7c6c859784-t27s2" Jun 03 21:51:59.906564 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:51:59.906477 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-t27s2" Jun 03 21:52:00.043223 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:00.043186 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-t27s2"] Jun 03 21:52:00.045909 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:52:00.045880 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86202efc_02ff_4b41_98f2_202348a644a6.slice/crio-e51813a2a2880eacc5c470fc3c8be19f7e3dc5c778d633d8c10aadf438f6bcde WatchSource:0}: Error finding container e51813a2a2880eacc5c470fc3c8be19f7e3dc5c778d633d8c10aadf438f6bcde: Status 404 returned error can't find the container with id e51813a2a2880eacc5c470fc3c8be19f7e3dc5c778d633d8c10aadf438f6bcde Jun 03 21:52:00.424985 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:00.424949 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-t27s2" event={"ID":"86202efc-02ff-4b41-98f2-202348a644a6","Type":"ContainerStarted","Data":"e51813a2a2880eacc5c470fc3c8be19f7e3dc5c778d633d8c10aadf438f6bcde"} Jun 03 21:52:02.435629 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:02.435588 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-t27s2" event={"ID":"86202efc-02ff-4b41-98f2-202348a644a6","Type":"ContainerStarted","Data":"263d6889ba6f9a7bcadb8b8d07f3de5a57c0c9beab6c8bbb79d2c384c4fd72f7"} Jun 03 21:52:02.436130 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:02.435727 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-t27s2" Jun 03 21:52:02.452021 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:02.451979 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-t27s2" podStartSLOduration=1.281681831 podStartE2EDuration="3.451964733s" totalImagesPullingTime="2.170282902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:52:02.449875735 +0000 UTC m=+870.785969003" watchObservedRunningTime="2026-06-03 21:52:02.451964733 +0000 UTC m=+870.788058000" Jun 03 21:52:13.442680 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:13.442647 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-t27s2" Jun 03 21:52:32.155070 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:32.154997 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 21:52:32.157159 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:32.157140 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 21:52:47.510550 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.510520 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6fbcbf97dc-6bz5p"] Jun 03 21:52:47.517124 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.517100 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:52:47.519587 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.519564 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 21:52:47.521604 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.521580 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fbcbf97dc-6bz5p"] Jun 03 21:52:47.644471 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.644432 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7786d\" (UniqueName: \"kubernetes.io/projected/99276231-5cc6-432f-aef9-6ce866c7a171-kube-api-access-7786d\") pod \"authorino-6fbcbf97dc-6bz5p\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:52:47.644631 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.644496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99276231-5cc6-432f-aef9-6ce866c7a171-tls-cert\") pod \"authorino-6fbcbf97dc-6bz5p\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:52:47.644631 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.644514 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/99276231-5cc6-432f-aef9-6ce866c7a171-oidc-ca\") pod \"authorino-6fbcbf97dc-6bz5p\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:52:47.745794 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.745749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99276231-5cc6-432f-aef9-6ce866c7a171-tls-cert\") pod \"authorino-6fbcbf97dc-6bz5p\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:52:47.745794 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.745791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/99276231-5cc6-432f-aef9-6ce866c7a171-oidc-ca\") pod \"authorino-6fbcbf97dc-6bz5p\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:52:47.746021 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.745850 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7786d\" (UniqueName: \"kubernetes.io/projected/99276231-5cc6-432f-aef9-6ce866c7a171-kube-api-access-7786d\") pod \"authorino-6fbcbf97dc-6bz5p\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:52:47.746478 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.746455 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/99276231-5cc6-432f-aef9-6ce866c7a171-oidc-ca\") pod \"authorino-6fbcbf97dc-6bz5p\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:52:47.748242 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.748219 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99276231-5cc6-432f-aef9-6ce866c7a171-tls-cert\") pod \"authorino-6fbcbf97dc-6bz5p\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:52:47.753662 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.753639 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7786d\" (UniqueName: \"kubernetes.io/projected/99276231-5cc6-432f-aef9-6ce866c7a171-kube-api-access-7786d\") pod \"authorino-6fbcbf97dc-6bz5p\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:52:47.826632 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.826554 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:52:47.958093 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:47.958061 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fbcbf97dc-6bz5p"] Jun 03 21:52:47.958353 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:52:47.958328 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99276231_5cc6_432f_aef9_6ce866c7a171.slice/crio-c2b5f00624ccdf7b3fa0f9fca63156c92cbef30bfb59673f5fbb7d81bcdf12d5 WatchSource:0}: Error finding container c2b5f00624ccdf7b3fa0f9fca63156c92cbef30bfb59673f5fbb7d81bcdf12d5: Status 404 returned error can't find the container with id c2b5f00624ccdf7b3fa0f9fca63156c92cbef30bfb59673f5fbb7d81bcdf12d5 Jun 03 21:52:48.641436 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:48.641400 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" event={"ID":"99276231-5cc6-432f-aef9-6ce866c7a171","Type":"ContainerStarted","Data":"e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f"} Jun 03 21:52:48.641812 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:48.641443 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" event={"ID":"99276231-5cc6-432f-aef9-6ce866c7a171","Type":"ContainerStarted","Data":"c2b5f00624ccdf7b3fa0f9fca63156c92cbef30bfb59673f5fbb7d81bcdf12d5"} Jun 03 21:52:48.658819 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:48.658768 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" podStartSLOduration=1.192200425 podStartE2EDuration="1.658752055s" totalImagesPullingTime="466.55163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:52:48.65710246 +0000 UTC m=+916.993195753" watchObservedRunningTime="2026-06-03 21:52:48.658752055 +0000 UTC m=+916.994845323" Jun 03 21:52:48.693622 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:48.693581 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dfcbc6955-d6qp6"] Jun 03 21:52:48.693846 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:48.693800 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" podUID="a378a6ec-3fdf-4d54-86c1-510560eeeb66" containerName="authorino" containerID="cri-o://70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5" gracePeriod=30 Jun 03 21:52:48.939044 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:48.939022 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" Jun 03 21:52:49.057538 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.057454 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgzsh\" (UniqueName: \"kubernetes.io/projected/a378a6ec-3fdf-4d54-86c1-510560eeeb66-kube-api-access-lgzsh\") pod \"a378a6ec-3fdf-4d54-86c1-510560eeeb66\" (UID: \"a378a6ec-3fdf-4d54-86c1-510560eeeb66\") " Jun 03 21:52:49.057538 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.057500 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a378a6ec-3fdf-4d54-86c1-510560eeeb66-tls-cert\") pod \"a378a6ec-3fdf-4d54-86c1-510560eeeb66\" (UID: \"a378a6ec-3fdf-4d54-86c1-510560eeeb66\") " Jun 03 21:52:49.059556 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.059532 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a378a6ec-3fdf-4d54-86c1-510560eeeb66-kube-api-access-lgzsh" (OuterVolumeSpecName: "kube-api-access-lgzsh") pod "a378a6ec-3fdf-4d54-86c1-510560eeeb66" (UID: "a378a6ec-3fdf-4d54-86c1-510560eeeb66"). InnerVolumeSpecName "kube-api-access-lgzsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:52:49.068177 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.068152 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a378a6ec-3fdf-4d54-86c1-510560eeeb66-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a378a6ec-3fdf-4d54-86c1-510560eeeb66" (UID: "a378a6ec-3fdf-4d54-86c1-510560eeeb66"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:52:49.159027 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.158997 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgzsh\" (UniqueName: \"kubernetes.io/projected/a378a6ec-3fdf-4d54-86c1-510560eeeb66-kube-api-access-lgzsh\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:52:49.159027 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.159023 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a378a6ec-3fdf-4d54-86c1-510560eeeb66-tls-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:52:49.646694 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.646659 2554 generic.go:356] "Generic (PLEG): container finished" podID="a378a6ec-3fdf-4d54-86c1-510560eeeb66" containerID="70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5" exitCode=0 Jun 03 21:52:49.647175 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.646701 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" Jun 03 21:52:49.647175 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.646747 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" event={"ID":"a378a6ec-3fdf-4d54-86c1-510560eeeb66","Type":"ContainerDied","Data":"70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5"} Jun 03 21:52:49.647175 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.646791 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dfcbc6955-d6qp6" event={"ID":"a378a6ec-3fdf-4d54-86c1-510560eeeb66","Type":"ContainerDied","Data":"a89fd21eed1f514c8cb3c400604ab2608c2ef39d1e872a3744ce9ca11bdf2af4"} Jun 03 21:52:49.647175 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.646815 2554 scope.go:117] "RemoveContainer" containerID="70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5" Jun 03 21:52:49.655303 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.655286 2554 scope.go:117] "RemoveContainer" containerID="70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5" Jun 03 21:52:49.655537 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:52:49.655520 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5\": container with ID starting with 70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5 not found: ID does not exist" containerID="70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5" Jun 03 21:52:49.655599 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.655548 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5"} err="failed to get container status \"70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5\": rpc error: code = NotFound desc = could not find container \"70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5\": container with ID starting with 70022e3c15897b1a92f24a39cdb4ba11b3e7aa9f4294b6c96161b871a72bb5c5 not found: ID does not exist" Jun 03 21:52:49.667166 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.667142 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dfcbc6955-d6qp6"] Jun 03 21:52:49.671097 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:49.671078 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dfcbc6955-d6qp6"] Jun 03 21:52:50.167032 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:52:50.166996 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a378a6ec-3fdf-4d54-86c1-510560eeeb66" path="/var/lib/kubelet/pods/a378a6ec-3fdf-4d54-86c1-510560eeeb66/volumes" Jun 03 21:53:17.196309 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.196277 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw"] Jun 03 21:53:17.198732 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.196609 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a378a6ec-3fdf-4d54-86c1-510560eeeb66" containerName="authorino" Jun 03 21:53:17.198732 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.196620 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a378a6ec-3fdf-4d54-86c1-510560eeeb66" containerName="authorino" Jun 03 21:53:17.198732 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.196688 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a378a6ec-3fdf-4d54-86c1-510560eeeb66" containerName="authorino" Jun 03 21:53:17.199563 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.199546 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.203316 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.203286 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 21:53:17.203316 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.203301 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z2s69\"" Jun 03 21:53:17.203518 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.203326 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 21:53:17.203518 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.203301 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 21:53:17.209094 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.209071 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw"] Jun 03 21:53:17.277915 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.277882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.278053 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.277974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a446f4-cef4-492e-b194-c697e418e0d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.278137 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.278120 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.278208 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.278163 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.283898 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.278268 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nk42\" (UniqueName: \"kubernetes.io/projected/82a446f4-cef4-492e-b194-c697e418e0d5-kube-api-access-6nk42\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.283898 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.278933 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.379813 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.379784 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a446f4-cef4-492e-b194-c697e418e0d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.379813 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.379819 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.380042 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.379848 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.380103 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.380040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nk42\" (UniqueName: \"kubernetes.io/projected/82a446f4-cef4-492e-b194-c697e418e0d5-kube-api-access-6nk42\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.380103 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.380070 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.380211 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.380169 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.380336 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.380278 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.380419 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.380401 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.380478 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.380432 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.381987 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.381969 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82a446f4-cef4-492e-b194-c697e418e0d5-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.382244 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.382228 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a446f4-cef4-492e-b194-c697e418e0d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.389205 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.389186 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nk42\" (UniqueName: \"kubernetes.io/projected/82a446f4-cef4-492e-b194-c697e418e0d5-kube-api-access-6nk42\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-gwlbw\" (UID: \"82a446f4-cef4-492e-b194-c697e418e0d5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.510542 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.510483 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:17.646778 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.646753 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw"] Jun 03 21:53:17.649449 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:53:17.649419 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a446f4_cef4_492e_b194_c697e418e0d5.slice/crio-1eed7f9593087da849829a84eb3d1453faa88867fcc5c01ae2c4107495aab159 WatchSource:0}: Error finding container 1eed7f9593087da849829a84eb3d1453faa88867fcc5c01ae2c4107495aab159: Status 404 returned error can't find the container with id 1eed7f9593087da849829a84eb3d1453faa88867fcc5c01ae2c4107495aab159 Jun 03 21:53:17.772300 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:17.772217 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" event={"ID":"82a446f4-cef4-492e-b194-c697e418e0d5","Type":"ContainerStarted","Data":"1eed7f9593087da849829a84eb3d1453faa88867fcc5c01ae2c4107495aab159"} Jun 03 21:53:20.788636 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:20.788587 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" event={"ID":"82a446f4-cef4-492e-b194-c697e418e0d5","Type":"ContainerStarted","Data":"1b33a1b76e9712d25b021b5dcd4493f3078a81a6604deb634fed2ff358f78082"} Jun 03 21:53:22.800003 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:22.799968 2554 generic.go:356] "Generic (PLEG): container finished" podID="82a446f4-cef4-492e-b194-c697e418e0d5" containerID="1b33a1b76e9712d25b021b5dcd4493f3078a81a6604deb634fed2ff358f78082" exitCode=0 Jun 03 21:53:22.800394 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:22.800047 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" event={"ID":"82a446f4-cef4-492e-b194-c697e418e0d5","Type":"ContainerDied","Data":"1b33a1b76e9712d25b021b5dcd4493f3078a81a6604deb634fed2ff358f78082"} Jun 03 21:53:24.810659 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:24.810626 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" event={"ID":"82a446f4-cef4-492e-b194-c697e418e0d5","Type":"ContainerStarted","Data":"6f07e39951a8bf8e041ac340f0070d55341d237f7ce3b6d0fccd1b02db1cb7af"} Jun 03 21:53:24.830005 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:24.829956 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" podStartSLOduration=2.493572477 podStartE2EDuration="7.829943309s" totalImagesPullingTime="4.004849946s" totalInitContainerRuntime="1.331520886s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:53:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:53:24.829072105 +0000 UTC m=+953.165165387" watchObservedRunningTime="2026-06-03 21:53:24.829943309 +0000 UTC m=+953.166036575" Jun 03 21:53:27.511131 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:27.511099 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:27.511545 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:27.511164 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:27.523490 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:27.523464 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:27.835414 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:27.835344 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-gwlbw" Jun 03 21:53:41.793931 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:41.793901 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96"] Jun 03 21:53:41.799724 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:41.799703 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:41.802455 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:41.802427 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 21:53:41.806496 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:41.806452 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96"] Jun 03 21:53:41.987591 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:41.987559 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:41.987591 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:41.987591 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:41.987788 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:41.987615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:41.987788 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:41.987631 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:41.987788 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:41.987647 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:41.987788 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:41.987706 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sddj\" (UniqueName: \"kubernetes.io/projected/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-kube-api-access-8sddj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.088586 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.088522 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.088586 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.088552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.088586 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.088579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.088873 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.088594 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.088873 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.088622 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.088873 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.088651 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sddj\" (UniqueName: \"kubernetes.io/projected/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-kube-api-access-8sddj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.089028 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.088987 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.089068 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.089041 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.089103 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.089081 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.090951 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.090923 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.091055 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.090974 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.096951 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.096920 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sddj\" (UniqueName: \"kubernetes.io/projected/498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9-kube-api-access-8sddj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96\" (UID: \"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.110881 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.110856 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:42.241507 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.241483 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96"] Jun 03 21:53:42.243397 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:53:42.243371 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498ec73e_6c2b_4c18_ad54_c09ac1fa2ac9.slice/crio-f0645e3db4c741c26cafc3006ad692b150fe1ed5aea471a8a4d8cdc1166d9e5f WatchSource:0}: Error finding container f0645e3db4c741c26cafc3006ad692b150fe1ed5aea471a8a4d8cdc1166d9e5f: Status 404 returned error can't find the container with id f0645e3db4c741c26cafc3006ad692b150fe1ed5aea471a8a4d8cdc1166d9e5f Jun 03 21:53:42.897991 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.897957 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" event={"ID":"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9","Type":"ContainerStarted","Data":"2e5fb63c06297580e4bc3844ec9e4a31410da5c8e3db75442b7ef3699bd38609"} Jun 03 21:53:42.898350 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:42.898017 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" event={"ID":"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9","Type":"ContainerStarted","Data":"f0645e3db4c741c26cafc3006ad692b150fe1ed5aea471a8a4d8cdc1166d9e5f"} Jun 03 21:53:43.903538 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:43.903452 2554 generic.go:356] "Generic (PLEG): container finished" podID="498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9" containerID="2e5fb63c06297580e4bc3844ec9e4a31410da5c8e3db75442b7ef3699bd38609" exitCode=0 Jun 03 21:53:43.903538 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:43.903490 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" event={"ID":"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9","Type":"ContainerDied","Data":"2e5fb63c06297580e4bc3844ec9e4a31410da5c8e3db75442b7ef3699bd38609"} Jun 03 21:53:44.915336 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:44.915258 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" event={"ID":"498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9","Type":"ContainerStarted","Data":"e018839492dea4744bb466f7f3ea33064b38a82add11155dea4b2ca7eb36d5ca"} Jun 03 21:53:44.934120 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:44.934075 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" podStartSLOduration=2.528403152 podStartE2EDuration="3.934062021s" totalImagesPullingTime="179.010047ms" totalInitContainerRuntime="1.226648822s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:53:44.932572515 +0000 UTC m=+973.268665782" watchObservedRunningTime="2026-06-03 21:53:44.934062021 +0000 UTC m=+973.270155287" Jun 03 21:53:52.081406 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.081375 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db"] Jun 03 21:53:52.092076 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.092056 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.094722 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.094693 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 21:53:52.097504 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.097482 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db"] Jun 03 21:53:52.111179 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.111156 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:52.111270 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.111205 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:52.123215 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.123196 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:52.169791 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.169766 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.169910 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.169796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.169910 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.169829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.169910 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.169895 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.170012 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.169940 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.170012 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.169974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmfgl\" (UniqueName: \"kubernetes.io/projected/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-kube-api-access-wmfgl\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.270523 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.270494 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmfgl\" (UniqueName: \"kubernetes.io/projected/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-kube-api-access-wmfgl\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.270622 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.270566 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.270622 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.270585 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.270622 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.270605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.270782 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.270635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.270782 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.270652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.271036 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.270998 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.271132 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.271047 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.271132 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.271073 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.272861 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.272826 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.273153 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.273139 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.277592 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.277569 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmfgl\" (UniqueName: \"kubernetes.io/projected/ff44cb5d-3c78-45ab-8ab5-0aba55c58dba-kube-api-access-wmfgl\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-v64db\" (UID: \"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.403277 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.403197 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:53:52.530924 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.530902 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db"] Jun 03 21:53:52.533054 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:53:52.533030 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff44cb5d_3c78_45ab_8ab5_0aba55c58dba.slice/crio-22e512b97948f3613f69070d463d3b7ec8a7d684c11f5677173cfd3371d96ec7 WatchSource:0}: Error finding container 22e512b97948f3613f69070d463d3b7ec8a7d684c11f5677173cfd3371d96ec7: Status 404 returned error can't find the container with id 22e512b97948f3613f69070d463d3b7ec8a7d684c11f5677173cfd3371d96ec7 Jun 03 21:53:52.958418 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.958379 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" event={"ID":"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba","Type":"ContainerStarted","Data":"0877cec61409da3d189c2addf4e25e9f49955f3b747745f4f78fcd3c8f262800"} Jun 03 21:53:52.958617 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.958449 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" event={"ID":"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba","Type":"ContainerStarted","Data":"22e512b97948f3613f69070d463d3b7ec8a7d684c11f5677173cfd3371d96ec7"} Jun 03 21:53:52.975926 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:52.975900 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96" Jun 03 21:53:53.971184 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:53.971138 2554 generic.go:356] "Generic (PLEG): container finished" podID="ff44cb5d-3c78-45ab-8ab5-0aba55c58dba" containerID="0877cec61409da3d189c2addf4e25e9f49955f3b747745f4f78fcd3c8f262800" exitCode=0 Jun 03 21:53:53.971650 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:53.971599 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" event={"ID":"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba","Type":"ContainerDied","Data":"0877cec61409da3d189c2addf4e25e9f49955f3b747745f4f78fcd3c8f262800"} Jun 03 21:53:54.978880 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:54.978847 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" event={"ID":"ff44cb5d-3c78-45ab-8ab5-0aba55c58dba","Type":"ContainerStarted","Data":"b72cdbbf9ec2312758aedaf15eb460b43ee6e9ac01f46cc2af9310204d6c1ed9"} Jun 03 21:53:54.997359 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:53:54.997312 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" podStartSLOduration=1.5023465169999999 podStartE2EDuration="2.997296642s" totalImagesPullingTime="206.372757ms" totalInitContainerRuntime="1.288577368s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:53:54.994768748 +0000 UTC m=+983.330862015" watchObservedRunningTime="2026-06-03 21:53:54.997296642 +0000 UTC m=+983.333389908" Jun 03 21:54:02.403710 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:02.403674 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:54:02.404146 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:02.403731 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:54:02.416418 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:02.416396 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:54:03.027532 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:03.027506 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-v64db" Jun 03 21:54:31.505530 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.505498 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-656b8999c4-lszf5"] Jun 03 21:54:31.509300 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.509283 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-656b8999c4-lszf5" Jun 03 21:54:31.516677 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.516653 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-656b8999c4-lszf5"] Jun 03 21:54:31.621977 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.621946 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml7d7\" (UniqueName: \"kubernetes.io/projected/7839dbe0-c18f-427f-9b7d-4b582536d048-kube-api-access-ml7d7\") pod \"authorino-656b8999c4-lszf5\" (UID: \"7839dbe0-c18f-427f-9b7d-4b582536d048\") " pod="kuadrant-system/authorino-656b8999c4-lszf5" Jun 03 21:54:31.622118 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.621984 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7839dbe0-c18f-427f-9b7d-4b582536d048-tls-cert\") pod \"authorino-656b8999c4-lszf5\" (UID: \"7839dbe0-c18f-427f-9b7d-4b582536d048\") " pod="kuadrant-system/authorino-656b8999c4-lszf5" Jun 03 21:54:31.622118 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.622080 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7839dbe0-c18f-427f-9b7d-4b582536d048-oidc-ca\") pod \"authorino-656b8999c4-lszf5\" (UID: \"7839dbe0-c18f-427f-9b7d-4b582536d048\") " pod="kuadrant-system/authorino-656b8999c4-lszf5" Jun 03 21:54:31.722775 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.722742 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7839dbe0-c18f-427f-9b7d-4b582536d048-oidc-ca\") pod \"authorino-656b8999c4-lszf5\" (UID: \"7839dbe0-c18f-427f-9b7d-4b582536d048\") " pod="kuadrant-system/authorino-656b8999c4-lszf5" Jun 03 21:54:31.722935 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.722795 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml7d7\" (UniqueName: \"kubernetes.io/projected/7839dbe0-c18f-427f-9b7d-4b582536d048-kube-api-access-ml7d7\") pod \"authorino-656b8999c4-lszf5\" (UID: \"7839dbe0-c18f-427f-9b7d-4b582536d048\") " pod="kuadrant-system/authorino-656b8999c4-lszf5" Jun 03 21:54:31.722935 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.722814 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7839dbe0-c18f-427f-9b7d-4b582536d048-tls-cert\") pod \"authorino-656b8999c4-lszf5\" (UID: \"7839dbe0-c18f-427f-9b7d-4b582536d048\") " pod="kuadrant-system/authorino-656b8999c4-lszf5" Jun 03 21:54:31.723367 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.723347 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7839dbe0-c18f-427f-9b7d-4b582536d048-oidc-ca\") pod \"authorino-656b8999c4-lszf5\" (UID: \"7839dbe0-c18f-427f-9b7d-4b582536d048\") " pod="kuadrant-system/authorino-656b8999c4-lszf5" Jun 03 21:54:31.725149 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.725133 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7839dbe0-c18f-427f-9b7d-4b582536d048-tls-cert\") pod \"authorino-656b8999c4-lszf5\" (UID: \"7839dbe0-c18f-427f-9b7d-4b582536d048\") " pod="kuadrant-system/authorino-656b8999c4-lszf5" Jun 03 21:54:31.730456 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.730429 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml7d7\" (UniqueName: \"kubernetes.io/projected/7839dbe0-c18f-427f-9b7d-4b582536d048-kube-api-access-ml7d7\") pod \"authorino-656b8999c4-lszf5\" (UID: \"7839dbe0-c18f-427f-9b7d-4b582536d048\") " pod="kuadrant-system/authorino-656b8999c4-lszf5" Jun 03 21:54:31.818982 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.818929 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-656b8999c4-lszf5" Jun 03 21:54:31.944452 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.944425 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-656b8999c4-lszf5"] Jun 03 21:54:31.946526 ip-10-0-141-1 kubenswrapper[2554]: W0603 21:54:31.946498 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7839dbe0_c18f_427f_9b7d_4b582536d048.slice/crio-25fe7cd73ccba1c87cecef51796b950d894f56a47d0224ab78f5ca829131387e WatchSource:0}: Error finding container 25fe7cd73ccba1c87cecef51796b950d894f56a47d0224ab78f5ca829131387e: Status 404 returned error can't find the container with id 25fe7cd73ccba1c87cecef51796b950d894f56a47d0224ab78f5ca829131387e Jun 03 21:54:31.947899 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:31.947881 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:54:32.156873 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:32.156773 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-656b8999c4-lszf5" event={"ID":"7839dbe0-c18f-427f-9b7d-4b582536d048","Type":"ContainerStarted","Data":"25fe7cd73ccba1c87cecef51796b950d894f56a47d0224ab78f5ca829131387e"} Jun 03 21:54:33.164338 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.164293 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-656b8999c4-lszf5" event={"ID":"7839dbe0-c18f-427f-9b7d-4b582536d048","Type":"ContainerStarted","Data":"f18bb33c690757afba062ac8e6b897756806f3d686818d1208c6613283af1e07"} Jun 03 21:54:33.181241 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.181197 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-656b8999c4-lszf5" podStartSLOduration=1.789091262 podStartE2EDuration="2.181183211s" totalImagesPullingTime="392.091949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:54:33.179201791 +0000 UTC m=+1021.515295059" watchObservedRunningTime="2026-06-03 21:54:33.181183211 +0000 UTC m=+1021.517276478" Jun 03 21:54:33.205476 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.205444 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fbcbf97dc-6bz5p"] Jun 03 21:54:33.205637 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.205617 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" podUID="99276231-5cc6-432f-aef9-6ce866c7a171" containerName="authorino" containerID="cri-o://e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f" gracePeriod=30 Jun 03 21:54:33.463348 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.463325 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:54:33.639574 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.639533 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99276231-5cc6-432f-aef9-6ce866c7a171-tls-cert\") pod \"99276231-5cc6-432f-aef9-6ce866c7a171\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " Jun 03 21:54:33.639766 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.639587 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/99276231-5cc6-432f-aef9-6ce866c7a171-oidc-ca\") pod \"99276231-5cc6-432f-aef9-6ce866c7a171\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " Jun 03 21:54:33.639766 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.639645 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7786d\" (UniqueName: \"kubernetes.io/projected/99276231-5cc6-432f-aef9-6ce866c7a171-kube-api-access-7786d\") pod \"99276231-5cc6-432f-aef9-6ce866c7a171\" (UID: \"99276231-5cc6-432f-aef9-6ce866c7a171\") " Jun 03 21:54:33.641660 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.641630 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99276231-5cc6-432f-aef9-6ce866c7a171-kube-api-access-7786d" (OuterVolumeSpecName: "kube-api-access-7786d") pod "99276231-5cc6-432f-aef9-6ce866c7a171" (UID: "99276231-5cc6-432f-aef9-6ce866c7a171"). InnerVolumeSpecName "kube-api-access-7786d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:54:33.645912 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.645887 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99276231-5cc6-432f-aef9-6ce866c7a171-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "99276231-5cc6-432f-aef9-6ce866c7a171" (UID: "99276231-5cc6-432f-aef9-6ce866c7a171"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 21:54:33.649819 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.649793 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99276231-5cc6-432f-aef9-6ce866c7a171-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "99276231-5cc6-432f-aef9-6ce866c7a171" (UID: "99276231-5cc6-432f-aef9-6ce866c7a171"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 21:54:33.740680 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.740655 2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99276231-5cc6-432f-aef9-6ce866c7a171-tls-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:54:33.740680 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.740681 2554 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/99276231-5cc6-432f-aef9-6ce866c7a171-oidc-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:54:33.740813 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:33.740691 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7786d\" (UniqueName: \"kubernetes.io/projected/99276231-5cc6-432f-aef9-6ce866c7a171-kube-api-access-7786d\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 21:54:34.169643 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:34.169561 2554 generic.go:356] "Generic (PLEG): container finished" podID="99276231-5cc6-432f-aef9-6ce866c7a171" containerID="e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f" exitCode=0 Jun 03 21:54:34.169643 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:34.169600 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" Jun 03 21:54:34.169643 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:34.169599 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" event={"ID":"99276231-5cc6-432f-aef9-6ce866c7a171","Type":"ContainerDied","Data":"e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f"} Jun 03 21:54:34.169643 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:34.169641 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fbcbf97dc-6bz5p" event={"ID":"99276231-5cc6-432f-aef9-6ce866c7a171","Type":"ContainerDied","Data":"c2b5f00624ccdf7b3fa0f9fca63156c92cbef30bfb59673f5fbb7d81bcdf12d5"} Jun 03 21:54:34.170174 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:34.169663 2554 scope.go:117] "RemoveContainer" containerID="e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f" Jun 03 21:54:34.179182 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:34.179167 2554 scope.go:117] "RemoveContainer" containerID="e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f" Jun 03 21:54:34.179439 ip-10-0-141-1 kubenswrapper[2554]: E0603 21:54:34.179421 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f\": container with ID starting with e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f not found: ID does not exist" containerID="e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f" Jun 03 21:54:34.179486 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:34.179447 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f"} err="failed to get container status \"e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f\": rpc error: code = NotFound desc = could not find container \"e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f\": container with ID starting with e55cc7562c2aaa4e56eba859ac788f20b6f7eb251c6f7d7f4371deccf711920f not found: ID does not exist" Jun 03 21:54:34.189906 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:34.189881 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fbcbf97dc-6bz5p"] Jun 03 21:54:34.193751 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:34.193730 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6fbcbf97dc-6bz5p"] Jun 03 21:54:36.167423 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:54:36.167386 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99276231-5cc6-432f-aef9-6ce866c7a171" path="/var/lib/kubelet/pods/99276231-5cc6-432f-aef9-6ce866c7a171/volumes" Jun 03 21:57:32.184320 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:57:32.184294 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 21:57:32.187775 ip-10-0-141-1 kubenswrapper[2554]: I0603 21:57:32.187754 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 22:00:00.136792 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.136759 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675400-vrhh9"] Jun 03 22:00:00.137231 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.137189 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99276231-5cc6-432f-aef9-6ce866c7a171" containerName="authorino" Jun 03 22:00:00.137231 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.137202 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="99276231-5cc6-432f-aef9-6ce866c7a171" containerName="authorino" Jun 03 22:00:00.137305 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.137276 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="99276231-5cc6-432f-aef9-6ce866c7a171" containerName="authorino" Jun 03 22:00:00.140186 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.140166 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" Jun 03 22:00:00.142795 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.142772 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gbk4b\"" Jun 03 22:00:00.153164 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.153144 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675400-vrhh9"] Jun 03 22:00:00.273278 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.273223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjw8g\" (UniqueName: \"kubernetes.io/projected/7fc3263a-16d6-47c8-9e68-0658ce6c3991-kube-api-access-jjw8g\") pod \"maas-api-key-cleanup-29675400-vrhh9\" (UID: \"7fc3263a-16d6-47c8-9e68-0658ce6c3991\") " pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" Jun 03 22:00:00.374586 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.374550 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjw8g\" (UniqueName: \"kubernetes.io/projected/7fc3263a-16d6-47c8-9e68-0658ce6c3991-kube-api-access-jjw8g\") pod \"maas-api-key-cleanup-29675400-vrhh9\" (UID: \"7fc3263a-16d6-47c8-9e68-0658ce6c3991\") " pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" Jun 03 22:00:00.384145 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.384113 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjw8g\" (UniqueName: \"kubernetes.io/projected/7fc3263a-16d6-47c8-9e68-0658ce6c3991-kube-api-access-jjw8g\") pod \"maas-api-key-cleanup-29675400-vrhh9\" (UID: \"7fc3263a-16d6-47c8-9e68-0658ce6c3991\") " pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" Jun 03 22:00:00.450866 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.450821 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" Jun 03 22:00:00.581748 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.581725 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675400-vrhh9"] Jun 03 22:00:00.583737 ip-10-0-141-1 kubenswrapper[2554]: W0603 22:00:00.583711 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc3263a_16d6_47c8_9e68_0658ce6c3991.slice/crio-7d976562c3b887ed9f742f4b0644faa976a495ab3c0a92500d8dee2803d66595 WatchSource:0}: Error finding container 7d976562c3b887ed9f742f4b0644faa976a495ab3c0a92500d8dee2803d66595: Status 404 returned error can't find the container with id 7d976562c3b887ed9f742f4b0644faa976a495ab3c0a92500d8dee2803d66595 Jun 03 22:00:00.585803 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.585788 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 22:00:00.701314 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:00.701228 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" event={"ID":"7fc3263a-16d6-47c8-9e68-0658ce6c3991","Type":"ContainerStarted","Data":"7d976562c3b887ed9f742f4b0644faa976a495ab3c0a92500d8dee2803d66595"} Jun 03 22:00:13.772491 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:13.772451 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" event={"ID":"7fc3263a-16d6-47c8-9e68-0658ce6c3991","Type":"ContainerStarted","Data":"068f34e9e9ffff1e8f93451d48dedd4116da7a3884c5fee7226ef9ca2f3459ec"} Jun 03 22:00:13.788407 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:13.788352 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" podStartSLOduration=1.013661995 podStartE2EDuration="13.788335874s" totalImagesPullingTime="12.774673879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:00:13.786791152 +0000 UTC m=+1362.122884439" watchObservedRunningTime="2026-06-03 22:00:13.788335874 +0000 UTC m=+1362.124429140" Jun 03 22:00:14.778723 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:14.778686 2554 generic.go:356] "Generic (PLEG): container finished" podID="7fc3263a-16d6-47c8-9e68-0658ce6c3991" containerID="068f34e9e9ffff1e8f93451d48dedd4116da7a3884c5fee7226ef9ca2f3459ec" exitCode=0 Jun 03 22:00:14.779116 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:14.778771 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" event={"ID":"7fc3263a-16d6-47c8-9e68-0658ce6c3991","Type":"ContainerDied","Data":"068f34e9e9ffff1e8f93451d48dedd4116da7a3884c5fee7226ef9ca2f3459ec"} Jun 03 22:00:15.909179 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:15.909157 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" Jun 03 22:00:16.014113 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:16.014080 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjw8g\" (UniqueName: \"kubernetes.io/projected/7fc3263a-16d6-47c8-9e68-0658ce6c3991-kube-api-access-jjw8g\") pod \"7fc3263a-16d6-47c8-9e68-0658ce6c3991\" (UID: \"7fc3263a-16d6-47c8-9e68-0658ce6c3991\") " Jun 03 22:00:16.016099 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:16.016076 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fc3263a-16d6-47c8-9e68-0658ce6c3991-kube-api-access-jjw8g" (OuterVolumeSpecName: "kube-api-access-jjw8g") pod "7fc3263a-16d6-47c8-9e68-0658ce6c3991" (UID: "7fc3263a-16d6-47c8-9e68-0658ce6c3991"). InnerVolumeSpecName "kube-api-access-jjw8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:00:16.114741 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:16.114682 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjw8g\" (UniqueName: \"kubernetes.io/projected/7fc3263a-16d6-47c8-9e68-0658ce6c3991-kube-api-access-jjw8g\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:00:16.789763 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:16.789725 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" Jun 03 22:00:16.789763 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:16.789752 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675400-vrhh9" event={"ID":"7fc3263a-16d6-47c8-9e68-0658ce6c3991","Type":"ContainerDied","Data":"7d976562c3b887ed9f742f4b0644faa976a495ab3c0a92500d8dee2803d66595"} Jun 03 22:00:16.789985 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:00:16.789821 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d976562c3b887ed9f742f4b0644faa976a495ab3c0a92500d8dee2803d66595" Jun 03 22:02:32.212001 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:02:32.211971 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 22:02:32.217726 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:02:32.217708 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 22:06:36.075949 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.075910 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl"] Jun 03 22:06:36.078453 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.076144 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" podUID="be7dff14-cd51-48ff-b526-2d0d5316d8f6" containerName="manager" containerID="cri-o://7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963" gracePeriod=10 Jun 03 22:06:36.529685 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.529661 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 22:06:36.588776 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.588709 2554 generic.go:356] "Generic (PLEG): container finished" podID="be7dff14-cd51-48ff-b526-2d0d5316d8f6" containerID="7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963" exitCode=0 Jun 03 22:06:36.588776 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.588745 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" Jun 03 22:06:36.589004 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.588798 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" event={"ID":"be7dff14-cd51-48ff-b526-2d0d5316d8f6","Type":"ContainerDied","Data":"7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963"} Jun 03 22:06:36.589004 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.588871 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl" event={"ID":"be7dff14-cd51-48ff-b526-2d0d5316d8f6","Type":"ContainerDied","Data":"e05c2e6cdcf96d246f3f32b118bcdb4f7f98a6f4aec3b85c3ecb0bb75453d51b"} Jun 03 22:06:36.589004 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.588906 2554 scope.go:117] "RemoveContainer" containerID="7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963" Jun 03 22:06:36.598264 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.598238 2554 scope.go:117] "RemoveContainer" containerID="7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963" Jun 03 22:06:36.598501 ip-10-0-141-1 kubenswrapper[2554]: E0603 22:06:36.598480 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963\": container with ID starting with 7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963 not found: ID does not exist" containerID="7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963" Jun 03 22:06:36.598577 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.598511 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963"} err="failed to get container status \"7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963\": rpc error: code = NotFound desc = could not find container \"7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963\": container with ID starting with 7e1630dfb9f9eb68190f1688d7d765be102639a0ea9d033d7221ab0d33ab6963 not found: ID does not exist" Jun 03 22:06:36.665676 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.665651 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtlp7\" (UniqueName: \"kubernetes.io/projected/be7dff14-cd51-48ff-b526-2d0d5316d8f6-kube-api-access-mtlp7\") pod \"be7dff14-cd51-48ff-b526-2d0d5316d8f6\" (UID: \"be7dff14-cd51-48ff-b526-2d0d5316d8f6\") " Jun 03 22:06:36.665815 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.665720 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be7dff14-cd51-48ff-b526-2d0d5316d8f6-extensions-socket-volume\") pod \"be7dff14-cd51-48ff-b526-2d0d5316d8f6\" (UID: \"be7dff14-cd51-48ff-b526-2d0d5316d8f6\") " Jun 03 22:06:36.666045 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.666023 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be7dff14-cd51-48ff-b526-2d0d5316d8f6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "be7dff14-cd51-48ff-b526-2d0d5316d8f6" (UID: "be7dff14-cd51-48ff-b526-2d0d5316d8f6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:06:36.667612 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.667591 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be7dff14-cd51-48ff-b526-2d0d5316d8f6-kube-api-access-mtlp7" (OuterVolumeSpecName: "kube-api-access-mtlp7") pod "be7dff14-cd51-48ff-b526-2d0d5316d8f6" (UID: "be7dff14-cd51-48ff-b526-2d0d5316d8f6"). InnerVolumeSpecName "kube-api-access-mtlp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:06:36.767156 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.767129 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtlp7\" (UniqueName: \"kubernetes.io/projected/be7dff14-cd51-48ff-b526-2d0d5316d8f6-kube-api-access-mtlp7\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:06:36.767156 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.767152 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be7dff14-cd51-48ff-b526-2d0d5316d8f6-extensions-socket-volume\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:06:36.911709 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.911679 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl"] Jun 03 22:06:36.915756 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:36.915733 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r29tl"] Jun 03 22:06:38.167111 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:06:38.167081 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be7dff14-cd51-48ff-b526-2d0d5316d8f6" path="/var/lib/kubelet/pods/be7dff14-cd51-48ff-b526-2d0d5316d8f6/volumes" Jun 03 22:07:32.240003 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:07:32.239976 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 22:07:32.247092 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:07:32.247072 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 22:12:32.267397 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:12:32.267366 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 22:12:32.275318 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:12:32.275296 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 22:15:00.137281 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.137204 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675415-q6md7"] Jun 03 22:15:00.137737 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.137546 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be7dff14-cd51-48ff-b526-2d0d5316d8f6" containerName="manager" Jun 03 22:15:00.137737 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.137556 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="be7dff14-cd51-48ff-b526-2d0d5316d8f6" containerName="manager" Jun 03 22:15:00.137737 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.137568 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc3263a-16d6-47c8-9e68-0658ce6c3991" containerName="cleanup" Jun 03 22:15:00.137737 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.137574 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc3263a-16d6-47c8-9e68-0658ce6c3991" containerName="cleanup" Jun 03 22:15:00.138167 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.138141 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="be7dff14-cd51-48ff-b526-2d0d5316d8f6" containerName="manager" Jun 03 22:15:00.138416 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.138391 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fc3263a-16d6-47c8-9e68-0658ce6c3991" containerName="cleanup" Jun 03 22:15:00.144238 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.142542 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" Jun 03 22:15:00.146301 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.146280 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gbk4b\"" Jun 03 22:15:00.168398 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.168373 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675415-q6md7"] Jun 03 22:15:00.245284 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.245254 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fvrc\" (UniqueName: \"kubernetes.io/projected/a9d9f4d5-5d8f-4350-bdde-40f377c85125-kube-api-access-8fvrc\") pod \"maas-api-key-cleanup-29675415-q6md7\" (UID: \"a9d9f4d5-5d8f-4350-bdde-40f377c85125\") " pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" Jun 03 22:15:00.346494 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.346463 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fvrc\" (UniqueName: \"kubernetes.io/projected/a9d9f4d5-5d8f-4350-bdde-40f377c85125-kube-api-access-8fvrc\") pod \"maas-api-key-cleanup-29675415-q6md7\" (UID: \"a9d9f4d5-5d8f-4350-bdde-40f377c85125\") " pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" Jun 03 22:15:00.354575 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.354555 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fvrc\" (UniqueName: \"kubernetes.io/projected/a9d9f4d5-5d8f-4350-bdde-40f377c85125-kube-api-access-8fvrc\") pod \"maas-api-key-cleanup-29675415-q6md7\" (UID: \"a9d9f4d5-5d8f-4350-bdde-40f377c85125\") " pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" Jun 03 22:15:00.453668 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.453640 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" Jun 03 22:15:00.583102 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.583065 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675415-q6md7"] Jun 03 22:15:00.586162 ip-10-0-141-1 kubenswrapper[2554]: W0603 22:15:00.586123 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d9f4d5_5d8f_4350_bdde_40f377c85125.slice/crio-299bd74a0f92adf8b45498f0d30b1d4be3d74506b8a0b6abe14413eeb8908860 WatchSource:0}: Error finding container 299bd74a0f92adf8b45498f0d30b1d4be3d74506b8a0b6abe14413eeb8908860: Status 404 returned error can't find the container with id 299bd74a0f92adf8b45498f0d30b1d4be3d74506b8a0b6abe14413eeb8908860 Jun 03 22:15:00.906601 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.906567 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" event={"ID":"a9d9f4d5-5d8f-4350-bdde-40f377c85125","Type":"ContainerStarted","Data":"557dee895ba87d8e593c23590bd1a918376ac96330830d92af64dac8ca7de69a"} Jun 03 22:15:00.906744 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.906622 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" event={"ID":"a9d9f4d5-5d8f-4350-bdde-40f377c85125","Type":"ContainerStarted","Data":"299bd74a0f92adf8b45498f0d30b1d4be3d74506b8a0b6abe14413eeb8908860"} Jun 03 22:15:00.924276 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:00.924218 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" podStartSLOduration=0.924200224 podStartE2EDuration="924.200224ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:15:00.923401974 +0000 UTC m=+2249.259495242" watchObservedRunningTime="2026-06-03 22:15:00.924200224 +0000 UTC m=+2249.260293532" Jun 03 22:15:01.913099 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:01.913068 2554 generic.go:356] "Generic (PLEG): container finished" podID="a9d9f4d5-5d8f-4350-bdde-40f377c85125" containerID="557dee895ba87d8e593c23590bd1a918376ac96330830d92af64dac8ca7de69a" exitCode=0 Jun 03 22:15:01.913452 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:01.913152 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" event={"ID":"a9d9f4d5-5d8f-4350-bdde-40f377c85125","Type":"ContainerDied","Data":"557dee895ba87d8e593c23590bd1a918376ac96330830d92af64dac8ca7de69a"} Jun 03 22:15:03.069855 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:03.068562 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" Jun 03 22:15:03.171532 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:03.171462 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fvrc\" (UniqueName: \"kubernetes.io/projected/a9d9f4d5-5d8f-4350-bdde-40f377c85125-kube-api-access-8fvrc\") pod \"a9d9f4d5-5d8f-4350-bdde-40f377c85125\" (UID: \"a9d9f4d5-5d8f-4350-bdde-40f377c85125\") " Jun 03 22:15:03.173454 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:03.173423 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9d9f4d5-5d8f-4350-bdde-40f377c85125-kube-api-access-8fvrc" (OuterVolumeSpecName: "kube-api-access-8fvrc") pod "a9d9f4d5-5d8f-4350-bdde-40f377c85125" (UID: "a9d9f4d5-5d8f-4350-bdde-40f377c85125"). InnerVolumeSpecName "kube-api-access-8fvrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:15:03.272885 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:03.272826 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fvrc\" (UniqueName: \"kubernetes.io/projected/a9d9f4d5-5d8f-4350-bdde-40f377c85125-kube-api-access-8fvrc\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:15:03.923526 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:03.923482 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" event={"ID":"a9d9f4d5-5d8f-4350-bdde-40f377c85125","Type":"ContainerDied","Data":"299bd74a0f92adf8b45498f0d30b1d4be3d74506b8a0b6abe14413eeb8908860"} Jun 03 22:15:03.923526 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:03.923504 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675415-q6md7" Jun 03 22:15:03.923728 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:15:03.923538 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="299bd74a0f92adf8b45498f0d30b1d4be3d74506b8a0b6abe14413eeb8908860" Jun 03 22:17:32.296846 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:32.296722 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 22:17:32.305108 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:32.305090 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z576l_2c252b44-3310-435c-8e02-3211754c50bb/ovn-acl-logging/0.log" Jun 03 22:17:36.277267 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.277221 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7"] Jun 03 22:17:36.277789 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.277767 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9d9f4d5-5d8f-4350-bdde-40f377c85125" containerName="cleanup" Jun 03 22:17:36.277902 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.277791 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9d9f4d5-5d8f-4350-bdde-40f377c85125" containerName="cleanup" Jun 03 22:17:36.277967 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.277912 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9d9f4d5-5d8f-4350-bdde-40f377c85125" containerName="cleanup" Jun 03 22:17:36.280970 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.280950 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.284639 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.284617 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 22:17:36.284639 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.284635 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4468ee54-openshift-default-dockercfg-jk8p8\"" Jun 03 22:17:36.314422 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.314393 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7"] Jun 03 22:17:36.347723 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.347696 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-socket\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.347825 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.347732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-credential-socket\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.347825 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.347762 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-envoy\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.347982 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.347885 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spx49\" (UniqueName: \"kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-kube-api-access-spx49\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.347982 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.347923 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-data\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.347982 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.347951 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37587a5c-d463-403e-b352-20c342ad51ad-istio-podinfo\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.347982 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.347974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-istio-token\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.348136 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.348013 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-certs\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.348136 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.348057 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37587a5c-d463-403e-b352-20c342ad51ad-istiod-ca-cert\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.448679 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.448652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-credential-socket\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.448821 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.448698 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-envoy\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.448821 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.448732 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spx49\" (UniqueName: \"kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-kube-api-access-spx49\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.448821 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.448750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-data\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.448821 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.448767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37587a5c-d463-403e-b352-20c342ad51ad-istio-podinfo\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.448821 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.448786 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-istio-token\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.448821 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.448817 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-certs\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.449147 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.448859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37587a5c-d463-403e-b352-20c342ad51ad-istiod-ca-cert\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.449147 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.448931 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-socket\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.449147 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.449107 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-credential-socket\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.449310 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.449234 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-socket\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.449310 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.449294 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-certs\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.449418 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.449362 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-data\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.449620 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.449596 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37587a5c-d463-403e-b352-20c342ad51ad-istiod-ca-cert\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.451168 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.451137 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-envoy\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.451266 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.451250 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37587a5c-d463-403e-b352-20c342ad51ad-istio-podinfo\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.459408 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.459387 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-istio-token\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.459848 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.459814 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spx49\" (UniqueName: \"kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-kube-api-access-spx49\") pod \"e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.591227 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.591172 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:36.731966 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.731934 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7"] Jun 03 22:17:36.733371 ip-10-0-141-1 kubenswrapper[2554]: W0603 22:17:36.733344 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37587a5c_d463_403e_b352_20c342ad51ad.slice/crio-42cd0a524a20df088b9760e4f292a7dec3a25be08c119dd6b4cff01102f88e55 WatchSource:0}: Error finding container 42cd0a524a20df088b9760e4f292a7dec3a25be08c119dd6b4cff01102f88e55: Status 404 returned error can't find the container with id 42cd0a524a20df088b9760e4f292a7dec3a25be08c119dd6b4cff01102f88e55 Jun 03 22:17:36.736165 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:36.736149 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 22:17:37.623770 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:37.623722 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" event={"ID":"37587a5c-d463-403e-b352-20c342ad51ad","Type":"ContainerStarted","Data":"42cd0a524a20df088b9760e4f292a7dec3a25be08c119dd6b4cff01102f88e55"} Jun 03 22:17:40.424067 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:40.424027 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 22:17:40.424313 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:40.424107 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 22:17:40.424313 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:40.424137 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 22:17:40.641158 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:40.641118 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" event={"ID":"37587a5c-d463-403e-b352-20c342ad51ad","Type":"ContainerStarted","Data":"6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295"} Jun 03 22:17:40.669091 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:40.669036 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" podStartSLOduration=0.981603109 podStartE2EDuration="4.669020141s" totalImagesPullingTime="3.687417032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:17:40.666240472 +0000 UTC m=+2409.002333738" watchObservedRunningTime="2026-06-03 22:17:40.669020141 +0000 UTC m=+2409.005113407" Jun 03 22:17:41.592286 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:41.592255 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:41.597290 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:41.597261 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:41.646104 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:41.646082 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:41.646953 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:41.646938 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:42.273739 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:42.273711 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7"] Jun 03 22:17:42.650014 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:42.649935 2554 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" secret="" err="secret \"e2e-ait-4468ee54-openshift-default-dockercfg-jk8p8\" not found" Jun 03 22:17:43.654740 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:43.654699 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" podUID="37587a5c-d463-403e-b352-20c342ad51ad" containerName="istio-proxy" containerID="cri-o://6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295" gracePeriod=30 Jun 03 22:17:48.911109 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:48.911081 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:49.008319 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.008288 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt"] Jun 03 22:17:49.008698 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.008685 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37587a5c-d463-403e-b352-20c342ad51ad" containerName="istio-proxy" Jun 03 22:17:49.008740 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.008701 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="37587a5c-d463-403e-b352-20c342ad51ad" containerName="istio-proxy" Jun 03 22:17:49.008773 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.008760 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="37587a5c-d463-403e-b352-20c342ad51ad" containerName="istio-proxy" Jun 03 22:17:49.011715 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.011693 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.014192 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.014172 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f82d99af-openshift-default-dockercfg-fq2zw\"" Jun 03 22:17:49.042072 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.042046 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt"] Jun 03 22:17:49.056098 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056079 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spx49\" (UniqueName: \"kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-kube-api-access-spx49\") pod \"37587a5c-d463-403e-b352-20c342ad51ad\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " Jun 03 22:17:49.056197 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056106 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-istio-token\") pod \"37587a5c-d463-403e-b352-20c342ad51ad\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " Jun 03 22:17:49.056197 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056127 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37587a5c-d463-403e-b352-20c342ad51ad-istio-podinfo\") pod \"37587a5c-d463-403e-b352-20c342ad51ad\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " Jun 03 22:17:49.056197 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056166 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-envoy\") pod \"37587a5c-d463-403e-b352-20c342ad51ad\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " Jun 03 22:17:49.056351 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056233 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37587a5c-d463-403e-b352-20c342ad51ad-istiod-ca-cert\") pod \"37587a5c-d463-403e-b352-20c342ad51ad\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " Jun 03 22:17:49.056351 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056271 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-socket\") pod \"37587a5c-d463-403e-b352-20c342ad51ad\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " Jun 03 22:17:49.056351 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056293 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-data\") pod \"37587a5c-d463-403e-b352-20c342ad51ad\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " Jun 03 22:17:49.056351 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056344 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-credential-socket\") pod \"37587a5c-d463-403e-b352-20c342ad51ad\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " Jun 03 22:17:49.056612 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056402 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-certs\") pod \"37587a5c-d463-403e-b352-20c342ad51ad\" (UID: \"37587a5c-d463-403e-b352-20c342ad51ad\") " Jun 03 22:17:49.056770 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056744 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "37587a5c-d463-403e-b352-20c342ad51ad" (UID: "37587a5c-d463-403e-b352-20c342ad51ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:17:49.056855 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056771 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37587a5c-d463-403e-b352-20c342ad51ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37587a5c-d463-403e-b352-20c342ad51ad" (UID: "37587a5c-d463-403e-b352-20c342ad51ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:17:49.056922 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056877 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37587a5c-d463-403e-b352-20c342ad51ad" (UID: "37587a5c-d463-403e-b352-20c342ad51ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:17:49.056922 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.056891 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37587a5c-d463-403e-b352-20c342ad51ad" (UID: "37587a5c-d463-403e-b352-20c342ad51ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:17:49.057064 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.057043 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37587a5c-d463-403e-b352-20c342ad51ad" (UID: "37587a5c-d463-403e-b352-20c342ad51ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:17:49.058564 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.058537 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37587a5c-d463-403e-b352-20c342ad51ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37587a5c-d463-403e-b352-20c342ad51ad" (UID: "37587a5c-d463-403e-b352-20c342ad51ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 03 22:17:49.058640 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.058566 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-kube-api-access-spx49" (OuterVolumeSpecName: "kube-api-access-spx49") pod "37587a5c-d463-403e-b352-20c342ad51ad" (UID: "37587a5c-d463-403e-b352-20c342ad51ad"). InnerVolumeSpecName "kube-api-access-spx49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:17:49.058640 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.058589 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "37587a5c-d463-403e-b352-20c342ad51ad" (UID: "37587a5c-d463-403e-b352-20c342ad51ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:17:49.058640 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.058616 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37587a5c-d463-403e-b352-20c342ad51ad" (UID: "37587a5c-d463-403e-b352-20c342ad51ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:17:49.157661 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.157630 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlc88\" (UniqueName: \"kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-kube-api-access-zlc88\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.157785 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.157682 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-socket\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.157785 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.157766 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-certs\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.157945 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.157808 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-podinfo\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.157945 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.157829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-envoy\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.157945 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.157868 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istiod-ca-cert\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.157945 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.157903 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-token\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.158107 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.158014 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-credential-socket\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.158107 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.158045 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-data\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.158210 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.158127 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-socket\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:17:49.158210 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.158150 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-data\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:17:49.158210 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.158163 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-credential-socket\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:17:49.158210 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.158178 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-workload-certs\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:17:49.158210 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.158193 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spx49\" (UniqueName: \"kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-kube-api-access-spx49\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:17:49.158210 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.158206 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37587a5c-d463-403e-b352-20c342ad51ad-istio-token\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:17:49.158490 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.158220 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37587a5c-d463-403e-b352-20c342ad51ad-istio-podinfo\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:17:49.158490 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.158234 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37587a5c-d463-403e-b352-20c342ad51ad-istio-envoy\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:17:49.158490 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.158247 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37587a5c-d463-403e-b352-20c342ad51ad-istiod-ca-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:17:49.259206 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259147 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-podinfo\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.259206 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259180 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-envoy\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.259206 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259197 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istiod-ca-cert\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.259388 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259216 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-token\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.259388 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-credential-socket\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.259388 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259281 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-data\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.259388 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlc88\" (UniqueName: \"kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-kube-api-access-zlc88\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.259388 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259332 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-socket\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.259388 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259362 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-certs\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.259739 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259698 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-credential-socket\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.259739 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259730 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-certs\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.259881 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.259784 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-data\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.260039 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.260015 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-socket\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.260039 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.260034 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istiod-ca-cert\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.261374 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.261350 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-envoy\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.261765 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.261747 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-podinfo\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.270002 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.269975 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-token\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.270776 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.270753 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlc88\" (UniqueName: \"kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-kube-api-access-zlc88\") pod \"e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.323013 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.322991 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:49.458271 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.458248 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt"] Jun 03 22:17:49.459990 ip-10-0-141-1 kubenswrapper[2554]: W0603 22:17:49.459966 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86ee61d_bb71_43e0_8cec_15cb8b18a463.slice/crio-ba0783b66cc1c1225010ed5e3c6e660f57d41da0a66f91b6595a4f72c37a9bd9 WatchSource:0}: Error finding container ba0783b66cc1c1225010ed5e3c6e660f57d41da0a66f91b6595a4f72c37a9bd9: Status 404 returned error can't find the container with id ba0783b66cc1c1225010ed5e3c6e660f57d41da0a66f91b6595a4f72c37a9bd9 Jun 03 22:17:49.463069 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.463038 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 22:17:49.463144 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.463115 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 22:17:49.463191 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.463142 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 22:17:49.687668 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.687632 2554 generic.go:356] "Generic (PLEG): container finished" podID="37587a5c-d463-403e-b352-20c342ad51ad" containerID="6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295" exitCode=0 Jun 03 22:17:49.687872 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.687671 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" Jun 03 22:17:49.687872 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.687720 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" event={"ID":"37587a5c-d463-403e-b352-20c342ad51ad","Type":"ContainerDied","Data":"6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295"} Jun 03 22:17:49.687872 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.687774 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7" event={"ID":"37587a5c-d463-403e-b352-20c342ad51ad","Type":"ContainerDied","Data":"42cd0a524a20df088b9760e4f292a7dec3a25be08c119dd6b4cff01102f88e55"} Jun 03 22:17:49.687872 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.687800 2554 scope.go:117] "RemoveContainer" containerID="6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295" Jun 03 22:17:49.689756 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.689730 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" event={"ID":"a86ee61d-bb71-43e0-8cec-15cb8b18a463","Type":"ContainerStarted","Data":"f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234"} Jun 03 22:17:49.689909 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.689777 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" event={"ID":"a86ee61d-bb71-43e0-8cec-15cb8b18a463","Type":"ContainerStarted","Data":"ba0783b66cc1c1225010ed5e3c6e660f57d41da0a66f91b6595a4f72c37a9bd9"} Jun 03 22:17:49.697434 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.697419 2554 scope.go:117] "RemoveContainer" containerID="6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295" Jun 03 22:17:49.697747 ip-10-0-141-1 kubenswrapper[2554]: E0603 22:17:49.697719 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295\": container with ID starting with 6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295 not found: ID does not exist" containerID="6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295" Jun 03 22:17:49.697826 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.697757 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295"} err="failed to get container status \"6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295\": rpc error: code = NotFound desc = could not find container \"6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295\": container with ID starting with 6773df448ed44315ba6161aef3df1df4a8f0df14f52cca8da2536e3f7ec39295 not found: ID does not exist" Jun 03 22:17:49.719019 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.718976 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" podStartSLOduration=1.7189628300000002 podStartE2EDuration="1.71896283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:17:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:17:49.717093722 +0000 UTC m=+2418.053186987" watchObservedRunningTime="2026-06-03 22:17:49.71896283 +0000 UTC m=+2418.055056096" Jun 03 22:17:49.732672 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.732644 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7"] Jun 03 22:17:49.736607 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:49.736587 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4468ee54-openshift-default-7c6794d864-ml9n7"] Jun 03 22:17:50.168391 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:50.168360 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37587a5c-d463-403e-b352-20c342ad51ad" path="/var/lib/kubelet/pods/37587a5c-d463-403e-b352-20c342ad51ad/volumes" Jun 03 22:17:50.323980 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:50.323953 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:50.328722 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:50.328701 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:50.697062 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:50.697031 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:50.697910 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:50.697891 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:17:54.961710 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:54.961674 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt"] Jun 03 22:17:54.962160 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:17:54.961866 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" podUID="a86ee61d-bb71-43e0-8cec-15cb8b18a463" containerName="istio-proxy" containerID="cri-o://f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234" gracePeriod=30 Jun 03 22:18:00.208735 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.208713 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:18:00.351828 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.351760 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-certs\") pod \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " Jun 03 22:18:00.351828 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.351789 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istiod-ca-cert\") pod \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " Jun 03 22:18:00.352033 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.351857 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-envoy\") pod \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " Jun 03 22:18:00.352033 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.351888 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-socket\") pod \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " Jun 03 22:18:00.352033 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.351995 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-token\") pod \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " Jun 03 22:18:00.352184 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352045 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-credential-socket\") pod \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " Jun 03 22:18:00.352184 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352057 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a86ee61d-bb71-43e0-8cec-15cb8b18a463" (UID: "a86ee61d-bb71-43e0-8cec-15cb8b18a463"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:18:00.352184 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352077 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-data\") pod \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " Jun 03 22:18:00.352184 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352121 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlc88\" (UniqueName: \"kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-kube-api-access-zlc88\") pod \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " Jun 03 22:18:00.352378 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352193 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-podinfo\") pod \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\" (UID: \"a86ee61d-bb71-43e0-8cec-15cb8b18a463\") " Jun 03 22:18:00.352378 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352291 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a86ee61d-bb71-43e0-8cec-15cb8b18a463" (UID: "a86ee61d-bb71-43e0-8cec-15cb8b18a463"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 22:18:00.352378 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352298 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-data" (OuterVolumeSpecName: "istio-data") pod "a86ee61d-bb71-43e0-8cec-15cb8b18a463" (UID: "a86ee61d-bb71-43e0-8cec-15cb8b18a463"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:18:00.352518 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352485 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-data\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:18:00.352518 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352502 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-certs\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:18:00.352613 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352516 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istiod-ca-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:18:00.352613 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352579 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a86ee61d-bb71-43e0-8cec-15cb8b18a463" (UID: "a86ee61d-bb71-43e0-8cec-15cb8b18a463"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:18:00.352724 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.352695 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a86ee61d-bb71-43e0-8cec-15cb8b18a463" (UID: "a86ee61d-bb71-43e0-8cec-15cb8b18a463"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:18:00.354088 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.354067 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a86ee61d-bb71-43e0-8cec-15cb8b18a463" (UID: "a86ee61d-bb71-43e0-8cec-15cb8b18a463"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 22:18:00.354182 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.354167 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-token" (OuterVolumeSpecName: "istio-token") pod "a86ee61d-bb71-43e0-8cec-15cb8b18a463" (UID: "a86ee61d-bb71-43e0-8cec-15cb8b18a463"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:18:00.354581 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.354556 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-kube-api-access-zlc88" (OuterVolumeSpecName: "kube-api-access-zlc88") pod "a86ee61d-bb71-43e0-8cec-15cb8b18a463" (UID: "a86ee61d-bb71-43e0-8cec-15cb8b18a463"). InnerVolumeSpecName "kube-api-access-zlc88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 22:18:00.354581 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.354566 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a86ee61d-bb71-43e0-8cec-15cb8b18a463" (UID: "a86ee61d-bb71-43e0-8cec-15cb8b18a463"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 03 22:18:00.453165 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.453139 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-envoy\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:18:00.453165 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.453161 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-workload-socket\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:18:00.453321 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.453172 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-token\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:18:00.453321 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.453180 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86ee61d-bb71-43e0-8cec-15cb8b18a463-credential-socket\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:18:00.453321 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.453188 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlc88\" (UniqueName: \"kubernetes.io/projected/a86ee61d-bb71-43e0-8cec-15cb8b18a463-kube-api-access-zlc88\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:18:00.453321 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.453198 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a86ee61d-bb71-43e0-8cec-15cb8b18a463-istio-podinfo\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\"" Jun 03 22:18:00.744516 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.744482 2554 generic.go:356] "Generic (PLEG): container finished" podID="a86ee61d-bb71-43e0-8cec-15cb8b18a463" containerID="f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234" exitCode=0 Jun 03 22:18:00.744649 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.744539 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" Jun 03 22:18:00.744649 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.744539 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" event={"ID":"a86ee61d-bb71-43e0-8cec-15cb8b18a463","Type":"ContainerDied","Data":"f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234"} Jun 03 22:18:00.744746 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.744680 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt" event={"ID":"a86ee61d-bb71-43e0-8cec-15cb8b18a463","Type":"ContainerDied","Data":"ba0783b66cc1c1225010ed5e3c6e660f57d41da0a66f91b6595a4f72c37a9bd9"} Jun 03 22:18:00.744746 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.744713 2554 scope.go:117] "RemoveContainer" containerID="f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234" Jun 03 22:18:00.754274 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.754255 2554 scope.go:117] "RemoveContainer" containerID="f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234" Jun 03 22:18:00.754507 ip-10-0-141-1 kubenswrapper[2554]: E0603 22:18:00.754488 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234\": container with ID starting with f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234 not found: ID does not exist" containerID="f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234" Jun 03 22:18:00.754578 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.754518 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234"} err="failed to get container status \"f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234\": rpc error: code = NotFound desc = could not find container \"f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234\": container with ID starting with f16ea58c1c35f134352e855787c0a1ccda7dd32038ad06a01dce4b99b139e234 not found: ID does not exist" Jun 03 22:18:00.769855 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.769817 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt"] Jun 03 22:18:00.774955 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:00.774935 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f82d99af-openshift-default-c6f66fc56-gjhlt"] Jun 03 22:18:02.167056 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:02.167023 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a86ee61d-bb71-43e0-8cec-15cb8b18a463" path="/var/lib/kubelet/pods/a86ee61d-bb71-43e0-8cec-15cb8b18a463/volumes" Jun 03 22:18:09.973156 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:09.973119 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-656b8999c4-lszf5_7839dbe0-c18f-427f-9b7d-4b582536d048/authorino/0.log" Jun 03 22:18:15.450673 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:15.450632 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675400-vrhh9_7fc3263a-16d6-47c8-9e68-0658ce6c3991/cleanup/0.log" Jun 03 22:18:15.570251 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:15.570227 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675415-q6md7_a9d9f4d5-5d8f-4350-bdde-40f377c85125/cleanup/0.log" Jun 03 22:18:15.814323 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:15.814222 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-dt8fg_c2779017-32b0-4f0c-b796-93134d540019/server/0.log" Jun 03 22:18:16.057007 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:16.056980 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6df88c9dc9-92h4m_3b3545b4-72f0-4630-9491-f5f615b818ec/copy-manifests/0.log" Jun 03 22:18:16.064734 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:16.064676 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6df88c9dc9-92h4m_3b3545b4-72f0-4630-9491-f5f615b818ec/manager/0.log" Jun 03 22:18:17.840822 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:17.840778 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-656b8999c4-lszf5_7839dbe0-c18f-427f-9b7d-4b582536d048/authorino/0.log" Jun 03 22:18:19.363113 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:19.363080 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8f4cf549-ftd4k_aa0bad36-c190-423d-a7cc-cfd4f38c0e3e/kube-auth-proxy/0.log" Jun 03 22:18:19.733212 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:19.733186 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-t27s2_86202efc-02ff-4b41-98f2-202348a644a6/payload-processing/0.log" Jun 03 22:18:20.354900 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:20.354867 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-gwlbw_82a446f4-cef4-492e-b194-c697e418e0d5/storage-initializer/0.log" Jun 03 22:18:20.362334 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:20.362310 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-gwlbw_82a446f4-cef4-492e-b194-c697e418e0d5/main/0.log" Jun 03 22:18:20.620694 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:20.620598 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96_498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9/storage-initializer/0.log" Jun 03 22:18:20.628210 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:20.628190 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjbs96_498ec73e-6c2b-4c18-ad54-c09ac1fa2ac9/main/0.log" Jun 03 22:18:20.752043 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:20.752008 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-v64db_ff44cb5d-3c78-45ab-8ab5-0aba55c58dba/storage-initializer/0.log" Jun 03 22:18:20.760811 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:20.760790 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-v64db_ff44cb5d-3c78-45ab-8ab5-0aba55c58dba/main/0.log" Jun 03 22:18:25.472193 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.472160 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k27wj/must-gather-gbl9f"] Jun 03 22:18:25.472564 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.472513 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a86ee61d-bb71-43e0-8cec-15cb8b18a463" containerName="istio-proxy" Jun 03 22:18:25.472564 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.472524 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a86ee61d-bb71-43e0-8cec-15cb8b18a463" containerName="istio-proxy" Jun 03 22:18:25.472660 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.472589 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a86ee61d-bb71-43e0-8cec-15cb8b18a463" containerName="istio-proxy" Jun 03 22:18:25.481752 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.481728 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k27wj/must-gather-gbl9f" Jun 03 22:18:25.484574 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.484555 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k27wj\"/\"default-dockercfg-2bzm5\"" Jun 03 22:18:25.484886 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.484864 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k27wj\"/\"kube-root-ca.crt\"" Jun 03 22:18:25.487463 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.487445 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k27wj\"/\"openshift-service-ca.crt\"" Jun 03 22:18:25.488096 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.488071 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k27wj/must-gather-gbl9f"] Jun 03 22:18:25.550914 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.550886 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/218a1d97-6e1d-494c-8bde-3165639861dd-must-gather-output\") pod \"must-gather-gbl9f\" (UID: \"218a1d97-6e1d-494c-8bde-3165639861dd\") " pod="openshift-must-gather-k27wj/must-gather-gbl9f" Jun 03 22:18:25.551008 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.550918 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whts2\" (UniqueName: \"kubernetes.io/projected/218a1d97-6e1d-494c-8bde-3165639861dd-kube-api-access-whts2\") pod \"must-gather-gbl9f\" (UID: \"218a1d97-6e1d-494c-8bde-3165639861dd\") " pod="openshift-must-gather-k27wj/must-gather-gbl9f" Jun 03 22:18:25.651827 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.651801 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/218a1d97-6e1d-494c-8bde-3165639861dd-must-gather-output\") pod \"must-gather-gbl9f\" (UID: \"218a1d97-6e1d-494c-8bde-3165639861dd\") " pod="openshift-must-gather-k27wj/must-gather-gbl9f" Jun 03 22:18:25.651827 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.651845 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whts2\" (UniqueName: \"kubernetes.io/projected/218a1d97-6e1d-494c-8bde-3165639861dd-kube-api-access-whts2\") pod \"must-gather-gbl9f\" (UID: \"218a1d97-6e1d-494c-8bde-3165639861dd\") " pod="openshift-must-gather-k27wj/must-gather-gbl9f" Jun 03 22:18:25.652116 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.652099 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/218a1d97-6e1d-494c-8bde-3165639861dd-must-gather-output\") pod \"must-gather-gbl9f\" (UID: \"218a1d97-6e1d-494c-8bde-3165639861dd\") " pod="openshift-must-gather-k27wj/must-gather-gbl9f" Jun 03 22:18:25.661666 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.661639 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whts2\" (UniqueName: \"kubernetes.io/projected/218a1d97-6e1d-494c-8bde-3165639861dd-kube-api-access-whts2\") pod \"must-gather-gbl9f\" (UID: \"218a1d97-6e1d-494c-8bde-3165639861dd\") " pod="openshift-must-gather-k27wj/must-gather-gbl9f" Jun 03 22:18:25.791360 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.791296 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k27wj/must-gather-gbl9f" Jun 03 22:18:25.922855 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:25.922811 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k27wj/must-gather-gbl9f"] Jun 03 22:18:25.924848 ip-10-0-141-1 kubenswrapper[2554]: W0603 22:18:25.924799 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod218a1d97_6e1d_494c_8bde_3165639861dd.slice/crio-f780ac667c08a51b20e9d43bbda85937a324978687dd32b2ad12632761f7751a WatchSource:0}: Error finding container f780ac667c08a51b20e9d43bbda85937a324978687dd32b2ad12632761f7751a: Status 404 returned error can't find the container with id f780ac667c08a51b20e9d43bbda85937a324978687dd32b2ad12632761f7751a Jun 03 22:18:26.869751 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:26.869655 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k27wj/must-gather-gbl9f" event={"ID":"218a1d97-6e1d-494c-8bde-3165639861dd","Type":"ContainerStarted","Data":"0fb3c23f9cdc5279cf4e4294d4d00da57b9140df6c0be28485c170cc8a339bcb"} Jun 03 22:18:26.869751 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:26.869713 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k27wj/must-gather-gbl9f" event={"ID":"218a1d97-6e1d-494c-8bde-3165639861dd","Type":"ContainerStarted","Data":"2993dfbfbf00f86f424e8865726dadd753260ffa4928e95e2676fa671b9cf5dc"} Jun 03 22:18:26.869751 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:26.869730 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k27wj/must-gather-gbl9f" event={"ID":"218a1d97-6e1d-494c-8bde-3165639861dd","Type":"ContainerStarted","Data":"f780ac667c08a51b20e9d43bbda85937a324978687dd32b2ad12632761f7751a"} Jun 03 22:18:26.888103 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:26.888039 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k27wj/must-gather-gbl9f" podStartSLOduration=1.20521315 podStartE2EDuration="1.888019245s" totalImagesPullingTime="682.806095ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 22:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:18:26.885166628 +0000 UTC m=+2455.221259897" watchObservedRunningTime="2026-06-03 22:18:26.888019245 +0000 UTC m=+2455.224112513" Jun 03 22:18:28.502174 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:28.502145 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mzrjj_4c182030-5598-4bed-910d-78da9cd3dc27/global-pull-secret-syncer/0.log" Jun 03 22:18:28.693189 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:28.693159 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gzhx5_0e7626cf-83d8-42c0-b139-475266086ac1/konnectivity-agent/0.log" Jun 03 22:18:28.765213 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:28.765130 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-1.ec2.internal_601cc931a3ceb7ad62ad67db9f874af0/haproxy/0.log" Jun 03 22:18:33.676593 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:33.676369 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-656b8999c4-lszf5_7839dbe0-c18f-427f-9b7d-4b582536d048/authorino/0.log" Jun 03 22:18:35.811356 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:35.811277 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-4vsrx_7e751bb6-b586-4037-b3de-0ab2d87887bc/kube-state-metrics/0.log" Jun 03 22:18:35.844616 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:35.844568 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-4vsrx_7e751bb6-b586-4037-b3de-0ab2d87887bc/kube-rbac-proxy-main/0.log" Jun 03 22:18:35.874239 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:35.874203 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-4vsrx_7e751bb6-b586-4037-b3de-0ab2d87887bc/kube-rbac-proxy-self/0.log" Jun 03 22:18:35.905791 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:35.905760 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-ccf47479-9hw8t_1b992d59-17d0-4d9d-83a2-d4777c12cd5a/metrics-server/0.log" Jun 03 22:18:36.054427 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.054394 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prcsx_c81632d6-f775-4420-9569-c7c890c7c50d/node-exporter/0.log" Jun 03 22:18:36.077063 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.076943 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prcsx_c81632d6-f775-4420-9569-c7c890c7c50d/kube-rbac-proxy/0.log" Jun 03 22:18:36.098785 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.098752 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prcsx_c81632d6-f775-4420-9569-c7c890c7c50d/init-textfile/0.log" Jun 03 22:18:36.206051 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.206016 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-67kgr_139fe141-3fcc-48fd-915d-baf64a26a389/kube-rbac-proxy-main/0.log" Jun 03 22:18:36.235121 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.235088 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-67kgr_139fe141-3fcc-48fd-915d-baf64a26a389/kube-rbac-proxy-self/0.log" Jun 03 22:18:36.259546 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.259511 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-67kgr_139fe141-3fcc-48fd-915d-baf64a26a389/openshift-state-metrics/0.log" Jun 03 22:18:36.630824 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.630790 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-2plcn_73ccdd62-56a1-449f-b6c8-36cfcb26938c/prometheus-operator/0.log" Jun 03 22:18:36.668070 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.668044 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-2plcn_73ccdd62-56a1-449f-b6c8-36cfcb26938c/kube-rbac-proxy/0.log" Jun 03 22:18:36.715472 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.715428 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-xjsfq_3c6cbf0d-4744-439b-9977-7c9a801768c7/prometheus-operator-admission-webhook/0.log" Jun 03 22:18:36.889565 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.889480 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb7dbcc4-7dhwz_10332e7d-da20-4ed3-bb69-785b275002b2/thanos-query/0.log" Jun 03 22:18:36.925538 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.925505 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb7dbcc4-7dhwz_10332e7d-da20-4ed3-bb69-785b275002b2/kube-rbac-proxy-web/0.log" Jun 03 22:18:36.957013 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.956623 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb7dbcc4-7dhwz_10332e7d-da20-4ed3-bb69-785b275002b2/kube-rbac-proxy/0.log" Jun 03 22:18:36.983366 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:36.983338 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb7dbcc4-7dhwz_10332e7d-da20-4ed3-bb69-785b275002b2/prom-label-proxy/0.log" Jun 03 22:18:37.004549 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:37.004480 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb7dbcc4-7dhwz_10332e7d-da20-4ed3-bb69-785b275002b2/kube-rbac-proxy-rules/0.log" Jun 03 22:18:37.029265 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:37.029225 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bb7dbcc4-7dhwz_10332e7d-da20-4ed3-bb69-785b275002b2/kube-rbac-proxy-metrics/0.log" Jun 03 22:18:39.737365 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:39.737312 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-lnqmj_4672dc87-b35a-45b2-b9b7-97022a1ed37b/download-server/0.log" Jun 03 22:18:40.777632 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:40.777593 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl"] Jun 03 22:18:40.781876 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:40.781820 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:40.788606 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:40.788581 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl"] Jun 03 22:18:40.931216 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:40.931177 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-sys\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:40.931377 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:40.931246 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9gx7\" (UniqueName: \"kubernetes.io/projected/a33fd4bd-103f-4103-9a34-289c6f951405-kube-api-access-l9gx7\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:40.931377 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:40.931283 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-lib-modules\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:40.931468 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:40.931432 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-podres\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:40.931542 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:40.931526 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-proc\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.033404 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.033025 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-sys\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.033404 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.033087 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9gx7\" (UniqueName: \"kubernetes.io/projected/a33fd4bd-103f-4103-9a34-289c6f951405-kube-api-access-l9gx7\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.033404 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.033121 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-lib-modules\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.033404 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.033148 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-sys\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.033404 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.033199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-podres\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.033404 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.033261 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-lib-modules\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.033404 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.033277 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-proc\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.033404 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.033330 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-podres\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.033404 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.033365 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a33fd4bd-103f-4103-9a34-289c6f951405-proc\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.042141 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.042092 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9gx7\" (UniqueName: \"kubernetes.io/projected/a33fd4bd-103f-4103-9a34-289c6f951405-kube-api-access-l9gx7\") pod \"perf-node-gather-daemonset-q52pl\" (UID: \"a33fd4bd-103f-4103-9a34-289c6f951405\") " pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.096499 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.096270 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.278544 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.275796 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl"] Jun 03 22:18:41.748330 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.748303 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7jrlc_e35196ec-35b9-4f12-9060-008ff886a985/dns/0.log" Jun 03 22:18:41.774122 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.774090 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7jrlc_e35196ec-35b9-4f12-9060-008ff886a985/kube-rbac-proxy/0.log" Jun 03 22:18:41.850769 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.850745 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pdbgn_66677f28-c099-4884-a43f-30a1d25d2a1f/dns-node-resolver/0.log" Jun 03 22:18:41.976154 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.976113 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" event={"ID":"a33fd4bd-103f-4103-9a34-289c6f951405","Type":"ContainerStarted","Data":"8abc00c0365c670fae552111933dc7685c88d1e249b961c2cfc56fae3f0bc782"} Jun 03 22:18:41.976343 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.976179 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" event={"ID":"a33fd4bd-103f-4103-9a34-289c6f951405","Type":"ContainerStarted","Data":"e76fc236319784102bab7e4351ebbb9778430c34d173332be8abb2a609265f9d"} Jun 03 22:18:41.976413 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.976380 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:41.993649 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:41.993580 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" podStartSLOduration=1.9935612329999999 podStartE2EDuration="1.993561233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:18:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:18:41.993358715 +0000 UTC m=+2470.329451984" watchObservedRunningTime="2026-06-03 22:18:41.993561233 +0000 UTC m=+2470.329654501" Jun 03 22:18:42.501314 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:42.501284 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-59744_b9009d27-4ec0-4368-9eaa-568a95fd3b9d/node-ca/0.log" Jun 03 22:18:43.655155 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:43.655117 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8f4cf549-ftd4k_aa0bad36-c190-423d-a7cc-cfd4f38c0e3e/kube-auth-proxy/0.log" Jun 03 22:18:43.822040 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:43.822013 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-t27s2_86202efc-02ff-4b41-98f2-202348a644a6/payload-processing/0.log" Jun 03 22:18:44.474982 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:44.474952 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lxll4_ac0b00dd-b1a9-437c-a081-6bc90a267324/serve-healthcheck-canary/0.log" Jun 03 22:18:45.155634 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:45.155607 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gbtdm_cfa0dad1-134e-47eb-8386-7b7bdf221925/kube-rbac-proxy/0.log" Jun 03 22:18:45.177322 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:45.177286 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gbtdm_cfa0dad1-134e-47eb-8386-7b7bdf221925/exporter/0.log" Jun 03 22:18:45.201727 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:45.201699 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gbtdm_cfa0dad1-134e-47eb-8386-7b7bdf221925/extractor/0.log" Jun 03 22:18:47.780109 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:47.780074 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675400-vrhh9_7fc3263a-16d6-47c8-9e68-0658ce6c3991/cleanup/0.log" Jun 03 22:18:47.807683 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:47.807653 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675415-q6md7_a9d9f4d5-5d8f-4350-bdde-40f377c85125/cleanup/0.log" Jun 03 22:18:47.900375 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:47.900351 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-dt8fg_c2779017-32b0-4f0c-b796-93134d540019/server/0.log" Jun 03 22:18:47.977474 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:47.977433 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6df88c9dc9-92h4m_3b3545b4-72f0-4630-9491-f5f615b818ec/manager/0.log" Jun 03 22:18:47.991875 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:47.991827 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k27wj/perf-node-gather-daemonset-q52pl" Jun 03 22:18:47.999945 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:47.999923 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6df88c9dc9-92h4m_3b3545b4-72f0-4630-9491-f5f615b818ec/copy-manifests/0.log" Jun 03 22:18:49.887965 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:49.887934 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58895f6957-2q9mc_08ea370a-3a95-4d4a-aad1-28f11d494f79/manager/0.log" Jun 03 22:18:53.851064 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:53.851032 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8f4cf549-ftd4k_aa0bad36-c190-423d-a7cc-cfd4f38c0e3e/kube-auth-proxy/0.log" Jun 03 22:18:53.994101 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:53.994065 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-t27s2_86202efc-02ff-4b41-98f2-202348a644a6/payload-processing/0.log" Jun 03 22:18:55.473163 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:55.473138 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8f4cf549-ftd4k_aa0bad36-c190-423d-a7cc-cfd4f38c0e3e/kube-auth-proxy/0.log" Jun 03 22:18:55.609754 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:55.609709 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-t27s2_86202efc-02ff-4b41-98f2-202348a644a6/payload-processing/0.log" Jun 03 22:18:56.382405 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:56.382373 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb_3935b29d-8bb0-48c6-93c1-82c2b9b2198a/kube-storage-version-migrator-operator/1.log" Jun 03 22:18:56.384419 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:56.384298 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-b44nb_3935b29d-8bb0-48c6-93c1-82c2b9b2198a/kube-storage-version-migrator-operator/0.log" Jun 03 22:18:57.537950 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:57.537925 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8f4cf549-ftd4k_aa0bad36-c190-423d-a7cc-cfd4f38c0e3e/kube-auth-proxy/0.log" Jun 03 22:18:57.667151 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:57.667118 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-t27s2_86202efc-02ff-4b41-98f2-202348a644a6/payload-processing/0.log" Jun 03 22:18:57.712222 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:57.712189 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmnf2_7f52dda5-0477-4720-ab55-06360a6c69ab/kube-multus-additional-cni-plugins/0.log" Jun 03 22:18:57.741435 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:57.741410 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmnf2_7f52dda5-0477-4720-ab55-06360a6c69ab/egress-router-binary-copy/0.log" Jun 03 22:18:57.768353 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:57.768324 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmnf2_7f52dda5-0477-4720-ab55-06360a6c69ab/cni-plugins/0.log" Jun 03 22:18:57.796136 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:57.796069 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmnf2_7f52dda5-0477-4720-ab55-06360a6c69ab/bond-cni-plugin/0.log" Jun 03 22:18:57.823261 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:57.823237 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmnf2_7f52dda5-0477-4720-ab55-06360a6c69ab/routeoverride-cni/0.log" Jun 03 22:18:57.845570 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:57.845545 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmnf2_7f52dda5-0477-4720-ab55-06360a6c69ab/whereabouts-cni-bincopy/0.log" Jun 03 22:18:57.868264 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:57.868234 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cmnf2_7f52dda5-0477-4720-ab55-06360a6c69ab/whereabouts-cni/0.log" Jun 03 22:18:58.167923 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:58.167823 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zg9r8_0452a347-97c3-4fe2-a9ec-569a6d21417c/kube-multus/0.log" Jun 03 22:18:58.300753 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:58.300719 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v8b9n_733dc558-703e-4ee8-b7e3-5c3d39841574/network-metrics-daemon/0.log" Jun 03 22:18:58.327928 ip-10-0-141-1 kubenswrapper[2554]: I0603 22:18:58.327887 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v8b9n_733dc558-703e-4ee8-b7e3-5c3d39841574/kube-rbac-proxy/0.log"