Jun 01 20:31:32.907298 ip-10-0-134-139 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 01 20:31:32.907311 ip-10-0-134-139 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 01 20:31:32.907320 ip-10-0-134-139 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 01 20:31:32.907612 ip-10-0-134-139 systemd[1]: Failed to start Kubernetes Kubelet. Jun 01 20:31:43.041304 ip-10-0-134-139 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 01 20:31:43.041322 ip-10-0-134-139 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8782676b183a4ed4a824c890c9dc46ab -- Jun 01 20:34:11.641947 ip-10-0-134-139 systemd[1]: Starting Kubernetes Kubelet... Jun 01 20:34:12.061204 ip-10-0-134-139 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 01 20:34:12.061204 ip-10-0-134-139 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 01 20:34:12.061204 ip-10-0-134-139 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 01 20:34:12.061204 ip-10-0-134-139 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 01 20:34:12.061204 ip-10-0-134-139 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 01 20:34:12.062743 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.062654 2561 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 01 20:34:12.068329 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068308 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 01 20:34:12.068329 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068325 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 01 20:34:12.068329 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068329 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 01 20:34:12.068329 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068340 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068344 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068347 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068350 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068353 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068355 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068358 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068362 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068364 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068367 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068369 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068372 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068375 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068378 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068380 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068383 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068385 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068388 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068390 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068396 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 01 20:34:12.068505 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068399 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068402 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068405 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068407 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068412 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068416 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068418 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068421 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068426 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068429 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068433 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068436 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068438 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068441 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068445 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068448 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068450 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068453 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068456 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 01 20:34:12.069005 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068458 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068461 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068463 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068466 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068469 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068472 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068474 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068477 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068479 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068482 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068484 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068487 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068490 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068492 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068495 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068497 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068500 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068503 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068505 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 01 20:34:12.069487 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068507 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068510 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068513 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068516 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068518 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068521 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068523 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068526 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068529 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068532 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068535 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068538 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068540 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068543 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068546 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068548 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068551 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068555 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068558 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068560 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 01 20:34:12.069969 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068563 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068565 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068568 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068571 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.068574 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069004 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069010 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069014 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069017 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069020 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069024 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069028 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069031 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069033 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069036 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069039 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069041 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069044 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069046 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 01 20:34:12.070451 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069050 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069053 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069056 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069058 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069061 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069064 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069066 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069069 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069071 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069074 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069078 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069082 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069085 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069087 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069090 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069093 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069096 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069098 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069101 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 01 20:34:12.070939 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069104 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069106 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069109 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069111 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069114 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069116 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069118 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069121 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069123 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069126 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069128 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069131 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069133 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069135 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069138 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069141 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069144 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069146 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069149 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069151 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 01 20:34:12.071414 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069154 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069157 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069159 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069162 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069165 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069167 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069170 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069172 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069175 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069177 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069180 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069182 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069185 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069187 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069190 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069192 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069195 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069197 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069200 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069202 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 01 20:34:12.071916 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069204 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069208 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069210 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069213 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069215 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069221 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069224 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069227 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069229 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069232 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069235 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069237 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.069240 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070451 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070461 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070469 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070474 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070480 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070484 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070488 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070492 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070496 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 01 20:34:12.072411 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070499 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070503 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070506 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070509 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070512 2561 flags.go:64] FLAG: --cgroup-root="" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070516 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070518 2561 flags.go:64] FLAG: --client-ca-file="" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070521 2561 flags.go:64] FLAG: --cloud-config="" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070524 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070527 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070531 2561 flags.go:64] FLAG: --cluster-domain="" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070534 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070537 2561 flags.go:64] FLAG: --config-dir="" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070540 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070543 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070548 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070551 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070554 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070558 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070561 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070564 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070567 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070570 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070573 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070577 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 01 20:34:12.072988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070580 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070582 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070593 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070596 2561 flags.go:64] FLAG: --enable-server="true" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070599 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070604 2561 flags.go:64] FLAG: --event-burst="100" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070607 2561 flags.go:64] FLAG: --event-qps="50" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070611 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070614 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070617 2561 flags.go:64] FLAG: --eviction-hard="" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070640 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070643 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070646 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070650 2561 flags.go:64] FLAG: --eviction-soft="" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070652 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070655 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070658 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070661 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070664 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070667 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070670 2561 flags.go:64] FLAG: --feature-gates="" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070673 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070676 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070680 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070683 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070686 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 01 20:34:12.073591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070689 2561 flags.go:64] FLAG: --help="false" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070691 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070695 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070697 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070700 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070703 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070706 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070709 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070712 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070715 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070718 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070721 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070724 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070727 2561 flags.go:64] FLAG: --kube-reserved="" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070730 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070733 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070736 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070739 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070742 2561 flags.go:64] FLAG: --lock-file="" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070744 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070747 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070750 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070756 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 01 20:34:12.074272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070758 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070761 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070764 2561 flags.go:64] FLAG: --logging-format="text" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070766 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070770 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070773 2561 flags.go:64] FLAG: --manifest-url="" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070779 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070784 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070787 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070791 2561 flags.go:64] FLAG: --max-pods="110" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070794 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070797 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070800 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070803 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070806 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070809 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070812 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070820 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070823 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070826 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070829 2561 flags.go:64] FLAG: --pod-cidr="" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070832 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070839 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070842 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 01 20:34:12.074850 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070845 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070848 2561 flags.go:64] FLAG: --port="10250" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070851 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070854 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0616e3c9f63bf3115" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070857 2561 flags.go:64] FLAG: --qos-reserved="" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070860 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070863 2561 flags.go:64] FLAG: --register-node="true" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070866 2561 flags.go:64] FLAG: --register-schedulable="true" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070868 2561 flags.go:64] FLAG: --register-with-taints="" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070872 2561 flags.go:64] FLAG: --registry-burst="10" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070875 2561 flags.go:64] FLAG: --registry-qps="5" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070877 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070880 2561 flags.go:64] FLAG: --reserved-memory="" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070884 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070887 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070892 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070894 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070897 2561 flags.go:64] FLAG: --runonce="false" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070900 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070903 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070906 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070909 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070911 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070914 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070917 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070920 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 01 20:34:12.075477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070923 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070926 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070929 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070934 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070937 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070940 2561 flags.go:64] FLAG: --system-cgroups="" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070943 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070948 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070951 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070954 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070958 2561 flags.go:64] FLAG: --tls-min-version="" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070961 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070964 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070967 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070969 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070972 2561 flags.go:64] FLAG: --v="2" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070976 2561 flags.go:64] FLAG: --version="false" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070980 2561 flags.go:64] FLAG: --vmodule="" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070985 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.070988 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071087 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071092 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071096 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071099 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 01 20:34:12.076127 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071102 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071104 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071107 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071109 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071112 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071115 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071117 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071120 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071122 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071125 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071128 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071133 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071136 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071139 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071141 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071144 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071147 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071149 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071152 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071154 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 01 20:34:12.076725 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071157 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071159 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071162 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071165 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071168 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071170 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071174 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071177 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071180 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071185 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071188 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071190 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071193 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071195 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071198 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071202 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071206 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071209 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 01 20:34:12.077301 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071211 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071214 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071217 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071221 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071224 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071228 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071230 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071233 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071236 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071239 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071241 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071244 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071246 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071249 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071251 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071254 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071256 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071259 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071261 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071264 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 01 20:34:12.077827 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071266 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071269 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071272 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071276 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071278 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071281 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071283 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071286 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071289 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071291 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071294 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071296 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071299 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071301 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071304 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071306 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071309 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071313 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071315 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071318 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 01 20:34:12.078323 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071321 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071323 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071326 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.071328 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.071800 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.078525 2561 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.078661 2561 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078718 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078725 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078728 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078732 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078736 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078739 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078741 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078744 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 01 20:34:12.078843 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078746 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078750 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078754 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078757 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078759 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078762 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078764 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078767 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078770 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078773 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078775 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078778 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078781 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078787 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078794 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078798 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078802 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078806 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078808 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 01 20:34:12.079259 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078811 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078814 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078816 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078819 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078822 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078825 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078828 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078830 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078833 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078835 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078838 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078840 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078843 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078845 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078848 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078851 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078854 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078857 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078860 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078864 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 01 20:34:12.079766 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078868 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078872 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078876 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078878 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078881 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078883 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078886 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078888 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078891 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078893 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078896 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078900 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078902 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078905 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078907 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078910 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078913 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078915 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078918 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078920 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 01 20:34:12.080261 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078923 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078926 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078928 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078931 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078933 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078936 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078939 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078944 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078948 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078952 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078956 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078958 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078961 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078963 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078966 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078968 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078970 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078974 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 01 20:34:12.080803 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.078976 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.078982 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079100 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079108 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079113 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079116 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079120 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079124 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079127 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079130 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079133 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079136 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079139 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079142 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079145 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079147 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 01 20:34:12.081249 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079150 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079152 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079155 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079157 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079160 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079162 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079165 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079168 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079170 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079172 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079175 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079178 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079182 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079186 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079191 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079195 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079198 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079200 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079202 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079205 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 01 20:34:12.081670 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079207 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079210 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079212 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079216 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079219 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079222 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079224 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079227 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079229 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079232 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079234 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079237 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079240 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079242 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079245 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079247 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079249 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079252 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079255 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079258 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 01 20:34:12.082154 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079263 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079267 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079271 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079274 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079276 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079279 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079281 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079284 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079286 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079289 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079291 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079294 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079296 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079299 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079301 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079304 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079308 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079310 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079313 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 01 20:34:12.082802 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079316 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079318 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079321 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079323 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079326 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079329 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079332 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079335 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079342 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079347 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079351 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079355 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:12.079357 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.079363 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 01 20:34:12.083262 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.080179 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 01 20:34:12.084080 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.084065 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 01 20:34:12.084995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.084983 2561 server.go:1019] "Starting client certificate rotation" Jun 01 20:34:12.085462 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.085443 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 01 20:34:12.085493 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.085486 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 01 20:34:12.106339 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.106319 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 01 20:34:12.108220 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.108203 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 01 20:34:12.124540 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.124514 2561 log.go:25] "Validated CRI v1 runtime API" Jun 01 20:34:12.130678 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.130659 2561 log.go:25] "Validated CRI v1 image API" Jun 01 20:34:12.133332 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.133310 2561 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 01 20:34:12.135186 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.135166 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 01 20:34:12.137026 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.137007 2561 fs.go:135] Filesystem UUIDs: map[311a1d8e-7b39-422d-a5a6-3fd2c2be8c55:/dev/nvme0n1p4 667323d1-6d5d-4eac-8aca-d9de4e216ecc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 01 20:34:12.137084 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.137026 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 01 20:34:12.141362 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.141236 2561 manager.go:217] Machine: {Timestamp:2026-06-01 20:34:12.140741447 +0000 UTC m=+0.389040745 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100051 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e2ba7d3bf70298daa0fb0bef7d936 SystemUUID:ec2e2ba7-d3bf-7029-8daa-0fb0bef7d936 BootID:8782676b-183a-4ed4-a824-c890c9dc46ab Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:e8:e8:cd:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:e8:e8:cd:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:a7:cf:53:73:c2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 01 20:34:12.142146 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.142135 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 01 20:34:12.142279 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.142267 2561 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 01 20:34:12.143842 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.143816 2561 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 01 20:34:12.143982 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.143844 2561 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 01 20:34:12.144028 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.143992 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 01 20:34:12.144028 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.143999 2561 container_manager_linux.go:306] "Creating device plugin manager" Jun 01 20:34:12.144028 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.144006 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 01 20:34:12.144654 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.144644 2561 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 01 20:34:12.146392 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.146382 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 01 20:34:12.146502 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.146494 2561 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 01 20:34:12.149516 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.149505 2561 kubelet.go:491] "Attempting to sync node with API server" Jun 01 20:34:12.149568 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.149520 2561 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 01 20:34:12.149568 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.149539 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 01 20:34:12.149568 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.149549 2561 kubelet.go:397] "Adding apiserver pod source" Jun 01 20:34:12.149568 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.149558 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 01 20:34:12.150468 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.150456 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 01 20:34:12.150507 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.150476 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 01 20:34:12.153202 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.153187 2561 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 01 20:34:12.155394 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.155381 2561 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 01 20:34:12.156418 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.156398 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dk29h" Jun 01 20:34:12.157708 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157694 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 01 20:34:12.157771 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157729 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 01 20:34:12.157771 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157738 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 01 20:34:12.157771 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157745 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 01 20:34:12.157771 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157753 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 01 20:34:12.157771 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157759 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 01 20:34:12.157771 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157766 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 01 20:34:12.157771 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157771 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 01 20:34:12.157970 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157779 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 01 20:34:12.157970 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157785 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 01 20:34:12.157970 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157797 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 01 20:34:12.157970 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.157803 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 01 20:34:12.158591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.158580 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 01 20:34:12.158591 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.158591 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 01 20:34:12.161851 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.161836 2561 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 01 20:34:12.161934 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.161875 2561 server.go:1295] "Started kubelet" Jun 01 20:34:12.162429 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.162394 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 01 20:34:12.162510 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.162429 2561 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 01 20:34:12.162510 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.162494 2561 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 01 20:34:12.162981 ip-10-0-134-139 systemd[1]: Started Kubernetes Kubelet. Jun 01 20:34:12.166207 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.166181 2561 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 01 20:34:12.166831 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.166779 2561 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 01 20:34:12.167239 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.167211 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dk29h" Jun 01 20:34:12.167495 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.167475 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 01 20:34:12.167495 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.167476 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 01 20:34:12.167635 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.167566 2561 server.go:317] "Adding debug handlers to kubelet server" Jun 01 20:34:12.170383 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.170357 2561 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 01 20:34:12.171308 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.170512 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-139.ec2.internal.18b50f4d40604110 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-139.ec2.internal,UID:ip-10-0-134-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-139.ec2.internal,},FirstTimestamp:2026-06-01 20:34:12.161847568 +0000 UTC m=+0.410146844,LastTimestamp:2026-06-01 20:34:12.161847568 +0000 UTC m=+0.410146844,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-139.ec2.internal,}" Jun 01 20:34:12.173312 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.173296 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 01 20:34:12.173945 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.173887 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 01 20:34:12.174039 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174017 2561 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 01 20:34:12.174039 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174037 2561 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 01 20:34:12.174167 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174155 2561 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 01 20:34:12.174231 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174217 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 01 20:34:12.174231 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174229 2561 reconciler.go:26] "Reconciler: start to sync state" Jun 01 20:34:12.174528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174512 2561 factory.go:55] Registering systemd factory Jun 01 20:34:12.174588 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174532 2561 factory.go:223] Registration of the systemd container factory successfully Jun 01 20:34:12.174754 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.174736 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-139.ec2.internal\" not found" Jun 01 20:34:12.174821 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174741 2561 factory.go:153] Registering CRI-O factory Jun 01 20:34:12.174821 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174768 2561 factory.go:223] Registration of the crio container factory successfully Jun 01 20:34:12.174821 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174817 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 01 20:34:12.174964 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174837 2561 factory.go:103] Registering Raw factory Jun 01 20:34:12.174964 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.174850 2561 manager.go:1196] Started watching for new ooms in manager Jun 01 20:34:12.175226 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.175209 2561 manager.go:319] Starting recovery of all containers Jun 01 20:34:12.179287 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.179263 2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 01 20:34:12.181486 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.181463 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-139.ec2.internal\" not found" node="ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.181868 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.181823 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 01 20:34:12.186359 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.186342 2561 manager.go:324] Recovery completed Jun 01 20:34:12.187704 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.187687 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 01 20:34:12.190295 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.190283 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 01 20:34:12.192215 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.192202 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientMemory" Jun 01 20:34:12.192279 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.192226 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 01 20:34:12.192279 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.192237 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientPID" Jun 01 20:34:12.192682 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.192671 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 01 20:34:12.192682 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.192680 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 01 20:34:12.192844 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.192694 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 01 20:34:12.195421 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.195409 2561 policy_none.go:49] "None policy: Start" Jun 01 20:34:12.195468 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.195426 2561 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 01 20:34:12.195468 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.195436 2561 state_mem.go:35] "Initializing new in-memory state store" Jun 01 20:34:12.258894 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.239149 2561 manager.go:341] "Starting Device Plugin manager" Jun 01 20:34:12.258894 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.239205 2561 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 01 20:34:12.258894 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.239215 2561 server.go:85] "Starting device plugin registration server" Jun 01 20:34:12.258894 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.239448 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 01 20:34:12.258894 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.239461 2561 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 01 20:34:12.258894 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.239551 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 01 20:34:12.258894 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.239651 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 01 20:34:12.258894 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.239660 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 01 20:34:12.258894 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.240311 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 01 20:34:12.258894 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.240363 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-139.ec2.internal\" not found" Jun 01 20:34:12.272253 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.272229 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 01 20:34:12.272373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.272261 2561 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 01 20:34:12.272373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.272279 2561 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 01 20:34:12.272373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.272286 2561 kubelet.go:2451] "Starting kubelet main sync loop" Jun 01 20:34:12.272516 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.272364 2561 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 01 20:34:12.278514 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.278498 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 01 20:34:12.340454 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.340384 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 01 20:34:12.341811 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.341793 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientMemory" Jun 01 20:34:12.341934 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.341831 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 01 20:34:12.341934 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.341844 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientPID" Jun 01 20:34:12.341934 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.341869 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.349110 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.349096 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.349153 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.349119 2561 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-139.ec2.internal\": node \"ip-10-0-134-139.ec2.internal\" not found" Jun 01 20:34:12.368194 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.368169 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-139.ec2.internal\" not found" Jun 01 20:34:12.373235 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.373220 2561 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-139.ec2.internal"] Jun 01 20:34:12.373303 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.373293 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 01 20:34:12.374115 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.374098 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientMemory" Jun 01 20:34:12.374179 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.374127 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 01 20:34:12.374179 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.374139 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientPID" Jun 01 20:34:12.375272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.375256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49745c6fbb96d179e264f3116dbcca39-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal\" (UID: \"49745c6fbb96d179e264f3116dbcca39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.375343 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.375286 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49745c6fbb96d179e264f3116dbcca39-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal\" (UID: \"49745c6fbb96d179e264f3116dbcca39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.375386 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.375351 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 01 20:34:12.375530 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.375512 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.375575 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.375546 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 01 20:34:12.376028 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.376011 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientMemory" Jun 01 20:34:12.376028 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.376021 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientMemory" Jun 01 20:34:12.376200 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.376038 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 01 20:34:12.376200 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.376044 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 01 20:34:12.376200 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.376050 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientPID" Jun 01 20:34:12.376200 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.376063 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientPID" Jun 01 20:34:12.377139 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.377125 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.377210 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.377150 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 01 20:34:12.377740 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.377727 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientMemory" Jun 01 20:34:12.377814 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.377754 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 01 20:34:12.377814 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.377768 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeHasSufficientPID" Jun 01 20:34:12.392175 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.392155 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-139.ec2.internal\" not found" node="ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.395521 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.395506 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-139.ec2.internal\" not found" node="ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.468310 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.468276 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-139.ec2.internal\" not found" Jun 01 20:34:12.476063 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.476036 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49745c6fbb96d179e264f3116dbcca39-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal\" (UID: \"49745c6fbb96d179e264f3116dbcca39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.476207 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.476072 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49745c6fbb96d179e264f3116dbcca39-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal\" (UID: \"49745c6fbb96d179e264f3116dbcca39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.476207 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.476100 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b796fdfcee5e37a7d2d9a6e13edd54f1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-139.ec2.internal\" (UID: \"b796fdfcee5e37a7d2d9a6e13edd54f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.476207 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.476141 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49745c6fbb96d179e264f3116dbcca39-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal\" (UID: \"49745c6fbb96d179e264f3116dbcca39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.476207 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.476148 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49745c6fbb96d179e264f3116dbcca39-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal\" (UID: \"49745c6fbb96d179e264f3116dbcca39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.569425 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.569394 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-139.ec2.internal\" not found" Jun 01 20:34:12.576770 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.576750 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b796fdfcee5e37a7d2d9a6e13edd54f1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-139.ec2.internal\" (UID: \"b796fdfcee5e37a7d2d9a6e13edd54f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.576827 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.576711 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b796fdfcee5e37a7d2d9a6e13edd54f1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-139.ec2.internal\" (UID: \"b796fdfcee5e37a7d2d9a6e13edd54f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.670241 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.670144 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-139.ec2.internal\" not found" Jun 01 20:34:12.694563 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.694523 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.700447 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:12.700428 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-139.ec2.internal" Jun 01 20:34:12.770643 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.770600 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-139.ec2.internal\" not found" Jun 01 20:34:12.871134 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.871090 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-139.ec2.internal\" not found" Jun 01 20:34:12.971636 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:12.971561 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-139.ec2.internal\" not found" Jun 01 20:34:13.072061 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.072031 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-139.ec2.internal\" not found" Jun 01 20:34:13.075832 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.075817 2561 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 01 20:34:13.085134 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.085115 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 01 20:34:13.085250 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.085224 2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 01 20:34:13.085355 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.085274 2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 01 20:34:13.085355 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.085280 2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 01 20:34:13.150445 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.150417 2561 apiserver.go:52] "Watching apiserver" Jun 01 20:34:13.164843 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.164805 2561 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 01 20:34:13.167115 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.167093 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-mgc8h","openshift-image-registry/node-ca-hr6hz","openshift-multus/multus-additional-cni-plugins-lcxjj","openshift-multus/multus-f2zl5","openshift-network-diagnostics/network-check-target-8qpcz","openshift-multus/network-metrics-daemon-2kqdx","openshift-network-operator/iptables-alerter-g7d5r","openshift-ovn-kubernetes/ovnkube-node-5zgnz","kube-system/konnectivity-agent-jskqr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv","openshift-cluster-node-tuning-operator/tuned-7n92j"] Jun 01 20:34:13.169967 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.169942 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-31 20:29:12 +0000 UTC" deadline="2028-01-12 09:50:38.421637074 +0000 UTC" Jun 01 20:34:13.170022 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.169967 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14149h16m25.251672952s" Jun 01 20:34:13.171018 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.170990 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mgc8h" Jun 01 20:34:13.171273 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.171253 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hr6hz" Jun 01 20:34:13.172851 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.172814 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2v79b\"" Jun 01 20:34:13.172851 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.172847 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 01 20:34:13.173003 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.172862 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 01 20:34:13.173058 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.173029 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.173350 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.173280 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zvwhd\"" Jun 01 20:34:13.173350 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.173281 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 01 20:34:13.173481 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.173414 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 01 20:34:13.173686 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.173605 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 01 20:34:13.174652 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.173681 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 01 20:34:13.174652 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.174471 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-139.ec2.internal" Jun 01 20:34:13.175122 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.175045 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2hnl\"" Jun 01 20:34:13.175494 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.175475 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 01 20:34:13.175637 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.175605 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 01 20:34:13.175976 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.175948 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 01 20:34:13.176043 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.176024 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 01 20:34:13.176111 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.176067 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 01 20:34:13.177949 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.177927 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.178042 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.178009 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:13.178107 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.178082 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:13.179345 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-os-release\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179431 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-run-netns\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179431 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-multus-cni-dir\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179431 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179384 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-var-lib-cni-bin\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179431 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-var-lib-cni-multus\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179635 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-run-multus-certs\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179635 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ec81339-bebd-4521-bea1-f04abfbde340-multus-daemon-config\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179635 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq8zd\" (UniqueName: \"kubernetes.io/projected/5ec81339-bebd-4521-bea1-f04abfbde340-kube-api-access-dq8zd\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179635 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179521 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-os-release\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.179635 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/14095d77-149b-4d73-9273-672aeb86dbd8-serviceca\") pod \"node-ca-hr6hz\" (UID: \"14095d77-149b-4d73-9273-672aeb86dbd8\") " pod="openshift-image-registry/node-ca-hr6hz" Jun 01 20:34:13.179635 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.179635 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179618 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-multus-socket-dir-parent\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-hostroot\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179739 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8d3811c-ea66-48f0-8b87-a427561261d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8d3811c-ea66-48f0-8b87-a427561261d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179788 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gpbb\" (UniqueName: \"kubernetes.io/projected/d09ae907-2157-41c9-83fb-d0f2c6193eb2-kube-api-access-2gpbb\") pod \"node-resolver-mgc8h\" (UID: \"d09ae907-2157-41c9-83fb-d0f2c6193eb2\") " pod="openshift-dns/node-resolver-mgc8h" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179810 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-etc-kubernetes\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d09ae907-2157-41c9-83fb-d0f2c6193eb2-tmp-dir\") pod \"node-resolver-mgc8h\" (UID: \"d09ae907-2157-41c9-83fb-d0f2c6193eb2\") " pod="openshift-dns/node-resolver-mgc8h" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179840 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-cnibin\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8d3811c-ea66-48f0-8b87-a427561261d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs2wh\" (UniqueName: \"kubernetes.io/projected/f8d3811c-ea66-48f0-8b87-a427561261d5-kube-api-access-gs2wh\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-cnibin\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179972 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5rbb5\"" Jun 01 20:34:13.179995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.179974 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ec81339-bebd-4521-bea1-f04abfbde340-cni-binary-copy\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.180528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.180008 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 01 20:34:13.180528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.180013 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-var-lib-kubelet\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.180528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.180047 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-multus-conf-dir\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.180528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.180092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14095d77-149b-4d73-9273-672aeb86dbd8-host\") pod \"node-ca-hr6hz\" (UID: \"14095d77-149b-4d73-9273-672aeb86dbd8\") " pod="openshift-image-registry/node-ca-hr6hz" Jun 01 20:34:13.180528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.180125 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-system-cni-dir\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.180528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.180156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-run-k8s-cni-cncf-io\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.180528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.180184 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d09ae907-2157-41c9-83fb-d0f2c6193eb2-hosts-file\") pod \"node-resolver-mgc8h\" (UID: \"d09ae907-2157-41c9-83fb-d0f2c6193eb2\") " pod="openshift-dns/node-resolver-mgc8h" Jun 01 20:34:13.180528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.180203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2qm4\" (UniqueName: \"kubernetes.io/projected/14095d77-149b-4d73-9273-672aeb86dbd8-kube-api-access-m2qm4\") pod \"node-ca-hr6hz\" (UID: \"14095d77-149b-4d73-9273-672aeb86dbd8\") " pod="openshift-image-registry/node-ca-hr6hz" Jun 01 20:34:13.180528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.180217 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-system-cni-dir\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.181733 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.181718 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:13.181820 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.181778 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:13.181820 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.181808 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g7d5r" Jun 01 20:34:13.183661 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.183642 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 01 20:34:13.183757 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.183714 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" Jun 01 20:34:13.183757 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.183719 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 01 20:34:13.183857 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.183769 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 01 20:34:13.183857 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.183720 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 01 20:34:13.184023 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.184008 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q8k58\"" Jun 01 20:34:13.184225 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.184210 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.186553 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.186305 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 01 20:34:13.186553 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.186350 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:13.186553 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.186413 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 01 20:34:13.186751 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.186596 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 01 20:34:13.186751 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.186735 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c6vrv\"" Jun 01 20:34:13.187105 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.186859 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 01 20:34:13.187105 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.186995 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 01 20:34:13.187105 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.187027 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 01 20:34:13.187242 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.187158 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 01 20:34:13.188498 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.188483 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.188892 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.188874 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 01 20:34:13.188969 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.188956 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bcpp2\"" Jun 01 20:34:13.188969 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.188964 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 01 20:34:13.190064 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.190048 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 01 20:34:13.190336 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.190312 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h97q2\"" Jun 01 20:34:13.190441 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.190424 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 01 20:34:13.190508 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.190491 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-139.ec2.internal"] Jun 01 20:34:13.190586 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.190574 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.190764 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.190746 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 01 20:34:13.192227 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.192210 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 01 20:34:13.192409 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.192395 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hhn55\"" Jun 01 20:34:13.192582 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.192470 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 01 20:34:13.194755 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.194739 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 01 20:34:13.194957 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.194944 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal"] Jun 01 20:34:13.208720 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.208699 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qd5qh" Jun 01 20:34:13.216803 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.216780 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qd5qh" Jun 01 20:34:13.275193 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.275050 2561 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 01 20:34:13.281300 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.281401 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281319 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8d3811c-ea66-48f0-8b87-a427561261d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.281401 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281349 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gpbb\" (UniqueName: \"kubernetes.io/projected/d09ae907-2157-41c9-83fb-d0f2c6193eb2-kube-api-access-2gpbb\") pod \"node-resolver-mgc8h\" (UID: \"d09ae907-2157-41c9-83fb-d0f2c6193eb2\") " pod="openshift-dns/node-resolver-mgc8h" Jun 01 20:34:13.281401 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281375 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-systemd\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.281560 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl8xn\" (UniqueName: \"kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn\") pod \"network-check-target-8qpcz\" (UID: \"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34\") " pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:13.281560 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281426 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-registration-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.281560 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281474 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-etc-kubernetes\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.281560 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281535 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-etc-kubernetes\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.281560 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-modprobe-d\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.281808 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-sysctl-d\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.281808 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281614 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4f44b26-668e-4e5f-bfd7-2c395bb88778-ovn-node-metrics-cert\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.281808 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281666 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-tuned\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.281808 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:13.281808 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281719 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8d3811c-ea66-48f0-8b87-a427561261d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.281808 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281748 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gs2wh\" (UniqueName: \"kubernetes.io/projected/f8d3811c-ea66-48f0-8b87-a427561261d5-kube-api-access-gs2wh\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.281808 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46dd7c3b-3af0-4f11-9471-1490e0a7c0da-konnectivity-ca\") pod \"konnectivity-agent-jskqr\" (UID: \"46dd7c3b-3af0-4f11-9471-1490e0a7c0da\") " pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:13.281808 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-device-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281827 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-run-k8s-cni-cncf-io\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281853 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d09ae907-2157-41c9-83fb-d0f2c6193eb2-hosts-file\") pod \"node-resolver-mgc8h\" (UID: \"d09ae907-2157-41c9-83fb-d0f2c6193eb2\") " pod="openshift-dns/node-resolver-mgc8h" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281881 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8d3811c-ea66-48f0-8b87-a427561261d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281910 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-run-k8s-cni-cncf-io\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281884 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2qm4\" (UniqueName: \"kubernetes.io/projected/14095d77-149b-4d73-9273-672aeb86dbd8-kube-api-access-m2qm4\") pod \"node-ca-hr6hz\" (UID: \"14095d77-149b-4d73-9273-672aeb86dbd8\") " pod="openshift-image-registry/node-ca-hr6hz" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281941 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d09ae907-2157-41c9-83fb-d0f2c6193eb2-hosts-file\") pod \"node-resolver-mgc8h\" (UID: \"d09ae907-2157-41c9-83fb-d0f2c6193eb2\") " pod="openshift-dns/node-resolver-mgc8h" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-sysctl-conf\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.281992 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-host\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282017 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46dd7c3b-3af0-4f11-9471-1490e0a7c0da-agent-certs\") pod \"konnectivity-agent-jskqr\" (UID: \"46dd7c3b-3af0-4f11-9471-1490e0a7c0da\") " pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282040 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-run-ovn\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282061 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-multus-cni-dir\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282077 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-var-lib-cni-multus\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282092 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-run-multus-certs\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-kubelet\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282148 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-multus-cni-dir\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-etc-openvswitch\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.282175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282163 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-var-lib-cni-multus\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282181 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-log-socket\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282171 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8d3811c-ea66-48f0-8b87-a427561261d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282198 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-run-multus-certs\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e-iptables-alerter-script\") pod \"iptables-alerter-g7d5r\" (UID: \"2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e\") " pod="openshift-network-operator/iptables-alerter-g7d5r" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282230 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ec81339-bebd-4521-bea1-f04abfbde340-multus-daemon-config\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282247 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8zd\" (UniqueName: \"kubernetes.io/projected/5ec81339-bebd-4521-bea1-f04abfbde340-kube-api-access-dq8zd\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282268 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/14095d77-149b-4d73-9273-672aeb86dbd8-serviceca\") pod \"node-ca-hr6hz\" (UID: \"14095d77-149b-4d73-9273-672aeb86dbd8\") " pod="openshift-image-registry/node-ca-hr6hz" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-node-log\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-cni-netd\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282409 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282515 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-multus-socket-dir-parent\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282537 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282567 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-multus-socket-dir-parent\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282577 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-kubernetes\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm49n\" (UniqueName: \"kubernetes.io/projected/b934ded8-2018-40fd-899b-d1b5fb08434d-kube-api-access-cm49n\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t47tm\" (UniqueName: \"kubernetes.io/projected/81a6c9fa-0e20-455d-b262-0711156022fe-kube-api-access-t47tm\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:13.283012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282667 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/14095d77-149b-4d73-9273-672aeb86dbd8-serviceca\") pod \"node-ca-hr6hz\" (UID: \"14095d77-149b-4d73-9273-672aeb86dbd8\") " pod="openshift-image-registry/node-ca-hr6hz" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282672 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-slash\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282701 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8d3811c-ea66-48f0-8b87-a427561261d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-run\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282739 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4f44b26-668e-4e5f-bfd7-2c395bb88778-ovnkube-config\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282757 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4f44b26-668e-4e5f-bfd7-2c395bb88778-ovnkube-script-lib\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282785 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d09ae907-2157-41c9-83fb-d0f2c6193eb2-tmp-dir\") pod \"node-resolver-mgc8h\" (UID: \"d09ae907-2157-41c9-83fb-d0f2c6193eb2\") " pod="openshift-dns/node-resolver-mgc8h" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282805 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-sysconfig\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282820 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-lib-modules\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282835 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-run-systemd\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282859 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5ec81339-bebd-4521-bea1-f04abfbde340-multus-daemon-config\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282917 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-cnibin\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282943 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-cnibin\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282971 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-cnibin\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.282972 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ec81339-bebd-4521-bea1-f04abfbde340-cni-binary-copy\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283013 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-var-lib-kubelet\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.283836 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283038 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-cnibin\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283045 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-multus-conf-dir\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283071 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14095d77-149b-4d73-9273-672aeb86dbd8-host\") pod \"node-ca-hr6hz\" (UID: \"14095d77-149b-4d73-9273-672aeb86dbd8\") " pod="openshift-image-registry/node-ca-hr6hz" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-run-openvswitch\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283102 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d09ae907-2157-41c9-83fb-d0f2c6193eb2-tmp-dir\") pod \"node-resolver-mgc8h\" (UID: \"d09ae907-2157-41c9-83fb-d0f2c6193eb2\") " pod="openshift-dns/node-resolver-mgc8h" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-run-ovn-kubernetes\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283162 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/14095d77-149b-4d73-9273-672aeb86dbd8-host\") pod \"node-ca-hr6hz\" (UID: \"14095d77-149b-4d73-9273-672aeb86dbd8\") " pod="openshift-image-registry/node-ca-hr6hz" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-var-lib-kubelet\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283178 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-multus-conf-dir\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283191 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-system-cni-dir\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-sys\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8d3811c-ea66-48f0-8b87-a427561261d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-run-netns\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kxv8\" (UniqueName: \"kubernetes.io/projected/f4f44b26-668e-4e5f-bfd7-2c395bb88778-kube-api-access-8kxv8\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283280 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-system-cni-dir\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh7p2\" (UniqueName: \"kubernetes.io/projected/2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e-kube-api-access-vh7p2\") pod \"iptables-alerter-g7d5r\" (UID: \"2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e\") " pod="openshift-network-operator/iptables-alerter-g7d5r" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283322 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-sys-fs\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.284570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283347 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkzcz\" (UniqueName: \"kubernetes.io/projected/b07a44f6-d443-4ce3-9488-e738143afd9f-kube-api-access-hkzcz\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283377 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-system-cni-dir\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283396 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-os-release\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283410 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-run-netns\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283413 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ec81339-bebd-4521-bea1-f04abfbde340-cni-binary-copy\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283430 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-cni-bin\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283473 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-system-cni-dir\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283473 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-run-netns\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283490 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-os-release\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283520 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e-host-slash\") pod \"iptables-alerter-g7d5r\" (UID: \"2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e\") " pod="openshift-network-operator/iptables-alerter-g7d5r" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283548 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-var-lib-cni-bin\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-var-lib-kubelet\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283581 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-host-var-lib-cni-bin\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-systemd-units\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283652 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4f44b26-668e-4e5f-bfd7-2c395bb88778-env-overrides\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283675 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-os-release\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-socket-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.285053 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283715 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-hostroot\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.285608 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b934ded8-2018-40fd-899b-d1b5fb08434d-tmp\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.285608 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283748 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8d3811c-ea66-48f0-8b87-a427561261d5-os-release\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.285608 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283766 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-var-lib-openvswitch\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.285608 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283792 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5ec81339-bebd-4521-bea1-f04abfbde340-hostroot\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.285608 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.283794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.286520 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:13.286495 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49745c6fbb96d179e264f3116dbcca39.slice/crio-780d0bea15cec4214d233db261828ab160738bf46b55a321ed5c441b4de491ee WatchSource:0}: Error finding container 780d0bea15cec4214d233db261828ab160738bf46b55a321ed5c441b4de491ee: Status 404 returned error can't find the container with id 780d0bea15cec4214d233db261828ab160738bf46b55a321ed5c441b4de491ee Jun 01 20:34:13.286790 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:13.286771 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb796fdfcee5e37a7d2d9a6e13edd54f1.slice/crio-ccaf59c28a151ae25826e815f6e3fba5347957c1394a9bd1d1456bd134a089cb WatchSource:0}: Error finding container ccaf59c28a151ae25826e815f6e3fba5347957c1394a9bd1d1456bd134a089cb: Status 404 returned error can't find the container with id ccaf59c28a151ae25826e815f6e3fba5347957c1394a9bd1d1456bd134a089cb Jun 01 20:34:13.290842 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.290821 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 01 20:34:13.291906 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.291724 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 01 20:34:13.294263 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.294241 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs2wh\" (UniqueName: \"kubernetes.io/projected/f8d3811c-ea66-48f0-8b87-a427561261d5-kube-api-access-gs2wh\") pod \"multus-additional-cni-plugins-lcxjj\" (UID: \"f8d3811c-ea66-48f0-8b87-a427561261d5\") " pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.294352 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.294264 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gpbb\" (UniqueName: \"kubernetes.io/projected/d09ae907-2157-41c9-83fb-d0f2c6193eb2-kube-api-access-2gpbb\") pod \"node-resolver-mgc8h\" (UID: \"d09ae907-2157-41c9-83fb-d0f2c6193eb2\") " pod="openshift-dns/node-resolver-mgc8h" Jun 01 20:34:13.294352 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.294241 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq8zd\" (UniqueName: \"kubernetes.io/projected/5ec81339-bebd-4521-bea1-f04abfbde340-kube-api-access-dq8zd\") pod \"multus-f2zl5\" (UID: \"5ec81339-bebd-4521-bea1-f04abfbde340\") " pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.294352 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.294267 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2qm4\" (UniqueName: \"kubernetes.io/projected/14095d77-149b-4d73-9273-672aeb86dbd8-kube-api-access-m2qm4\") pod \"node-ca-hr6hz\" (UID: \"14095d77-149b-4d73-9273-672aeb86dbd8\") " pod="openshift-image-registry/node-ca-hr6hz" Jun 01 20:34:13.384704 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384679 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-cni-bin\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.384704 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384707 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e-host-slash\") pod \"iptables-alerter-g7d5r\" (UID: \"2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e\") " pod="openshift-network-operator/iptables-alerter-g7d5r" Jun 01 20:34:13.384920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384723 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-var-lib-kubelet\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.384920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384737 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-systemd-units\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.384920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384792 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e-host-slash\") pod \"iptables-alerter-g7d5r\" (UID: \"2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e\") " pod="openshift-network-operator/iptables-alerter-g7d5r" Jun 01 20:34:13.384920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384800 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-cni-bin\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.384920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384853 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-var-lib-kubelet\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.384920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384859 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-systemd-units\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.384920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384875 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4f44b26-668e-4e5f-bfd7-2c395bb88778-env-overrides\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.384920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384891 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-socket-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.384920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384908 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b934ded8-2018-40fd-899b-d1b5fb08434d-tmp\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.384920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384922 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-var-lib-openvswitch\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384937 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384953 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384969 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-systemd\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.384987 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl8xn\" (UniqueName: \"kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn\") pod \"network-check-target-8qpcz\" (UID: \"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34\") " pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385011 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-registration-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385035 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-modprobe-d\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385041 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-var-lib-openvswitch\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385031 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385057 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-socket-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385069 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-systemd\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385084 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-sysctl-d\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385105 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385117 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4f44b26-668e-4e5f-bfd7-2c395bb88778-ovn-node-metrics-cert\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385134 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-tuned\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385151 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385108 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-registration-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.385373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385178 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46dd7c3b-3af0-4f11-9471-1490e0a7c0da-konnectivity-ca\") pod \"konnectivity-agent-jskqr\" (UID: \"46dd7c3b-3af0-4f11-9471-1490e0a7c0da\") " pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385203 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-device-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385207 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-modprobe-d\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385234 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-sysctl-conf\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385259 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-host\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385203 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-sysctl-d\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385282 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46dd7c3b-3af0-4f11-9471-1490e0a7c0da-agent-certs\") pod \"konnectivity-agent-jskqr\" (UID: \"46dd7c3b-3af0-4f11-9471-1490e0a7c0da\") " pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.385287 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385320 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-run-ovn\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385362 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-run-ovn\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385406 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4f44b26-668e-4e5f-bfd7-2c395bb88778-env-overrides\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.385415 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs podName:81a6c9fa-0e20-455d-b262-0711156022fe nodeName:}" failed. No retries permitted until 2026-06-01 20:34:13.885327514 +0000 UTC m=+2.133626778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs") pod "network-metrics-daemon-2kqdx" (UID: "81a6c9fa-0e20-455d-b262-0711156022fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385462 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-kubelet\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385489 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-etc-openvswitch\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385514 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-log-socket\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385541 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e-iptables-alerter-script\") pod \"iptables-alerter-g7d5r\" (UID: \"2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e\") " pod="openshift-network-operator/iptables-alerter-g7d5r" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385571 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-node-log\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.386107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385595 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-cni-netd\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385653 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-kubernetes\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-device-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385683 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cm49n\" (UniqueName: \"kubernetes.io/projected/b934ded8-2018-40fd-899b-d1b5fb08434d-kube-api-access-cm49n\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385711 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t47tm\" (UniqueName: \"kubernetes.io/projected/81a6c9fa-0e20-455d-b262-0711156022fe-kube-api-access-t47tm\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385729 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-etc-openvswitch\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385732 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-host\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385739 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-slash\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385759 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-kubelet\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385765 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-run\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385770 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-log-socket\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385802 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4f44b26-668e-4e5f-bfd7-2c395bb88778-ovnkube-config\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385810 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-node-log\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385816 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-run\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385831 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4f44b26-668e-4e5f-bfd7-2c395bb88778-ovnkube-script-lib\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385860 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-sysconfig\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385870 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-slash\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385878 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46dd7c3b-3af0-4f11-9471-1490e0a7c0da-konnectivity-ca\") pod \"konnectivity-agent-jskqr\" (UID: \"46dd7c3b-3af0-4f11-9471-1490e0a7c0da\") " pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:13.387046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385885 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-lib-modules\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385680 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-sysctl-conf\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385911 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-run-systemd\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385937 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385869 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-kubernetes\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385966 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-run-openvswitch\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.385992 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-run-ovn-kubernetes\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386012 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-sysconfig\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-run-ovn-kubernetes\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386079 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-run-systemd\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386090 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-lib-modules\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386120 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-run-openvswitch\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386117 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386132 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-sys\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386164 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-run-netns\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386193 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kxv8\" (UniqueName: \"kubernetes.io/projected/f4f44b26-668e-4e5f-bfd7-2c395bb88778-kube-api-access-8kxv8\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386218 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vh7p2\" (UniqueName: \"kubernetes.io/projected/2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e-kube-api-access-vh7p2\") pod \"iptables-alerter-g7d5r\" (UID: \"2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e\") " pod="openshift-network-operator/iptables-alerter-g7d5r" Jun 01 20:34:13.387943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-run-netns\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386246 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-sys-fs\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386287 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkzcz\" (UniqueName: \"kubernetes.io/projected/b07a44f6-d443-4ce3-9488-e738143afd9f-kube-api-access-hkzcz\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386296 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b07a44f6-d443-4ce3-9488-e738143afd9f-sys-fs\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b934ded8-2018-40fd-899b-d1b5fb08434d-sys\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386373 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e-iptables-alerter-script\") pod \"iptables-alerter-g7d5r\" (UID: \"2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e\") " pod="openshift-network-operator/iptables-alerter-g7d5r" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386425 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4f44b26-668e-4e5f-bfd7-2c395bb88778-host-cni-netd\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386453 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4f44b26-668e-4e5f-bfd7-2c395bb88778-ovnkube-config\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.386650 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4f44b26-668e-4e5f-bfd7-2c395bb88778-ovnkube-script-lib\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.388062 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46dd7c3b-3af0-4f11-9471-1490e0a7c0da-agent-certs\") pod \"konnectivity-agent-jskqr\" (UID: \"46dd7c3b-3af0-4f11-9471-1490e0a7c0da\") " pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.388350 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b934ded8-2018-40fd-899b-d1b5fb08434d-etc-tuned\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.388367 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4f44b26-668e-4e5f-bfd7-2c395bb88778-ovn-node-metrics-cert\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.388522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.388378 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b934ded8-2018-40fd-899b-d1b5fb08434d-tmp\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.393341 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.393324 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 01 20:34:13.393387 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.393344 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 01 20:34:13.393387 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.393355 2561 projected.go:194] Error preparing data for projected volume kube-api-access-gl8xn for pod openshift-network-diagnostics/network-check-target-8qpcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:13.393451 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.393401 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn podName:4cfc53fd-18ac-4afd-861f-c5b7d8b25f34 nodeName:}" failed. No retries permitted until 2026-06-01 20:34:13.893387508 +0000 UTC m=+2.141686789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gl8xn" (UniqueName: "kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn") pod "network-check-target-8qpcz" (UID: "4cfc53fd-18ac-4afd-861f-c5b7d8b25f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:13.395481 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.395457 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t47tm\" (UniqueName: \"kubernetes.io/projected/81a6c9fa-0e20-455d-b262-0711156022fe-kube-api-access-t47tm\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:13.395912 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.395888 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh7p2\" (UniqueName: \"kubernetes.io/projected/2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e-kube-api-access-vh7p2\") pod \"iptables-alerter-g7d5r\" (UID: \"2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e\") " pod="openshift-network-operator/iptables-alerter-g7d5r" Jun 01 20:34:13.396528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.396507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm49n\" (UniqueName: \"kubernetes.io/projected/b934ded8-2018-40fd-899b-d1b5fb08434d-kube-api-access-cm49n\") pod \"tuned-7n92j\" (UID: \"b934ded8-2018-40fd-899b-d1b5fb08434d\") " pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.396802 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.396778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkzcz\" (UniqueName: \"kubernetes.io/projected/b07a44f6-d443-4ce3-9488-e738143afd9f-kube-api-access-hkzcz\") pod \"aws-ebs-csi-driver-node-fc5hv\" (UID: \"b07a44f6-d443-4ce3-9488-e738143afd9f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.397021 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.397005 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kxv8\" (UniqueName: \"kubernetes.io/projected/f4f44b26-668e-4e5f-bfd7-2c395bb88778-kube-api-access-8kxv8\") pod \"ovnkube-node-5zgnz\" (UID: \"f4f44b26-668e-4e5f-bfd7-2c395bb88778\") " pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.491315 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.491220 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mgc8h" Jun 01 20:34:13.498810 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:13.498787 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd09ae907_2157_41c9_83fb_d0f2c6193eb2.slice/crio-42bd3017ec881546762471ee5c8419a5a06130b2bfae39683c4e80ba579a26e6 WatchSource:0}: Error finding container 42bd3017ec881546762471ee5c8419a5a06130b2bfae39683c4e80ba579a26e6: Status 404 returned error can't find the container with id 42bd3017ec881546762471ee5c8419a5a06130b2bfae39683c4e80ba579a26e6 Jun 01 20:34:13.505300 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.505284 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hr6hz" Jun 01 20:34:13.511675 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:13.511651 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14095d77_149b_4d73_9273_672aeb86dbd8.slice/crio-021b7b0dbd44e5171da4202090a5f6067c45aae6364bb76b53716022c04eab8c WatchSource:0}: Error finding container 021b7b0dbd44e5171da4202090a5f6067c45aae6364bb76b53716022c04eab8c: Status 404 returned error can't find the container with id 021b7b0dbd44e5171da4202090a5f6067c45aae6364bb76b53716022c04eab8c Jun 01 20:34:13.523917 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.523898 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" Jun 01 20:34:13.526161 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.526140 2561 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 01 20:34:13.529664 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:13.529647 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d3811c_ea66_48f0_8b87_a427561261d5.slice/crio-35dbf01bdd67ab0bff7b5c5fb1cd9f5ab61345d974622d941aba90dbd1d2f970 WatchSource:0}: Error finding container 35dbf01bdd67ab0bff7b5c5fb1cd9f5ab61345d974622d941aba90dbd1d2f970: Status 404 returned error can't find the container with id 35dbf01bdd67ab0bff7b5c5fb1cd9f5ab61345d974622d941aba90dbd1d2f970 Jun 01 20:34:13.535381 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.535367 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f2zl5" Jun 01 20:34:13.541813 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.541796 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g7d5r" Jun 01 20:34:13.542601 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:13.542581 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec81339_bebd_4521_bea1_f04abfbde340.slice/crio-5f4ab339d0c78ef7d14dc7d3f5a9e9a2a498c8f0ace3c6972328e43b85236385 WatchSource:0}: Error finding container 5f4ab339d0c78ef7d14dc7d3f5a9e9a2a498c8f0ace3c6972328e43b85236385: Status 404 returned error can't find the container with id 5f4ab339d0c78ef7d14dc7d3f5a9e9a2a498c8f0ace3c6972328e43b85236385 Jun 01 20:34:13.547281 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:13.547255 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ccab492_b3ed_4295_a2d7_e0a1d9e8c60e.slice/crio-df96007678baa7297f03a8c497616782a3b6dae2413671c184db0081447ab39a WatchSource:0}: Error finding container df96007678baa7297f03a8c497616782a3b6dae2413671c184db0081447ab39a: Status 404 returned error can't find the container with id df96007678baa7297f03a8c497616782a3b6dae2413671c184db0081447ab39a Jun 01 20:34:13.559525 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.559505 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:13.565586 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:13.565566 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f44b26_668e_4e5f_bfd7_2c395bb88778.slice/crio-91ba3f90b2e25e9d348d3da542cbe60d0b84d021fa2b6c7844cfdc8d0fd23c8f WatchSource:0}: Error finding container 91ba3f90b2e25e9d348d3da542cbe60d0b84d021fa2b6c7844cfdc8d0fd23c8f: Status 404 returned error can't find the container with id 91ba3f90b2e25e9d348d3da542cbe60d0b84d021fa2b6c7844cfdc8d0fd23c8f Jun 01 20:34:13.566069 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.566054 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:13.572914 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:13.572891 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46dd7c3b_3af0_4f11_9471_1490e0a7c0da.slice/crio-45b1672797ecc7e3ce60d97a5efbfe1f7936e4b473dc53102e3920cdf09c8348 WatchSource:0}: Error finding container 45b1672797ecc7e3ce60d97a5efbfe1f7936e4b473dc53102e3920cdf09c8348: Status 404 returned error can't find the container with id 45b1672797ecc7e3ce60d97a5efbfe1f7936e4b473dc53102e3920cdf09c8348 Jun 01 20:34:13.592794 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.592769 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" Jun 01 20:34:13.598212 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:13.598182 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb07a44f6_d443_4ce3_9488_e738143afd9f.slice/crio-9318896c7ea71a92bfc1d35bed63c1949fc5f305a18f1e0ebf8f352e42b48c26 WatchSource:0}: Error finding container 9318896c7ea71a92bfc1d35bed63c1949fc5f305a18f1e0ebf8f352e42b48c26: Status 404 returned error can't find the container with id 9318896c7ea71a92bfc1d35bed63c1949fc5f305a18f1e0ebf8f352e42b48c26 Jun 01 20:34:13.601939 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.601920 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7n92j" Jun 01 20:34:13.606892 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:34:13.606874 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb934ded8_2018_40fd_899b_d1b5fb08434d.slice/crio-3c537cb3f9aa345e42946e73fb9b2c2ef98f740beae9dfd2fc5e0fe095bd241a WatchSource:0}: Error finding container 3c537cb3f9aa345e42946e73fb9b2c2ef98f740beae9dfd2fc5e0fe095bd241a: Status 404 returned error can't find the container with id 3c537cb3f9aa345e42946e73fb9b2c2ef98f740beae9dfd2fc5e0fe095bd241a Jun 01 20:34:13.890097 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.890023 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:13.890242 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.890146 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:13.890242 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.890201 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs podName:81a6c9fa-0e20-455d-b262-0711156022fe nodeName:}" failed. No retries permitted until 2026-06-01 20:34:14.890184466 +0000 UTC m=+3.138483731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs") pod "network-metrics-daemon-2kqdx" (UID: "81a6c9fa-0e20-455d-b262-0711156022fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:13.990416 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:13.990379 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl8xn\" (UniqueName: \"kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn\") pod \"network-check-target-8qpcz\" (UID: \"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34\") " pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:13.990676 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.990654 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 01 20:34:13.990758 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.990684 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 01 20:34:13.990758 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.990696 2561 projected.go:194] Error preparing data for projected volume kube-api-access-gl8xn for pod openshift-network-diagnostics/network-check-target-8qpcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:13.990855 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:13.990789 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn podName:4cfc53fd-18ac-4afd-861f-c5b7d8b25f34 nodeName:}" failed. No retries permitted until 2026-06-01 20:34:14.990770014 +0000 UTC m=+3.239069284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gl8xn" (UniqueName: "kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn") pod "network-check-target-8qpcz" (UID: "4cfc53fd-18ac-4afd-861f-c5b7d8b25f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:14.216184 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.216105 2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 01 20:34:14.217654 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.217603 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-31 20:29:13 +0000 UTC" deadline="2027-11-02 11:53:20.718267572 +0000 UTC" Jun 01 20:34:14.217654 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.217654 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12447h19m6.500616783s" Jun 01 20:34:14.321760 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.321693 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" event={"ID":"f8d3811c-ea66-48f0-8b87-a427561261d5","Type":"ContainerStarted","Data":"35dbf01bdd67ab0bff7b5c5fb1cd9f5ab61345d974622d941aba90dbd1d2f970"} Jun 01 20:34:14.323111 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.323079 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mgc8h" event={"ID":"d09ae907-2157-41c9-83fb-d0f2c6193eb2","Type":"ContainerStarted","Data":"42bd3017ec881546762471ee5c8419a5a06130b2bfae39683c4e80ba579a26e6"} Jun 01 20:34:14.339000 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.338863 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-139.ec2.internal" event={"ID":"b796fdfcee5e37a7d2d9a6e13edd54f1","Type":"ContainerStarted","Data":"ccaf59c28a151ae25826e815f6e3fba5347957c1394a9bd1d1456bd134a089cb"} Jun 01 20:34:14.344563 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.344527 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" event={"ID":"49745c6fbb96d179e264f3116dbcca39","Type":"ContainerStarted","Data":"780d0bea15cec4214d233db261828ab160738bf46b55a321ed5c441b4de491ee"} Jun 01 20:34:14.359720 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.359575 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7n92j" event={"ID":"b934ded8-2018-40fd-899b-d1b5fb08434d","Type":"ContainerStarted","Data":"3c537cb3f9aa345e42946e73fb9b2c2ef98f740beae9dfd2fc5e0fe095bd241a"} Jun 01 20:34:14.368325 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.368280 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" event={"ID":"b07a44f6-d443-4ce3-9488-e738143afd9f","Type":"ContainerStarted","Data":"9318896c7ea71a92bfc1d35bed63c1949fc5f305a18f1e0ebf8f352e42b48c26"} Jun 01 20:34:14.384889 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.384766 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jskqr" event={"ID":"46dd7c3b-3af0-4f11-9471-1490e0a7c0da","Type":"ContainerStarted","Data":"45b1672797ecc7e3ce60d97a5efbfe1f7936e4b473dc53102e3920cdf09c8348"} Jun 01 20:34:14.404287 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.404248 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" event={"ID":"f4f44b26-668e-4e5f-bfd7-2c395bb88778","Type":"ContainerStarted","Data":"91ba3f90b2e25e9d348d3da542cbe60d0b84d021fa2b6c7844cfdc8d0fd23c8f"} Jun 01 20:34:14.411397 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.410341 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hr6hz" event={"ID":"14095d77-149b-4d73-9273-672aeb86dbd8","Type":"ContainerStarted","Data":"021b7b0dbd44e5171da4202090a5f6067c45aae6364bb76b53716022c04eab8c"} Jun 01 20:34:14.416020 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.415981 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g7d5r" event={"ID":"2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e","Type":"ContainerStarted","Data":"df96007678baa7297f03a8c497616782a3b6dae2413671c184db0081447ab39a"} Jun 01 20:34:14.418712 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.418675 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f2zl5" event={"ID":"5ec81339-bebd-4521-bea1-f04abfbde340","Type":"ContainerStarted","Data":"5f4ab339d0c78ef7d14dc7d3f5a9e9a2a498c8f0ace3c6972328e43b85236385"} Jun 01 20:34:14.459387 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.459354 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 01 20:34:14.898237 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.898176 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:14.898435 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:14.898319 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:14.898435 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:14.898383 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs podName:81a6c9fa-0e20-455d-b262-0711156022fe nodeName:}" failed. No retries permitted until 2026-06-01 20:34:16.898363318 +0000 UTC m=+5.146662595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs") pod "network-metrics-daemon-2kqdx" (UID: "81a6c9fa-0e20-455d-b262-0711156022fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:14.999223 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:14.999170 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl8xn\" (UniqueName: \"kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn\") pod \"network-check-target-8qpcz\" (UID: \"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34\") " pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:14.999408 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:14.999381 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 01 20:34:14.999408 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:14.999399 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 01 20:34:14.999524 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:14.999411 2561 projected.go:194] Error preparing data for projected volume kube-api-access-gl8xn for pod openshift-network-diagnostics/network-check-target-8qpcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:14.999524 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:14.999469 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn podName:4cfc53fd-18ac-4afd-861f-c5b7d8b25f34 nodeName:}" failed. No retries permitted until 2026-06-01 20:34:16.99945119 +0000 UTC m=+5.247750479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gl8xn" (UniqueName: "kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn") pod "network-check-target-8qpcz" (UID: "4cfc53fd-18ac-4afd-861f-c5b7d8b25f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:15.218920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:15.218765 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-31 20:29:13 +0000 UTC" deadline="2028-01-21 03:35:50.480008935 +0000 UTC" Jun 01 20:34:15.218920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:15.218805 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14359h1m35.261207967s" Jun 01 20:34:15.272755 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:15.272722 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:15.272949 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:15.272769 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:15.272949 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:15.272875 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:15.273059 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:15.273013 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:15.604790 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:15.604701 2561 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 01 20:34:16.912304 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:16.912256 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:16.912708 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:16.912406 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:16.912708 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:16.912479 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs podName:81a6c9fa-0e20-455d-b262-0711156022fe nodeName:}" failed. No retries permitted until 2026-06-01 20:34:20.912456455 +0000 UTC m=+9.160755728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs") pod "network-metrics-daemon-2kqdx" (UID: "81a6c9fa-0e20-455d-b262-0711156022fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:17.012977 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:17.012929 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl8xn\" (UniqueName: \"kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn\") pod \"network-check-target-8qpcz\" (UID: \"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34\") " pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:17.013146 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:17.013083 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 01 20:34:17.013146 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:17.013106 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 01 20:34:17.013146 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:17.013117 2561 projected.go:194] Error preparing data for projected volume kube-api-access-gl8xn for pod openshift-network-diagnostics/network-check-target-8qpcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:17.013248 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:17.013172 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn podName:4cfc53fd-18ac-4afd-861f-c5b7d8b25f34 nodeName:}" failed. No retries permitted until 2026-06-01 20:34:21.013158307 +0000 UTC m=+9.261457570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gl8xn" (UniqueName: "kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn") pod "network-check-target-8qpcz" (UID: "4cfc53fd-18ac-4afd-861f-c5b7d8b25f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:17.273419 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:17.273349 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:17.273419 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:17.273399 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:17.273571 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:17.273489 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:17.273655 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:17.273611 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:19.273086 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:19.273047 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:19.273526 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:19.273055 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:19.273526 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:19.273187 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:19.273526 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:19.273272 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:20.430911 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.430730 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" event={"ID":"f8d3811c-ea66-48f0-8b87-a427561261d5","Type":"ContainerStarted","Data":"e4cf3cd389c9c0ccf9e47db4228c1ace135298fcabd9580e0456d800db2cae8b"} Jun 01 20:34:20.432462 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.432438 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mgc8h" event={"ID":"d09ae907-2157-41c9-83fb-d0f2c6193eb2","Type":"ContainerStarted","Data":"c2a3fb42aa8b32e7f6356510497a181e4caa488cd5760679099d83e8a2682c36"} Jun 01 20:34:20.433918 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.433897 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-139.ec2.internal" event={"ID":"b796fdfcee5e37a7d2d9a6e13edd54f1","Type":"ContainerStarted","Data":"16d9468610141bc5d16a02e7a0ab53752bd33ff0ada7515ce4752311a116aa1b"} Jun 01 20:34:20.435261 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.435242 2561 generic.go:358] "Generic (PLEG): container finished" podID="49745c6fbb96d179e264f3116dbcca39" containerID="53264274367b34c25a5e902e966596d287627387fb0d9381ec0f5602a45cf07d" exitCode=0 Jun 01 20:34:20.435339 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.435300 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" event={"ID":"49745c6fbb96d179e264f3116dbcca39","Type":"ContainerDied","Data":"53264274367b34c25a5e902e966596d287627387fb0d9381ec0f5602a45cf07d"} Jun 01 20:34:20.436637 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.436602 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" event={"ID":"b07a44f6-d443-4ce3-9488-e738143afd9f","Type":"ContainerStarted","Data":"ca5bace708770682eb0a8ae55b0f859f5c3f9c5d6da5c9e39338962b62d41834"} Jun 01 20:34:20.440488 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.440471 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jskqr" event={"ID":"46dd7c3b-3af0-4f11-9471-1490e0a7c0da","Type":"ContainerStarted","Data":"964aa2d73a43e768c85c6415939e1408992a85a5079cad6801a2a8d4c2e6bc1f"} Jun 01 20:34:20.441758 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.441736 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hr6hz" event={"ID":"14095d77-149b-4d73-9273-672aeb86dbd8","Type":"ContainerStarted","Data":"fac4b906891bc4a3432857a74c3623832012604021e22f583c433d6c6f415091"} Jun 01 20:34:20.464547 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.464510 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jskqr" podStartSLOduration=2.064092275 podStartE2EDuration="8.464497292s" podCreationTimestamp="2026-06-01 20:34:12 +0000 UTC" firstStartedPulling="2026-06-01 20:34:13.574210551 +0000 UTC m=+1.822509816" lastFinishedPulling="2026-06-01 20:34:19.97461556 +0000 UTC m=+8.222914833" observedRunningTime="2026-06-01 20:34:20.464318299 +0000 UTC m=+8.712617585" watchObservedRunningTime="2026-06-01 20:34:20.464497292 +0000 UTC m=+8.712796578" Jun 01 20:34:20.486477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.486434 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-139.ec2.internal" podStartSLOduration=7.486421079 podStartE2EDuration="7.486421079s" podCreationTimestamp="2026-06-01 20:34:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 20:34:20.48596291 +0000 UTC m=+8.734262197" watchObservedRunningTime="2026-06-01 20:34:20.486421079 +0000 UTC m=+8.734720364" Jun 01 20:34:20.497895 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.497858 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-mgc8h" podStartSLOduration=2.024338578 podStartE2EDuration="8.497849552s" podCreationTimestamp="2026-06-01 20:34:12 +0000 UTC" firstStartedPulling="2026-06-01 20:34:13.50027857 +0000 UTC m=+1.748577834" lastFinishedPulling="2026-06-01 20:34:19.973789537 +0000 UTC m=+8.222088808" observedRunningTime="2026-06-01 20:34:20.49743793 +0000 UTC m=+8.745737207" watchObservedRunningTime="2026-06-01 20:34:20.497849552 +0000 UTC m=+8.746148837" Jun 01 20:34:20.510778 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.509198 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hr6hz" podStartSLOduration=2.048524976 podStartE2EDuration="8.509176302s" podCreationTimestamp="2026-06-01 20:34:12 +0000 UTC" firstStartedPulling="2026-06-01 20:34:13.513130758 +0000 UTC m=+1.761430021" lastFinishedPulling="2026-06-01 20:34:19.973782084 +0000 UTC m=+8.222081347" observedRunningTime="2026-06-01 20:34:20.508713314 +0000 UTC m=+8.757012602" watchObservedRunningTime="2026-06-01 20:34:20.509176302 +0000 UTC m=+8.757475589" Jun 01 20:34:20.800435 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.800361 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:20.801171 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.801149 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:20.937488 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:20.937447 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:20.937659 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:20.937586 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:20.937719 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:20.937680 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs podName:81a6c9fa-0e20-455d-b262-0711156022fe nodeName:}" failed. No retries permitted until 2026-06-01 20:34:28.93766085 +0000 UTC m=+17.185960118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs") pod "network-metrics-daemon-2kqdx" (UID: "81a6c9fa-0e20-455d-b262-0711156022fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:21.038254 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.038222 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl8xn\" (UniqueName: \"kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn\") pod \"network-check-target-8qpcz\" (UID: \"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34\") " pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:21.038434 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:21.038385 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 01 20:34:21.038434 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:21.038407 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 01 20:34:21.038535 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:21.038445 2561 projected.go:194] Error preparing data for projected volume kube-api-access-gl8xn for pod openshift-network-diagnostics/network-check-target-8qpcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:21.038535 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:21.038512 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn podName:4cfc53fd-18ac-4afd-861f-c5b7d8b25f34 nodeName:}" failed. No retries permitted until 2026-06-01 20:34:29.0384922 +0000 UTC m=+17.286791479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gl8xn" (UniqueName: "kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn") pod "network-check-target-8qpcz" (UID: "4cfc53fd-18ac-4afd-861f-c5b7d8b25f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:21.238860 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.238834 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 01 20:34:21.245680 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.245586 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-01T20:34:21.238856532Z","UUID":"2900077c-8452-469b-92d2-3d1fa7d7f427","Handler":null,"Name":"","Endpoint":""} Jun 01 20:34:21.247291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.247272 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 01 20:34:21.247369 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.247296 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 01 20:34:21.273078 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.273056 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:21.273188 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.273102 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:21.273188 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:21.273180 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:21.273312 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:21.273286 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:21.444881 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.444793 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" event={"ID":"49745c6fbb96d179e264f3116dbcca39","Type":"ContainerStarted","Data":"31567a9d005457e5f83b63d14bd08ce2abfcb906545b91275ce687df4f2321df"} Jun 01 20:34:21.446320 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.446297 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" event={"ID":"b07a44f6-d443-4ce3-9488-e738143afd9f","Type":"ContainerStarted","Data":"70d415c10ae8e2ae67243528e68534d37441563bb2fc6d10b99e764d8c7a0ca3"} Jun 01 20:34:21.447490 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.447462 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g7d5r" event={"ID":"2ccab492-b3ed-4295-a2d7-e0a1d9e8c60e","Type":"ContainerStarted","Data":"de8f9102b81e74c89cbd1e790c4e0bfd2c0bed28a8c69f54761acd8402e106e0"} Jun 01 20:34:21.448687 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.448665 2561 generic.go:358] "Generic (PLEG): container finished" podID="f8d3811c-ea66-48f0-8b87-a427561261d5" containerID="e4cf3cd389c9c0ccf9e47db4228c1ace135298fcabd9580e0456d800db2cae8b" exitCode=0 Jun 01 20:34:21.448779 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.448761 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" event={"ID":"f8d3811c-ea66-48f0-8b87-a427561261d5","Type":"ContainerDied","Data":"e4cf3cd389c9c0ccf9e47db4228c1ace135298fcabd9580e0456d800db2cae8b"} Jun 01 20:34:21.456975 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.456944 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-139.ec2.internal" podStartSLOduration=8.456932893 podStartE2EDuration="8.456932893s" podCreationTimestamp="2026-06-01 20:34:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 20:34:21.456750985 +0000 UTC m=+9.705050271" watchObservedRunningTime="2026-06-01 20:34:21.456932893 +0000 UTC m=+9.705232179" Jun 01 20:34:21.486301 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:21.486265 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g7d5r" podStartSLOduration=3.054475276 podStartE2EDuration="9.48625199s" podCreationTimestamp="2026-06-01 20:34:12 +0000 UTC" firstStartedPulling="2026-06-01 20:34:13.548741838 +0000 UTC m=+1.797041105" lastFinishedPulling="2026-06-01 20:34:19.980518555 +0000 UTC m=+8.228817819" observedRunningTime="2026-06-01 20:34:21.48617646 +0000 UTC m=+9.734475746" watchObservedRunningTime="2026-06-01 20:34:21.48625199 +0000 UTC m=+9.734551277" Jun 01 20:34:22.452271 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:22.452166 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" event={"ID":"b07a44f6-d443-4ce3-9488-e738143afd9f","Type":"ContainerStarted","Data":"9daef28ae1271d4a5d23aad3310cd38ea56764c4809355095bd8a9111c624ba4"} Jun 01 20:34:22.452271 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:22.452213 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 01 20:34:22.467427 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:22.467375 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fc5hv" podStartSLOduration=1.939966596 podStartE2EDuration="10.467359191s" podCreationTimestamp="2026-06-01 20:34:12 +0000 UTC" firstStartedPulling="2026-06-01 20:34:13.599586899 +0000 UTC m=+1.847886163" lastFinishedPulling="2026-06-01 20:34:22.126979479 +0000 UTC m=+10.375278758" observedRunningTime="2026-06-01 20:34:22.466856691 +0000 UTC m=+10.715155978" watchObservedRunningTime="2026-06-01 20:34:22.467359191 +0000 UTC m=+10.715658478" Jun 01 20:34:23.272719 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:23.272686 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:23.272910 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:23.272699 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:23.272910 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:23.272790 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:23.272910 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:23.272884 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:25.273588 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:25.273397 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:25.274238 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:25.273397 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:25.274238 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:25.273710 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:25.274238 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:25.273789 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:26.459933 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:26.459900 2561 generic.go:358] "Generic (PLEG): container finished" podID="f8d3811c-ea66-48f0-8b87-a427561261d5" containerID="a8dd95e6c0449a3b8318a081dfc608075ac30b6055446429cf6eec547d8de3f4" exitCode=0 Jun 01 20:34:26.460307 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:26.459951 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" event={"ID":"f8d3811c-ea66-48f0-8b87-a427561261d5","Type":"ContainerDied","Data":"a8dd95e6c0449a3b8318a081dfc608075ac30b6055446429cf6eec547d8de3f4"} Jun 01 20:34:27.272726 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:27.272688 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:27.272893 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:27.272688 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:27.272893 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:27.272831 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:27.272893 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:27.272867 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:27.463674 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:27.463638 2561 generic.go:358] "Generic (PLEG): container finished" podID="f8d3811c-ea66-48f0-8b87-a427561261d5" containerID="77f8568d06b156b541349df0384742bd05e368fb0189817c6c38cc01b080d345" exitCode=0 Jun 01 20:34:27.463674 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:27.463654 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" event={"ID":"f8d3811c-ea66-48f0-8b87-a427561261d5","Type":"ContainerDied","Data":"77f8568d06b156b541349df0384742bd05e368fb0189817c6c38cc01b080d345"} Jun 01 20:34:28.992447 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:28.992361 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:28.992821 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:28.992479 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:28.992821 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:28.992534 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs podName:81a6c9fa-0e20-455d-b262-0711156022fe nodeName:}" failed. No retries permitted until 2026-06-01 20:34:44.992519599 +0000 UTC m=+33.240818863 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs") pod "network-metrics-daemon-2kqdx" (UID: "81a6c9fa-0e20-455d-b262-0711156022fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:29.093089 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:29.093058 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl8xn\" (UniqueName: \"kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn\") pod \"network-check-target-8qpcz\" (UID: \"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34\") " pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:29.093228 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:29.093181 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 01 20:34:29.093228 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:29.093194 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 01 20:34:29.093228 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:29.093203 2561 projected.go:194] Error preparing data for projected volume kube-api-access-gl8xn for pod openshift-network-diagnostics/network-check-target-8qpcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:29.093338 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:29.093250 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn podName:4cfc53fd-18ac-4afd-861f-c5b7d8b25f34 nodeName:}" failed. No retries permitted until 2026-06-01 20:34:45.093236822 +0000 UTC m=+33.341536086 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gl8xn" (UniqueName: "kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn") pod "network-check-target-8qpcz" (UID: "4cfc53fd-18ac-4afd-861f-c5b7d8b25f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:29.273323 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:29.273249 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:29.273471 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:29.273249 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:29.273471 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:29.273360 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:29.273471 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:29.273418 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:29.469195 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:29.469166 2561 generic.go:358] "Generic (PLEG): container finished" podID="f8d3811c-ea66-48f0-8b87-a427561261d5" containerID="bc783d30ac4cd8684b9c6727953a86b645192a2235c3c29611a89c29bc46123a" exitCode=0 Jun 01 20:34:29.469195 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:29.469206 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" event={"ID":"f8d3811c-ea66-48f0-8b87-a427561261d5","Type":"ContainerDied","Data":"bc783d30ac4cd8684b9c6727953a86b645192a2235c3c29611a89c29bc46123a"} Jun 01 20:34:31.272505 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:31.272471 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:31.272944 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:31.272469 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:31.272944 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:31.272637 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:31.272944 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:31.272697 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:33.273151 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:33.273114 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:33.273714 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:33.273240 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:33.273714 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:33.273114 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:33.273714 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:33.273574 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:35.272778 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:35.272751 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:35.273194 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:35.272793 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:35.273194 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:35.272895 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:35.273194 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:35.273030 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:36.484128 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:36.484083 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7n92j" event={"ID":"b934ded8-2018-40fd-899b-d1b5fb08434d","Type":"ContainerStarted","Data":"46c86724b29f4106e2ac855263c83fafb6e9d2c9c8b93aada7ade761082553be"} Jun 01 20:34:36.498347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:36.498297 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7n92j" podStartSLOduration=2.408682049 podStartE2EDuration="24.498283396s" podCreationTimestamp="2026-06-01 20:34:12 +0000 UTC" firstStartedPulling="2026-06-01 20:34:13.608289549 +0000 UTC m=+1.856588813" lastFinishedPulling="2026-06-01 20:34:35.697890893 +0000 UTC m=+23.946190160" observedRunningTime="2026-06-01 20:34:36.497950733 +0000 UTC m=+24.746250019" watchObservedRunningTime="2026-06-01 20:34:36.498283396 +0000 UTC m=+24.746582681" Jun 01 20:34:37.272899 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:37.272866 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:37.273090 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:37.272869 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:37.273090 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:37.272990 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:37.273090 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:37.273054 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:39.272775 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:39.272740 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:39.273161 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:39.272750 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:39.273161 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:39.272846 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:39.273161 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:39.272933 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:41.137101 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:41.137044 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:41.137808 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:41.137238 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 01 20:34:41.137890 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:41.137871 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jskqr" Jun 01 20:34:41.272956 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:41.272921 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:41.273120 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:41.273042 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:41.273120 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:41.273088 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:41.273204 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:41.273171 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:43.273228 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:43.273192 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:43.273715 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:43.273331 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:43.273715 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:43.273379 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:43.273715 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:43.273549 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:45.015988 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:45.015951 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:45.016520 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:45.016081 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:45.016520 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:45.016144 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs podName:81a6c9fa-0e20-455d-b262-0711156022fe nodeName:}" failed. No retries permitted until 2026-06-01 20:35:17.016125851 +0000 UTC m=+65.264425119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs") pod "network-metrics-daemon-2kqdx" (UID: "81a6c9fa-0e20-455d-b262-0711156022fe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 01 20:34:45.116395 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:45.116358 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl8xn\" (UniqueName: \"kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn\") pod \"network-check-target-8qpcz\" (UID: \"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34\") " pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:45.116576 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:45.116533 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 01 20:34:45.116576 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:45.116553 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 01 20:34:45.116706 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:45.116582 2561 projected.go:194] Error preparing data for projected volume kube-api-access-gl8xn for pod openshift-network-diagnostics/network-check-target-8qpcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:45.116706 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:45.116661 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn podName:4cfc53fd-18ac-4afd-861f-c5b7d8b25f34 nodeName:}" failed. No retries permitted until 2026-06-01 20:35:17.116640355 +0000 UTC m=+65.364939645 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gl8xn" (UniqueName: "kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn") pod "network-check-target-8qpcz" (UID: "4cfc53fd-18ac-4afd-861f-c5b7d8b25f34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 01 20:34:45.273508 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:45.273425 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:45.273684 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:45.273425 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:45.273684 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:45.273564 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:45.273684 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:45.273675 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:47.272990 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:47.272957 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:47.273455 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:47.272957 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:47.273455 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:47.273087 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:47.273455 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:47.273160 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:49.272687 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:49.272459 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:49.273362 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:49.272459 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:49.273362 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:49.272796 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:49.273362 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:49.272875 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:49.511406 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:49.511176 2561 generic.go:358] "Generic (PLEG): container finished" podID="f8d3811c-ea66-48f0-8b87-a427561261d5" containerID="c4be155ce8d0378bfa50a6944b43dcd999dd20d9b5691f5e544b0394711f001c" exitCode=0 Jun 01 20:34:49.511406 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:49.511270 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" event={"ID":"f8d3811c-ea66-48f0-8b87-a427561261d5","Type":"ContainerDied","Data":"c4be155ce8d0378bfa50a6944b43dcd999dd20d9b5691f5e544b0394711f001c"} Jun 01 20:34:49.513916 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:49.513892 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" event={"ID":"f4f44b26-668e-4e5f-bfd7-2c395bb88778","Type":"ContainerStarted","Data":"0be5b9364e40a0b73963e5356a316fb95ce660a5c7de30587d039e70d3a6f913"} Jun 01 20:34:49.513916 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:49.513920 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" event={"ID":"f4f44b26-668e-4e5f-bfd7-2c395bb88778","Type":"ContainerStarted","Data":"7ec356d720bf0d83008726ed10a1a0880c01d482ad56e50eee703f41ec883612"} Jun 01 20:34:49.514074 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:49.513929 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" event={"ID":"f4f44b26-668e-4e5f-bfd7-2c395bb88778","Type":"ContainerStarted","Data":"a8b192ea9cdd4129c188c5e3b12cd218cc2a89b318b412edda2ff12bec9ccdf7"} Jun 01 20:34:49.514074 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:49.513939 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" event={"ID":"f4f44b26-668e-4e5f-bfd7-2c395bb88778","Type":"ContainerStarted","Data":"eee9e8d12f64d5afc64b6b2c166fe559ddad955ef380ecab37875ae1795bc669"} Jun 01 20:34:49.514074 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:49.513951 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" event={"ID":"f4f44b26-668e-4e5f-bfd7-2c395bb88778","Type":"ContainerStarted","Data":"0c09a5bab562b897f797d32c591675198b5d74bbea99647a56149c7e142c78d2"} Jun 01 20:34:49.514074 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:49.513964 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" event={"ID":"f4f44b26-668e-4e5f-bfd7-2c395bb88778","Type":"ContainerStarted","Data":"9f70d8dd691abee54014b49582806329cd5b7e6a5fa2506c651cfcde9c84dae6"} Jun 01 20:34:50.517854 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:50.517821 2561 generic.go:358] "Generic (PLEG): container finished" podID="f8d3811c-ea66-48f0-8b87-a427561261d5" containerID="ff3d2b717d3a62c97e294cbcdfb26abf90a6742016eebc4c47ceca87e7aa6124" exitCode=0 Jun 01 20:34:50.518333 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:50.517888 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" event={"ID":"f8d3811c-ea66-48f0-8b87-a427561261d5","Type":"ContainerDied","Data":"ff3d2b717d3a62c97e294cbcdfb26abf90a6742016eebc4c47ceca87e7aa6124"} Jun 01 20:34:51.272668 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:51.272604 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:51.272863 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:51.272672 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:51.272863 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:51.272757 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:51.272988 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:51.272914 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:53.272677 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:53.272636 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:53.273098 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:53.272636 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:53.273098 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:53.272761 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:53.273098 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:53.272884 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:54.527234 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:54.527155 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f2zl5" event={"ID":"5ec81339-bebd-4521-bea1-f04abfbde340","Type":"ContainerStarted","Data":"b829ee6c8fcce2c4423da07f8bb9cdf4815f38cacb87b881b4327f209bbe353f"} Jun 01 20:34:54.532535 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:54.530694 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" event={"ID":"f8d3811c-ea66-48f0-8b87-a427561261d5","Type":"ContainerStarted","Data":"85b64961d2e6a795c5c63f542b1d0cd0e696f1aae8a79b2aad8b64e4b1a3e3e7"} Jun 01 20:34:54.534820 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:54.534789 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" event={"ID":"f4f44b26-668e-4e5f-bfd7-2c395bb88778","Type":"ContainerStarted","Data":"453b3440958a8fcc36f7447944ec9b2437fa2a1738df4077502f05860913e42a"} Jun 01 20:34:54.545184 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:54.545139 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-f2zl5" podStartSLOduration=2.107617564 podStartE2EDuration="42.545128944s" podCreationTimestamp="2026-06-01 20:34:12 +0000 UTC" firstStartedPulling="2026-06-01 20:34:13.544479604 +0000 UTC m=+1.792778868" lastFinishedPulling="2026-06-01 20:34:53.981990973 +0000 UTC m=+42.230290248" observedRunningTime="2026-06-01 20:34:54.544937659 +0000 UTC m=+42.793236944" watchObservedRunningTime="2026-06-01 20:34:54.545128944 +0000 UTC m=+42.793428230" Jun 01 20:34:54.562055 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:54.562006 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lcxjj" podStartSLOduration=2.129044635 podStartE2EDuration="42.561993715s" podCreationTimestamp="2026-06-01 20:34:12 +0000 UTC" firstStartedPulling="2026-06-01 20:34:13.531047379 +0000 UTC m=+1.779346642" lastFinishedPulling="2026-06-01 20:34:53.963996454 +0000 UTC m=+42.212295722" observedRunningTime="2026-06-01 20:34:54.561445048 +0000 UTC m=+42.809744334" watchObservedRunningTime="2026-06-01 20:34:54.561993715 +0000 UTC m=+42.810293000" Jun 01 20:34:55.273291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:55.273258 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:55.273291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:55.273278 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:55.273655 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:55.273407 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:55.273655 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:55.273483 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:56.541128 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:56.540933 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" event={"ID":"f4f44b26-668e-4e5f-bfd7-2c395bb88778","Type":"ContainerStarted","Data":"a39cc3b191bc566c027403144b0a8b6d058c858ab65dd4d426121dc2cf7d91a3"} Jun 01 20:34:56.541575 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:56.541243 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:56.541575 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:56.541275 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:56.556979 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:56.556950 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:56.566162 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:56.565040 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" podStartSLOduration=9.12019744 podStartE2EDuration="44.565022221s" podCreationTimestamp="2026-06-01 20:34:12 +0000 UTC" firstStartedPulling="2026-06-01 20:34:13.566911382 +0000 UTC m=+1.815210649" lastFinishedPulling="2026-06-01 20:34:49.011736146 +0000 UTC m=+37.260035430" observedRunningTime="2026-06-01 20:34:56.563607962 +0000 UTC m=+44.811907250" watchObservedRunningTime="2026-06-01 20:34:56.565022221 +0000 UTC m=+44.813321509" Jun 01 20:34:57.272860 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:57.272825 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:57.273104 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:57.273069 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:57.273368 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:57.273347 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:57.273475 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:57.273177 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:57.543280 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:57.543202 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:57.557000 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:57.556977 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:34:57.955123 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:57.955022 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8qpcz"] Jun 01 20:34:57.955291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:57.955141 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:57.955291 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:57.955250 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:57.957670 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:57.957643 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2kqdx"] Jun 01 20:34:57.957789 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:57.957747 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:57.957884 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:57.957856 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:34:59.272891 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:59.272852 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:34:59.273587 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:34:59.272853 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:34:59.273587 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:59.273002 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:34:59.273587 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:34:59.273040 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:35:01.272691 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:01.272662 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:35:01.272691 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:01.272674 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:35:01.273080 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:01.272762 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:35:01.273080 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:01.272870 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qpcz" podUID="4cfc53fd-18ac-4afd-861f-c5b7d8b25f34" Jun 01 20:35:02.582853 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.582816 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-139.ec2.internal" event="NodeReady" Jun 01 20:35:02.583463 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.582973 2561 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 01 20:35:02.624146 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.624067 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vjnlg"] Jun 01 20:35:02.711187 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.711145 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xk4vw"] Jun 01 20:35:02.711349 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.711306 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.713181 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.713158 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 01 20:35:02.713345 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.713200 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 01 20:35:02.713345 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.713282 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rq65\"" Jun 01 20:35:02.727181 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.727073 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vjnlg"] Jun 01 20:35:02.727181 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.727101 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xk4vw"] Jun 01 20:35:02.727354 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.727207 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:02.728997 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.728977 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 01 20:35:02.729121 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.729105 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rzs9n\"" Jun 01 20:35:02.729240 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.729224 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 01 20:35:02.729345 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.729329 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 01 20:35:02.843046 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.843011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.843216 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.843085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:02.843216 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.843120 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltvc\" (UniqueName: \"kubernetes.io/projected/e2c491b3-caaf-4355-abbb-f8767dc02bbc-kube-api-access-8ltvc\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:02.843216 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.843140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62c63df5-42a6-417b-a170-cab4a4e85c2a-config-volume\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.843216 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.843165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62c63df5-42a6-417b-a170-cab4a4e85c2a-tmp-dir\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.843216 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.843188 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slrd6\" (UniqueName: \"kubernetes.io/projected/62c63df5-42a6-417b-a170-cab4a4e85c2a-kube-api-access-slrd6\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.943968 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.943879 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62c63df5-42a6-417b-a170-cab4a4e85c2a-tmp-dir\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.943968 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.943911 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-slrd6\" (UniqueName: \"kubernetes.io/projected/62c63df5-42a6-417b-a170-cab4a4e85c2a-kube-api-access-slrd6\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.943968 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.943936 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.944291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.943978 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:02.944291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.944003 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltvc\" (UniqueName: \"kubernetes.io/projected/e2c491b3-caaf-4355-abbb-f8767dc02bbc-kube-api-access-8ltvc\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:02.944291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.944021 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62c63df5-42a6-417b-a170-cab4a4e85c2a-config-volume\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.944291 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:02.944116 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 01 20:35:02.944291 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:02.944182 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls podName:62c63df5-42a6-417b-a170-cab4a4e85c2a nodeName:}" failed. No retries permitted until 2026-06-01 20:35:03.444161913 +0000 UTC m=+51.692461192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls") pod "dns-default-vjnlg" (UID: "62c63df5-42a6-417b-a170-cab4a4e85c2a") : secret "dns-default-metrics-tls" not found Jun 01 20:35:02.944291 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:02.944207 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 01 20:35:02.944291 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:02.944258 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert podName:e2c491b3-caaf-4355-abbb-f8767dc02bbc nodeName:}" failed. No retries permitted until 2026-06-01 20:35:03.444242008 +0000 UTC m=+51.692541275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert") pod "ingress-canary-xk4vw" (UID: "e2c491b3-caaf-4355-abbb-f8767dc02bbc") : secret "canary-serving-cert" not found Jun 01 20:35:02.944550 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.944343 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62c63df5-42a6-417b-a170-cab4a4e85c2a-tmp-dir\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.944600 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.944582 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/62c63df5-42a6-417b-a170-cab4a4e85c2a-config-volume\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.955088 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.955066 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slrd6\" (UniqueName: \"kubernetes.io/projected/62c63df5-42a6-417b-a170-cab4a4e85c2a-kube-api-access-slrd6\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:02.955232 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:02.955214 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltvc\" (UniqueName: \"kubernetes.io/projected/e2c491b3-caaf-4355-abbb-f8767dc02bbc-kube-api-access-8ltvc\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:03.272650 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:03.272604 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:35:03.272819 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:03.272654 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:35:03.274863 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:03.274843 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 01 20:35:03.275312 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:03.275295 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 01 20:35:03.275428 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:03.275411 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gkzmp\"" Jun 01 20:35:03.275478 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:03.275468 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 01 20:35:03.275529 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:03.275501 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tjj44\"" Jun 01 20:35:03.447871 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:03.447836 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:03.448056 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:03.447903 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:03.448056 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:03.448001 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 01 20:35:03.448130 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:03.448067 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert podName:e2c491b3-caaf-4355-abbb-f8767dc02bbc nodeName:}" failed. No retries permitted until 2026-06-01 20:35:04.448051513 +0000 UTC m=+52.696350776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert") pod "ingress-canary-xk4vw" (UID: "e2c491b3-caaf-4355-abbb-f8767dc02bbc") : secret "canary-serving-cert" not found Jun 01 20:35:03.448130 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:03.448003 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 01 20:35:03.448202 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:03.448130 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls podName:62c63df5-42a6-417b-a170-cab4a4e85c2a nodeName:}" failed. No retries permitted until 2026-06-01 20:35:04.448118172 +0000 UTC m=+52.696417436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls") pod "dns-default-vjnlg" (UID: "62c63df5-42a6-417b-a170-cab4a4e85c2a") : secret "dns-default-metrics-tls" not found Jun 01 20:35:04.455302 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:04.455261 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:04.455705 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:04.455329 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:04.455705 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:04.455390 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 01 20:35:04.455705 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:04.455426 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 01 20:35:04.455705 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:04.455454 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert podName:e2c491b3-caaf-4355-abbb-f8767dc02bbc nodeName:}" failed. No retries permitted until 2026-06-01 20:35:06.455438176 +0000 UTC m=+54.703737440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert") pod "ingress-canary-xk4vw" (UID: "e2c491b3-caaf-4355-abbb-f8767dc02bbc") : secret "canary-serving-cert" not found Jun 01 20:35:04.455705 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:04.455467 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls podName:62c63df5-42a6-417b-a170-cab4a4e85c2a nodeName:}" failed. No retries permitted until 2026-06-01 20:35:06.455461923 +0000 UTC m=+54.703761187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls") pod "dns-default-vjnlg" (UID: "62c63df5-42a6-417b-a170-cab4a4e85c2a") : secret "dns-default-metrics-tls" not found Jun 01 20:35:06.465990 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:06.465769 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:06.466352 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:06.466034 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:06.466352 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:06.465913 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 01 20:35:06.466352 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:06.466118 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert podName:e2c491b3-caaf-4355-abbb-f8767dc02bbc nodeName:}" failed. No retries permitted until 2026-06-01 20:35:10.466097261 +0000 UTC m=+58.714396546 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert") pod "ingress-canary-xk4vw" (UID: "e2c491b3-caaf-4355-abbb-f8767dc02bbc") : secret "canary-serving-cert" not found Jun 01 20:35:06.466352 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:06.466147 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 01 20:35:06.466352 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:06.466178 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls podName:62c63df5-42a6-417b-a170-cab4a4e85c2a nodeName:}" failed. No retries permitted until 2026-06-01 20:35:10.466168168 +0000 UTC m=+58.714467448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls") pod "dns-default-vjnlg" (UID: "62c63df5-42a6-417b-a170-cab4a4e85c2a") : secret "dns-default-metrics-tls" not found Jun 01 20:35:10.491894 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:10.491857 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:10.492317 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:10.491916 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:10.492317 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:10.491999 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 01 20:35:10.492317 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:10.492016 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 01 20:35:10.492317 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:10.492066 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert podName:e2c491b3-caaf-4355-abbb-f8767dc02bbc nodeName:}" failed. No retries permitted until 2026-06-01 20:35:18.49205196 +0000 UTC m=+66.740351224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert") pod "ingress-canary-xk4vw" (UID: "e2c491b3-caaf-4355-abbb-f8767dc02bbc") : secret "canary-serving-cert" not found Jun 01 20:35:10.492317 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:10.492078 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls podName:62c63df5-42a6-417b-a170-cab4a4e85c2a nodeName:}" failed. No retries permitted until 2026-06-01 20:35:18.492071952 +0000 UTC m=+66.740371216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls") pod "dns-default-vjnlg" (UID: "62c63df5-42a6-417b-a170-cab4a4e85c2a") : secret "dns-default-metrics-tls" not found Jun 01 20:35:17.038733 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:17.038691 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:35:17.040529 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:17.040504 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 01 20:35:17.049047 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:17.049027 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 01 20:35:17.049131 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:17.049096 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs podName:81a6c9fa-0e20-455d-b262-0711156022fe nodeName:}" failed. No retries permitted until 2026-06-01 20:36:21.049074089 +0000 UTC m=+129.297373370 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs") pod "network-metrics-daemon-2kqdx" (UID: "81a6c9fa-0e20-455d-b262-0711156022fe") : secret "metrics-daemon-secret" not found Jun 01 20:35:17.139142 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:17.139110 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl8xn\" (UniqueName: \"kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn\") pod \"network-check-target-8qpcz\" (UID: \"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34\") " pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:35:17.141700 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:17.141680 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 01 20:35:17.152040 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:17.152018 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 01 20:35:17.163131 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:17.163108 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl8xn\" (UniqueName: \"kubernetes.io/projected/4cfc53fd-18ac-4afd-861f-c5b7d8b25f34-kube-api-access-gl8xn\") pod \"network-check-target-8qpcz\" (UID: \"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34\") " pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:35:17.384424 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:17.384341 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tjj44\"" Jun 01 20:35:17.392833 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:17.392810 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:35:17.548927 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:17.548894 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8qpcz"] Jun 01 20:35:17.578734 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:17.578701 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8qpcz" event={"ID":"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34","Type":"ContainerStarted","Data":"f5e1805e96c58e6570fb8f98d2ac0fcfd54229a58ce16991b87f22c399165b1e"} Jun 01 20:35:18.549230 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:18.549187 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:18.549747 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:18.549331 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 01 20:35:18.549747 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:18.549393 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:18.549747 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:18.549400 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert podName:e2c491b3-caaf-4355-abbb-f8767dc02bbc nodeName:}" failed. No retries permitted until 2026-06-01 20:35:34.549381338 +0000 UTC m=+82.797680621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert") pod "ingress-canary-xk4vw" (UID: "e2c491b3-caaf-4355-abbb-f8767dc02bbc") : secret "canary-serving-cert" not found Jun 01 20:35:18.549747 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:18.549579 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 01 20:35:18.549747 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:18.549658 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls podName:62c63df5-42a6-417b-a170-cab4a4e85c2a nodeName:}" failed. No retries permitted until 2026-06-01 20:35:34.549639854 +0000 UTC m=+82.797939127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls") pod "dns-default-vjnlg" (UID: "62c63df5-42a6-417b-a170-cab4a4e85c2a") : secret "dns-default-metrics-tls" not found Jun 01 20:35:21.587516 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:21.587478 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8qpcz" event={"ID":"4cfc53fd-18ac-4afd-861f-c5b7d8b25f34","Type":"ContainerStarted","Data":"e1d330a30bf7639af51efd4a792123869e19a961887e2ced3c3829d35b48ce8f"} Jun 01 20:35:21.588018 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:21.587598 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:35:29.556271 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:29.556158 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5zgnz" Jun 01 20:35:29.580336 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:29.580276 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8qpcz" podStartSLOduration=74.378362293 podStartE2EDuration="1m17.580249905s" podCreationTimestamp="2026-06-01 20:34:12 +0000 UTC" firstStartedPulling="2026-06-01 20:35:17.55575257 +0000 UTC m=+65.804051833" lastFinishedPulling="2026-06-01 20:35:20.757640177 +0000 UTC m=+69.005939445" observedRunningTime="2026-06-01 20:35:21.600559232 +0000 UTC m=+69.848858519" watchObservedRunningTime="2026-06-01 20:35:29.580249905 +0000 UTC m=+77.828549192" Jun 01 20:35:34.563120 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:34.563057 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:35:34.563589 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:34.563144 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:35:34.563589 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:34.563210 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 01 20:35:34.563589 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:34.563257 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 01 20:35:34.563589 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:34.563281 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls podName:62c63df5-42a6-417b-a170-cab4a4e85c2a nodeName:}" failed. No retries permitted until 2026-06-01 20:36:06.563261685 +0000 UTC m=+114.811560949 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls") pod "dns-default-vjnlg" (UID: "62c63df5-42a6-417b-a170-cab4a4e85c2a") : secret "dns-default-metrics-tls" not found Jun 01 20:35:34.563589 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:35:34.563323 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert podName:e2c491b3-caaf-4355-abbb-f8767dc02bbc nodeName:}" failed. No retries permitted until 2026-06-01 20:36:06.563307311 +0000 UTC m=+114.811606575 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert") pod "ingress-canary-xk4vw" (UID: "e2c491b3-caaf-4355-abbb-f8767dc02bbc") : secret "canary-serving-cert" not found Jun 01 20:35:52.591675 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:35:52.591642 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8qpcz" Jun 01 20:36:06.578255 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:06.578218 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:36:06.578668 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:06.578270 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:36:06.578668 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:06.578374 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 01 20:36:06.578668 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:06.578424 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 01 20:36:06.578668 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:06.578451 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls podName:62c63df5-42a6-417b-a170-cab4a4e85c2a nodeName:}" failed. No retries permitted until 2026-06-01 20:37:10.578434223 +0000 UTC m=+178.826733487 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls") pod "dns-default-vjnlg" (UID: "62c63df5-42a6-417b-a170-cab4a4e85c2a") : secret "dns-default-metrics-tls" not found Jun 01 20:36:06.578668 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:06.578474 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert podName:e2c491b3-caaf-4355-abbb-f8767dc02bbc nodeName:}" failed. No retries permitted until 2026-06-01 20:37:10.578458957 +0000 UTC m=+178.826758228 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert") pod "ingress-canary-xk4vw" (UID: "e2c491b3-caaf-4355-abbb-f8767dc02bbc") : secret "canary-serving-cert" not found Jun 01 20:36:12.774581 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.774546 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-jvpcq"] Jun 01 20:36:12.777302 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.777286 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-jvpcq" Jun 01 20:36:12.779000 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.778982 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 01 20:36:12.779490 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.779468 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jg8zz\"" Jun 01 20:36:12.779566 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.779507 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 01 20:36:12.783353 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.783334 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-jvpcq"] Jun 01 20:36:12.786258 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.786239 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2"] Jun 01 20:36:12.787805 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.787789 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-sxx5t"] Jun 01 20:36:12.787941 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.787924 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:12.789408 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.789386 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:12.789880 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.789859 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 01 20:36:12.789980 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.789948 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 01 20:36:12.790211 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.789884 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 01 20:36:12.790211 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.789891 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bx2b6\"" Jun 01 20:36:12.790897 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.790878 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 01 20:36:12.791290 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.791274 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 01 20:36:12.791424 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.791330 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 01 20:36:12.791493 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.791363 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 01 20:36:12.791897 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.791758 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-p7h7m\"" Jun 01 20:36:12.795989 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.795869 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2"] Jun 01 20:36:12.797313 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.797295 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 01 20:36:12.799025 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.799008 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-sxx5t"] Jun 01 20:36:12.876456 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.876421 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2"] Jun 01 20:36:12.878390 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.878368 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:12.880252 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.880230 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-667hs\"" Jun 01 20:36:12.880336 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.880255 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 01 20:36:12.880336 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.880255 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 01 20:36:12.882716 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.882695 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz"] Jun 01 20:36:12.884335 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.884319 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-clz2x"] Jun 01 20:36:12.884479 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.884461 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:12.885974 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.885956 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7544b464c-n2ttg"] Jun 01 20:36:12.886124 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.886108 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" Jun 01 20:36:12.886549 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.886517 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 01 20:36:12.886942 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.886910 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 01 20:36:12.887078 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.887008 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q5cmg\"" Jun 01 20:36:12.887160 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.887076 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 01 20:36:12.887532 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.887515 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 01 20:36:12.887902 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.887884 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:12.887902 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.887898 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2"] Jun 01 20:36:12.888517 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.888493 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 01 20:36:12.890194 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.890164 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 01 20:36:12.890194 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.890189 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gs82t\"" Jun 01 20:36:12.890394 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.890381 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 01 20:36:12.890465 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.890434 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 01 20:36:12.890465 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.890445 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 01 20:36:12.890465 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.890445 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 01 20:36:12.890617 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.890478 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r5r86\"" Jun 01 20:36:12.890617 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.890566 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 01 20:36:12.896190 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.896170 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 01 20:36:12.896564 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.896514 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz"] Jun 01 20:36:12.897267 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.897251 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-clz2x"] Jun 01 20:36:12.899682 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.899663 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7544b464c-n2ttg"] Jun 01 20:36:12.919136 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.919113 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssddk\" (UniqueName: \"kubernetes.io/projected/c3e24a84-f601-4e73-8b1a-1ac84417da87-kube-api-access-ssddk\") pod \"cluster-samples-operator-755bbf9bfb-rbqb2\" (UID: \"c3e24a84-f601-4e73-8b1a-1ac84417da87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:12.919253 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.919148 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2qkv\" (UniqueName: \"kubernetes.io/projected/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-kube-api-access-d2qkv\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:12.919253 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.919217 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rbqb2\" (UID: \"c3e24a84-f601-4e73-8b1a-1ac84417da87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:12.919375 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.919263 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6vzb\" (UniqueName: \"kubernetes.io/projected/876ed95c-1771-4ce7-8259-f0dbb6082549-kube-api-access-h6vzb\") pod \"volume-data-source-validator-7598fd5bd-jvpcq\" (UID: \"876ed95c-1771-4ce7-8259-f0dbb6082549\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-jvpcq" Jun 01 20:36:12.919375 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.919312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-trusted-ca\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:12.919375 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.919360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-config\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:12.919495 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.919422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-serving-cert\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:12.982193 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.982168 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp"] Jun 01 20:36:12.984260 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.984247 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" Jun 01 20:36:12.986234 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.986213 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-n77j7\"" Jun 01 20:36:12.986350 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.986248 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 01 20:36:12.986350 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.986261 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 01 20:36:12.986350 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.986286 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 01 20:36:12.986350 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.986249 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 01 20:36:12.991577 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:12.991555 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp"] Jun 01 20:36:13.020409 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:13.020409 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020399 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.020566 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020416 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c176036-c9e0-42c9-bdf8-23edd49632fc-ca-trust-extracted\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.020566 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020432 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-installation-pull-secrets\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.020566 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020454 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-serving-cert\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:13.020566 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b70d650-c8dc-4bd2-ba65-eaff1e51937e-serving-cert\") pod \"service-ca-operator-69877444c-clz2x\" (UID: \"2b70d650-c8dc-4bd2-ba65-eaff1e51937e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" Jun 01 20:36:13.020566 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020562 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jdct\" (UniqueName: \"kubernetes.io/projected/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-kube-api-access-7jdct\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:13.020824 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020589 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-trusted-ca\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.020824 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020692 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-certificates\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.020824 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020752 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m86nq\" (UniqueName: \"kubernetes.io/projected/2b70d650-c8dc-4bd2-ba65-eaff1e51937e-kube-api-access-m86nq\") pod \"service-ca-operator-69877444c-clz2x\" (UID: \"2b70d650-c8dc-4bd2-ba65-eaff1e51937e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" Jun 01 20:36:13.020824 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-bound-sa-token\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.021004 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020836 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssddk\" (UniqueName: \"kubernetes.io/projected/c3e24a84-f601-4e73-8b1a-1ac84417da87-kube-api-access-ssddk\") pod \"cluster-samples-operator-755bbf9bfb-rbqb2\" (UID: \"c3e24a84-f601-4e73-8b1a-1ac84417da87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:13.021004 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020887 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2qkv\" (UniqueName: \"kubernetes.io/projected/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-kube-api-access-d2qkv\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:13.021004 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b70d650-c8dc-4bd2-ba65-eaff1e51937e-config\") pod \"service-ca-operator-69877444c-clz2x\" (UID: \"2b70d650-c8dc-4bd2-ba65-eaff1e51937e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" Jun 01 20:36:13.021004 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020942 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rbqb2\" (UID: \"c3e24a84-f601-4e73-8b1a-1ac84417da87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:13.021004 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-image-registry-private-configuration\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.021004 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.020999 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rpvs\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-kube-api-access-4rpvs\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.021267 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.021063 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6vzb\" (UniqueName: \"kubernetes.io/projected/876ed95c-1771-4ce7-8259-f0dbb6082549-kube-api-access-h6vzb\") pod \"volume-data-source-validator-7598fd5bd-jvpcq\" (UID: \"876ed95c-1771-4ce7-8259-f0dbb6082549\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-jvpcq" Jun 01 20:36:13.021267 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.021081 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 01 20:36:13.021267 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.021099 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-trusted-ca\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:13.021267 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.021153 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls podName:c3e24a84-f601-4e73-8b1a-1ac84417da87 nodeName:}" failed. No retries permitted until 2026-06-01 20:36:13.521133373 +0000 UTC m=+121.769432641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rbqb2" (UID: "c3e24a84-f601-4e73-8b1a-1ac84417da87") : secret "samples-operator-tls" not found Jun 01 20:36:13.021267 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.021174 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:13.021267 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.021217 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-config\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:13.021267 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.021244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:13.021524 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.021274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61936f31-2d91-4aae-af35-98648951f7df-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:13.021798 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.021782 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-config\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:13.021895 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.021878 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-trusted-ca\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:13.022716 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.022702 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-serving-cert\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:13.028412 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.028359 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6vzb\" (UniqueName: \"kubernetes.io/projected/876ed95c-1771-4ce7-8259-f0dbb6082549-kube-api-access-h6vzb\") pod \"volume-data-source-validator-7598fd5bd-jvpcq\" (UID: \"876ed95c-1771-4ce7-8259-f0dbb6082549\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-jvpcq" Jun 01 20:36:13.028514 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.028446 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2qkv\" (UniqueName: \"kubernetes.io/projected/2560e6e6-843a-4326-b1a1-72eb4cbd5e76-kube-api-access-d2qkv\") pod \"console-operator-86d7c6cc77-sxx5t\" (UID: \"2560e6e6-843a-4326-b1a1-72eb4cbd5e76\") " pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:13.028657 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.028640 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssddk\" (UniqueName: \"kubernetes.io/projected/c3e24a84-f601-4e73-8b1a-1ac84417da87-kube-api-access-ssddk\") pod \"cluster-samples-operator-755bbf9bfb-rbqb2\" (UID: \"c3e24a84-f601-4e73-8b1a-1ac84417da87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:13.086572 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.086543 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-jvpcq" Jun 01 20:36:13.105427 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.105394 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:13.122516 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.122490 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b70d650-c8dc-4bd2-ba65-eaff1e51937e-serving-cert\") pod \"service-ca-operator-69877444c-clz2x\" (UID: \"2b70d650-c8dc-4bd2-ba65-eaff1e51937e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" Jun 01 20:36:13.122657 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.122533 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.122657 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.122567 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jdct\" (UniqueName: \"kubernetes.io/projected/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-kube-api-access-7jdct\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:13.122657 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.122590 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-trusted-ca\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.122657 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.122638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6710a661-ae89-40c4-b4c5-5ab71d659495-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-8nwjp\" (UID: \"6710a661-ae89-40c4-b4c5-5ab71d659495\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" Jun 01 20:36:13.122883 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.122671 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-certificates\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.122883 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.122683 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 01 20:36:13.122883 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.122696 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m86nq\" (UniqueName: \"kubernetes.io/projected/2b70d650-c8dc-4bd2-ba65-eaff1e51937e-kube-api-access-m86nq\") pod \"service-ca-operator-69877444c-clz2x\" (UID: \"2b70d650-c8dc-4bd2-ba65-eaff1e51937e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" Jun 01 20:36:13.122883 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.122703 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7544b464c-n2ttg: secret "image-registry-tls" not found Jun 01 20:36:13.123135 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.123114 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls podName:4c176036-c9e0-42c9-bdf8-23edd49632fc nodeName:}" failed. No retries permitted until 2026-06-01 20:36:13.623082422 +0000 UTC m=+121.871381701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls") pod "image-registry-7544b464c-n2ttg" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc") : secret "image-registry-tls" not found Jun 01 20:36:13.125082 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.124511 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-image-registry-private-configuration\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.125082 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.124538 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-trusted-ca\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.125082 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.124588 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4rpvs\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-kube-api-access-4rpvs\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.125082 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.124813 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd8f4\" (UniqueName: \"kubernetes.io/projected/6710a661-ae89-40c4-b4c5-5ab71d659495-kube-api-access-zd8f4\") pod \"kube-storage-version-migrator-operator-96ddc787c-8nwjp\" (UID: \"6710a661-ae89-40c4-b4c5-5ab71d659495\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" Jun 01 20:36:13.125082 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.124823 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-certificates\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.125082 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.125028 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:13.125420 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.125233 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.125643 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.125697 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-installation-pull-secrets\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.125739 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6710a661-ae89-40c4-b4c5-5ab71d659495-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-8nwjp\" (UID: \"6710a661-ae89-40c4-b4c5-5ab71d659495\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.125773 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert podName:61936f31-2d91-4aae-af35-98648951f7df nodeName:}" failed. No retries permitted until 2026-06-01 20:36:13.62574796 +0000 UTC m=+121.874047235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-lxnc2" (UID: "61936f31-2d91-4aae-af35-98648951f7df") : secret "networking-console-plugin-cert" not found Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.125850 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b70d650-c8dc-4bd2-ba65-eaff1e51937e-config\") pod \"service-ca-operator-69877444c-clz2x\" (UID: \"2b70d650-c8dc-4bd2-ba65-eaff1e51937e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.125867 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.125890 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c176036-c9e0-42c9-bdf8-23edd49632fc-ca-trust-extracted\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.125921 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-bound-sa-token\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.125985 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.126016 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61936f31-2d91-4aae-af35-98648951f7df-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.126813 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61936f31-2d91-4aae-af35-98648951f7df-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:13.127187 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.126818 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls podName:af9cbe11-2466-42c7-9fbd-f83c0ec673f5 nodeName:}" failed. No retries permitted until 2026-06-01 20:36:13.626788377 +0000 UTC m=+121.875087652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-q2lxz" (UID: "af9cbe11-2466-42c7-9fbd-f83c0ec673f5") : secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:13.127872 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.127376 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b70d650-c8dc-4bd2-ba65-eaff1e51937e-config\") pod \"service-ca-operator-69877444c-clz2x\" (UID: \"2b70d650-c8dc-4bd2-ba65-eaff1e51937e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" Jun 01 20:36:13.127872 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.127679 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c176036-c9e0-42c9-bdf8-23edd49632fc-ca-trust-extracted\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.129650 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.128609 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:13.130229 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.130134 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b70d650-c8dc-4bd2-ba65-eaff1e51937e-serving-cert\") pod \"service-ca-operator-69877444c-clz2x\" (UID: \"2b70d650-c8dc-4bd2-ba65-eaff1e51937e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" Jun 01 20:36:13.131084 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.131060 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-installation-pull-secrets\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.131727 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.131696 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-image-registry-private-configuration\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.134329 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.134281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m86nq\" (UniqueName: \"kubernetes.io/projected/2b70d650-c8dc-4bd2-ba65-eaff1e51937e-kube-api-access-m86nq\") pod \"service-ca-operator-69877444c-clz2x\" (UID: \"2b70d650-c8dc-4bd2-ba65-eaff1e51937e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" Jun 01 20:36:13.134678 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.134655 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jdct\" (UniqueName: \"kubernetes.io/projected/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-kube-api-access-7jdct\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:13.135603 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.135574 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rpvs\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-kube-api-access-4rpvs\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.138279 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.138258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-bound-sa-token\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.205465 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.205403 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" Jun 01 20:36:13.227545 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.227511 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6710a661-ae89-40c4-b4c5-5ab71d659495-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-8nwjp\" (UID: \"6710a661-ae89-40c4-b4c5-5ab71d659495\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" Jun 01 20:36:13.227675 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.227619 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zd8f4\" (UniqueName: \"kubernetes.io/projected/6710a661-ae89-40c4-b4c5-5ab71d659495-kube-api-access-zd8f4\") pod \"kube-storage-version-migrator-operator-96ddc787c-8nwjp\" (UID: \"6710a661-ae89-40c4-b4c5-5ab71d659495\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" Jun 01 20:36:13.227755 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.227731 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6710a661-ae89-40c4-b4c5-5ab71d659495-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-8nwjp\" (UID: \"6710a661-ae89-40c4-b4c5-5ab71d659495\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" Jun 01 20:36:13.229647 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.229583 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6710a661-ae89-40c4-b4c5-5ab71d659495-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-8nwjp\" (UID: \"6710a661-ae89-40c4-b4c5-5ab71d659495\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" Jun 01 20:36:13.230271 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.230249 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6710a661-ae89-40c4-b4c5-5ab71d659495-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-8nwjp\" (UID: \"6710a661-ae89-40c4-b4c5-5ab71d659495\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" Jun 01 20:36:13.235815 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.235790 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-jvpcq"] Jun 01 20:36:13.238885 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.238852 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd8f4\" (UniqueName: \"kubernetes.io/projected/6710a661-ae89-40c4-b4c5-5ab71d659495-kube-api-access-zd8f4\") pod \"kube-storage-version-migrator-operator-96ddc787c-8nwjp\" (UID: \"6710a661-ae89-40c4-b4c5-5ab71d659495\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" Jun 01 20:36:13.241602 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:13.241580 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876ed95c_1771_4ce7_8259_f0dbb6082549.slice/crio-d272b9c606de6c77ec26a30b8e3d38ff0c11bc62585e523b405ef224a64ba935 WatchSource:0}: Error finding container d272b9c606de6c77ec26a30b8e3d38ff0c11bc62585e523b405ef224a64ba935: Status 404 returned error can't find the container with id d272b9c606de6c77ec26a30b8e3d38ff0c11bc62585e523b405ef224a64ba935 Jun 01 20:36:13.252696 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.252658 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-sxx5t"] Jun 01 20:36:13.256265 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:13.256080 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2560e6e6_843a_4326_b1a1_72eb4cbd5e76.slice/crio-8c4022c031b35ce57f44b34ae1a153f2b82e6263f5b477b2f7170bab28cd8ce7 WatchSource:0}: Error finding container 8c4022c031b35ce57f44b34ae1a153f2b82e6263f5b477b2f7170bab28cd8ce7: Status 404 returned error can't find the container with id 8c4022c031b35ce57f44b34ae1a153f2b82e6263f5b477b2f7170bab28cd8ce7 Jun 01 20:36:13.293013 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.292984 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" Jun 01 20:36:13.330113 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.330082 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-clz2x"] Jun 01 20:36:13.333275 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:13.333243 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b70d650_c8dc_4bd2_ba65_eaff1e51937e.slice/crio-fe1c96e98a74065ccbb0e63f3211c99b4936443b1ae62a4f3d3d1de3ed8b5ee3 WatchSource:0}: Error finding container fe1c96e98a74065ccbb0e63f3211c99b4936443b1ae62a4f3d3d1de3ed8b5ee3: Status 404 returned error can't find the container with id fe1c96e98a74065ccbb0e63f3211c99b4936443b1ae62a4f3d3d1de3ed8b5ee3 Jun 01 20:36:13.408718 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.408687 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp"] Jun 01 20:36:13.411649 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:13.411604 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6710a661_ae89_40c4_b4c5_5ab71d659495.slice/crio-84f98f51b11bc17e9fb519986bab1018a97827daa60073fc48baf573a8e085ce WatchSource:0}: Error finding container 84f98f51b11bc17e9fb519986bab1018a97827daa60073fc48baf573a8e085ce: Status 404 returned error can't find the container with id 84f98f51b11bc17e9fb519986bab1018a97827daa60073fc48baf573a8e085ce Jun 01 20:36:13.530386 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.530351 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rbqb2\" (UID: \"c3e24a84-f601-4e73-8b1a-1ac84417da87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:13.530551 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.530466 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 01 20:36:13.530551 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.530518 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls podName:c3e24a84-f601-4e73-8b1a-1ac84417da87 nodeName:}" failed. No retries permitted until 2026-06-01 20:36:14.530504316 +0000 UTC m=+122.778803580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rbqb2" (UID: "c3e24a84-f601-4e73-8b1a-1ac84417da87") : secret "samples-operator-tls" not found Jun 01 20:36:13.631458 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.631364 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:13.631616 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.631461 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:13.631616 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.631496 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:13.631616 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.631519 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 01 20:36:13.631616 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.631540 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7544b464c-n2ttg: secret "image-registry-tls" not found Jun 01 20:36:13.631616 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.631593 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 01 20:36:13.631616 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.631598 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:13.631854 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.631604 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls podName:4c176036-c9e0-42c9-bdf8-23edd49632fc nodeName:}" failed. No retries permitted until 2026-06-01 20:36:14.631583184 +0000 UTC m=+122.879882464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls") pod "image-registry-7544b464c-n2ttg" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc") : secret "image-registry-tls" not found Jun 01 20:36:13.631854 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.631666 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert podName:61936f31-2d91-4aae-af35-98648951f7df nodeName:}" failed. No retries permitted until 2026-06-01 20:36:14.631654411 +0000 UTC m=+122.879953684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-lxnc2" (UID: "61936f31-2d91-4aae-af35-98648951f7df") : secret "networking-console-plugin-cert" not found Jun 01 20:36:13.631854 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:13.631683 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls podName:af9cbe11-2466-42c7-9fbd-f83c0ec673f5 nodeName:}" failed. No retries permitted until 2026-06-01 20:36:14.631674318 +0000 UTC m=+122.879973613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-q2lxz" (UID: "af9cbe11-2466-42c7-9fbd-f83c0ec673f5") : secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:13.682939 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.682910 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-jvpcq" event={"ID":"876ed95c-1771-4ce7-8259-f0dbb6082549","Type":"ContainerStarted","Data":"d272b9c606de6c77ec26a30b8e3d38ff0c11bc62585e523b405ef224a64ba935"} Jun 01 20:36:13.683848 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.683823 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" event={"ID":"6710a661-ae89-40c4-b4c5-5ab71d659495","Type":"ContainerStarted","Data":"84f98f51b11bc17e9fb519986bab1018a97827daa60073fc48baf573a8e085ce"} Jun 01 20:36:13.684759 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.684741 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" event={"ID":"2b70d650-c8dc-4bd2-ba65-eaff1e51937e","Type":"ContainerStarted","Data":"fe1c96e98a74065ccbb0e63f3211c99b4936443b1ae62a4f3d3d1de3ed8b5ee3"} Jun 01 20:36:13.685615 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:13.685598 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" event={"ID":"2560e6e6-843a-4326-b1a1-72eb4cbd5e76","Type":"ContainerStarted","Data":"8c4022c031b35ce57f44b34ae1a153f2b82e6263f5b477b2f7170bab28cd8ce7"} Jun 01 20:36:14.540543 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:14.539901 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rbqb2\" (UID: \"c3e24a84-f601-4e73-8b1a-1ac84417da87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:14.540543 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:14.540101 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 01 20:36:14.540543 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:14.540165 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls podName:c3e24a84-f601-4e73-8b1a-1ac84417da87 nodeName:}" failed. No retries permitted until 2026-06-01 20:36:16.540147123 +0000 UTC m=+124.788446391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rbqb2" (UID: "c3e24a84-f601-4e73-8b1a-1ac84417da87") : secret "samples-operator-tls" not found Jun 01 20:36:14.641956 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:14.640976 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:14.641956 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:14.641100 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:14.641956 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:14.641138 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:14.641956 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:14.641266 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:14.641956 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:14.641329 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls podName:af9cbe11-2466-42c7-9fbd-f83c0ec673f5 nodeName:}" failed. No retries permitted until 2026-06-01 20:36:16.641311227 +0000 UTC m=+124.889610497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-q2lxz" (UID: "af9cbe11-2466-42c7-9fbd-f83c0ec673f5") : secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:14.641956 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:14.641755 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 01 20:36:14.641956 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:14.641771 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7544b464c-n2ttg: secret "image-registry-tls" not found Jun 01 20:36:14.641956 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:14.641814 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls podName:4c176036-c9e0-42c9-bdf8-23edd49632fc nodeName:}" failed. No retries permitted until 2026-06-01 20:36:16.641799793 +0000 UTC m=+124.890099064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls") pod "image-registry-7544b464c-n2ttg" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc") : secret "image-registry-tls" not found Jun 01 20:36:14.641956 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:14.641879 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 01 20:36:14.641956 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:14.641914 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert podName:61936f31-2d91-4aae-af35-98648951f7df nodeName:}" failed. No retries permitted until 2026-06-01 20:36:16.641901443 +0000 UTC m=+124.890200713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-lxnc2" (UID: "61936f31-2d91-4aae-af35-98648951f7df") : secret "networking-console-plugin-cert" not found Jun 01 20:36:15.691789 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:15.691753 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-jvpcq" event={"ID":"876ed95c-1771-4ce7-8259-f0dbb6082549","Type":"ContainerStarted","Data":"92411a5548f466231dd661555600b0c05280cc85c4af42a66283e39dc21a008f"} Jun 01 20:36:15.705219 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:15.705061 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-jvpcq" podStartSLOduration=2.163171287 podStartE2EDuration="3.705046815s" podCreationTimestamp="2026-06-01 20:36:12 +0000 UTC" firstStartedPulling="2026-06-01 20:36:13.24339743 +0000 UTC m=+121.491696695" lastFinishedPulling="2026-06-01 20:36:14.785272946 +0000 UTC m=+123.033572223" observedRunningTime="2026-06-01 20:36:15.704146961 +0000 UTC m=+123.952446248" watchObservedRunningTime="2026-06-01 20:36:15.705046815 +0000 UTC m=+123.953346100" Jun 01 20:36:16.558540 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:16.558512 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rbqb2\" (UID: \"c3e24a84-f601-4e73-8b1a-1ac84417da87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:16.558715 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:16.558691 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 01 20:36:16.558796 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:16.558783 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls podName:c3e24a84-f601-4e73-8b1a-1ac84417da87 nodeName:}" failed. No retries permitted until 2026-06-01 20:36:20.558758434 +0000 UTC m=+128.807058162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rbqb2" (UID: "c3e24a84-f601-4e73-8b1a-1ac84417da87") : secret "samples-operator-tls" not found Jun 01 20:36:16.659143 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:16.659111 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:16.659299 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:16.659192 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:16.659299 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:16.659218 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:16.659299 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:16.659280 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 01 20:36:16.659411 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:16.659304 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7544b464c-n2ttg: secret "image-registry-tls" not found Jun 01 20:36:16.659411 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:16.659312 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:16.659411 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:16.659332 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 01 20:36:16.659411 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:16.659369 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls podName:4c176036-c9e0-42c9-bdf8-23edd49632fc nodeName:}" failed. No retries permitted until 2026-06-01 20:36:20.65934882 +0000 UTC m=+128.907648086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls") pod "image-registry-7544b464c-n2ttg" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc") : secret "image-registry-tls" not found Jun 01 20:36:16.659411 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:16.659386 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert podName:61936f31-2d91-4aae-af35-98648951f7df nodeName:}" failed. No retries permitted until 2026-06-01 20:36:20.659377329 +0000 UTC m=+128.907676597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-lxnc2" (UID: "61936f31-2d91-4aae-af35-98648951f7df") : secret "networking-console-plugin-cert" not found Jun 01 20:36:16.659411 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:16.659406 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls podName:af9cbe11-2466-42c7-9fbd-f83c0ec673f5 nodeName:}" failed. No retries permitted until 2026-06-01 20:36:20.659392763 +0000 UTC m=+128.907692040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-q2lxz" (UID: "af9cbe11-2466-42c7-9fbd-f83c0ec673f5") : secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:16.694466 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:16.694440 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" event={"ID":"6710a661-ae89-40c4-b4c5-5ab71d659495","Type":"ContainerStarted","Data":"f84176f39d3dea064510d6f06b047556bc9452050772aaa9b1a322547797e139"} Jun 01 20:36:16.696050 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:16.696027 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" event={"ID":"2b70d650-c8dc-4bd2-ba65-eaff1e51937e","Type":"ContainerStarted","Data":"7d2937ab11c9e753021b4a9f4f584afbeae8bcfbf088aaabaf9c5b459abd166c"} Jun 01 20:36:16.697475 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:16.697454 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/0.log" Jun 01 20:36:16.697571 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:16.697490 2561 generic.go:358] "Generic (PLEG): container finished" podID="2560e6e6-843a-4326-b1a1-72eb4cbd5e76" containerID="4b2e4e941babbe929e0041709475c08f2a615b9c7aa365876002452785a891b4" exitCode=255 Jun 01 20:36:16.697571 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:16.697519 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" event={"ID":"2560e6e6-843a-4326-b1a1-72eb4cbd5e76","Type":"ContainerDied","Data":"4b2e4e941babbe929e0041709475c08f2a615b9c7aa365876002452785a891b4"} Jun 01 20:36:16.697728 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:16.697715 2561 scope.go:117] "RemoveContainer" containerID="4b2e4e941babbe929e0041709475c08f2a615b9c7aa365876002452785a891b4" Jun 01 20:36:16.709316 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:16.709272 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" podStartSLOduration=1.643785611 podStartE2EDuration="4.70925792s" podCreationTimestamp="2026-06-01 20:36:12 +0000 UTC" firstStartedPulling="2026-06-01 20:36:13.41335508 +0000 UTC m=+121.661654343" lastFinishedPulling="2026-06-01 20:36:16.478827388 +0000 UTC m=+124.727126652" observedRunningTime="2026-06-01 20:36:16.708576848 +0000 UTC m=+124.956876135" watchObservedRunningTime="2026-06-01 20:36:16.70925792 +0000 UTC m=+124.957557210" Jun 01 20:36:17.701291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.701264 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:36:17.701764 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.701675 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/0.log" Jun 01 20:36:17.701764 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.701720 2561 generic.go:358] "Generic (PLEG): container finished" podID="2560e6e6-843a-4326-b1a1-72eb4cbd5e76" containerID="2bbe93e5fa6f514154ddf55c208dae13a897b612b08b14e9d6713780afc518b8" exitCode=255 Jun 01 20:36:17.701872 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.701808 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" event={"ID":"2560e6e6-843a-4326-b1a1-72eb4cbd5e76","Type":"ContainerDied","Data":"2bbe93e5fa6f514154ddf55c208dae13a897b612b08b14e9d6713780afc518b8"} Jun 01 20:36:17.701872 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.701850 2561 scope.go:117] "RemoveContainer" containerID="4b2e4e941babbe929e0041709475c08f2a615b9c7aa365876002452785a891b4" Jun 01 20:36:17.702092 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.702072 2561 scope.go:117] "RemoveContainer" containerID="2bbe93e5fa6f514154ddf55c208dae13a897b612b08b14e9d6713780afc518b8" Jun 01 20:36:17.702301 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:17.702281 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-sxx5t_openshift-console-operator(2560e6e6-843a-4326-b1a1-72eb4cbd5e76)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" podUID="2560e6e6-843a-4326-b1a1-72eb4cbd5e76" Jun 01 20:36:17.716449 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.716411 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" podStartSLOduration=2.573989772 podStartE2EDuration="5.716399257s" podCreationTimestamp="2026-06-01 20:36:12 +0000 UTC" firstStartedPulling="2026-06-01 20:36:13.335002515 +0000 UTC m=+121.583301779" lastFinishedPulling="2026-06-01 20:36:16.477411999 +0000 UTC m=+124.725711264" observedRunningTime="2026-06-01 20:36:16.734454779 +0000 UTC m=+124.982754067" watchObservedRunningTime="2026-06-01 20:36:17.716399257 +0000 UTC m=+125.964698543" Jun 01 20:36:17.845072 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.845040 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x"] Jun 01 20:36:17.849365 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.849339 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x" Jun 01 20:36:17.851552 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.851527 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 01 20:36:17.851552 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.851552 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 01 20:36:17.851763 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.851551 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qrlcl\"" Jun 01 20:36:17.857863 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.857842 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x"] Jun 01 20:36:17.971729 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:17.971702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2x5p\" (UniqueName: \"kubernetes.io/projected/376fcf9e-e1cf-4657-830d-3a70318a8919-kube-api-access-z2x5p\") pod \"migrator-96c6f749-cxk4x\" (UID: \"376fcf9e-e1cf-4657-830d-3a70318a8919\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x" Jun 01 20:36:18.072454 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:18.072418 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2x5p\" (UniqueName: \"kubernetes.io/projected/376fcf9e-e1cf-4657-830d-3a70318a8919-kube-api-access-z2x5p\") pod \"migrator-96c6f749-cxk4x\" (UID: \"376fcf9e-e1cf-4657-830d-3a70318a8919\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x" Jun 01 20:36:18.079314 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:18.079291 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2x5p\" (UniqueName: \"kubernetes.io/projected/376fcf9e-e1cf-4657-830d-3a70318a8919-kube-api-access-z2x5p\") pod \"migrator-96c6f749-cxk4x\" (UID: \"376fcf9e-e1cf-4657-830d-3a70318a8919\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x" Jun 01 20:36:18.159140 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:18.159107 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x" Jun 01 20:36:18.276074 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:18.276038 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376fcf9e_e1cf_4657_830d_3a70318a8919.slice/crio-638bd08bf0d97d057801ec89a4c841e5a2e84993f63f9ca632a332178e4f3555 WatchSource:0}: Error finding container 638bd08bf0d97d057801ec89a4c841e5a2e84993f63f9ca632a332178e4f3555: Status 404 returned error can't find the container with id 638bd08bf0d97d057801ec89a4c841e5a2e84993f63f9ca632a332178e4f3555 Jun 01 20:36:18.276332 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:18.276312 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x"] Jun 01 20:36:18.704395 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:18.704306 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x" event={"ID":"376fcf9e-e1cf-4657-830d-3a70318a8919","Type":"ContainerStarted","Data":"638bd08bf0d97d057801ec89a4c841e5a2e84993f63f9ca632a332178e4f3555"} Jun 01 20:36:18.705481 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:18.705463 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:36:18.705828 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:18.705810 2561 scope.go:117] "RemoveContainer" containerID="2bbe93e5fa6f514154ddf55c208dae13a897b612b08b14e9d6713780afc518b8" Jun 01 20:36:18.706011 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:18.705992 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-sxx5t_openshift-console-operator(2560e6e6-843a-4326-b1a1-72eb4cbd5e76)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" podUID="2560e6e6-843a-4326-b1a1-72eb4cbd5e76" Jun 01 20:36:18.804894 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:18.804862 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mgc8h_d09ae907-2157-41c9-83fb-d0f2c6193eb2/dns-node-resolver/0.log" Jun 01 20:36:20.005522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.005443 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hr6hz_14095d77-149b-4d73-9273-672aeb86dbd8/node-ca/0.log" Jun 01 20:36:20.093359 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.093330 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-8wgdz"] Jun 01 20:36:20.096318 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.096304 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-8wgdz" Jun 01 20:36:20.097976 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.097952 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 01 20:36:20.098167 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.098152 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 01 20:36:20.098247 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.098195 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 01 20:36:20.098564 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.098548 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 01 20:36:20.098710 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.098603 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tjjps\"" Jun 01 20:36:20.102438 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.102406 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-8wgdz"] Jun 01 20:36:20.190272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.190231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/961b3ff1-cf90-46fc-b536-c39950aa859e-signing-cabundle\") pod \"service-ca-685df94d57-8wgdz\" (UID: \"961b3ff1-cf90-46fc-b536-c39950aa859e\") " pod="openshift-service-ca/service-ca-685df94d57-8wgdz" Jun 01 20:36:20.190446 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.190370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/961b3ff1-cf90-46fc-b536-c39950aa859e-signing-key\") pod \"service-ca-685df94d57-8wgdz\" (UID: \"961b3ff1-cf90-46fc-b536-c39950aa859e\") " pod="openshift-service-ca/service-ca-685df94d57-8wgdz" Jun 01 20:36:20.190446 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.190430 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmsd5\" (UniqueName: \"kubernetes.io/projected/961b3ff1-cf90-46fc-b536-c39950aa859e-kube-api-access-wmsd5\") pod \"service-ca-685df94d57-8wgdz\" (UID: \"961b3ff1-cf90-46fc-b536-c39950aa859e\") " pod="openshift-service-ca/service-ca-685df94d57-8wgdz" Jun 01 20:36:20.290853 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.290775 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/961b3ff1-cf90-46fc-b536-c39950aa859e-signing-key\") pod \"service-ca-685df94d57-8wgdz\" (UID: \"961b3ff1-cf90-46fc-b536-c39950aa859e\") " pod="openshift-service-ca/service-ca-685df94d57-8wgdz" Jun 01 20:36:20.290853 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.290807 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmsd5\" (UniqueName: \"kubernetes.io/projected/961b3ff1-cf90-46fc-b536-c39950aa859e-kube-api-access-wmsd5\") pod \"service-ca-685df94d57-8wgdz\" (UID: \"961b3ff1-cf90-46fc-b536-c39950aa859e\") " pod="openshift-service-ca/service-ca-685df94d57-8wgdz" Jun 01 20:36:20.290853 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.290846 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/961b3ff1-cf90-46fc-b536-c39950aa859e-signing-cabundle\") pod \"service-ca-685df94d57-8wgdz\" (UID: \"961b3ff1-cf90-46fc-b536-c39950aa859e\") " pod="openshift-service-ca/service-ca-685df94d57-8wgdz" Jun 01 20:36:20.291416 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.291398 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/961b3ff1-cf90-46fc-b536-c39950aa859e-signing-cabundle\") pod \"service-ca-685df94d57-8wgdz\" (UID: \"961b3ff1-cf90-46fc-b536-c39950aa859e\") " pod="openshift-service-ca/service-ca-685df94d57-8wgdz" Jun 01 20:36:20.293163 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.293142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/961b3ff1-cf90-46fc-b536-c39950aa859e-signing-key\") pod \"service-ca-685df94d57-8wgdz\" (UID: \"961b3ff1-cf90-46fc-b536-c39950aa859e\") " pod="openshift-service-ca/service-ca-685df94d57-8wgdz" Jun 01 20:36:20.298158 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.298140 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmsd5\" (UniqueName: \"kubernetes.io/projected/961b3ff1-cf90-46fc-b536-c39950aa859e-kube-api-access-wmsd5\") pod \"service-ca-685df94d57-8wgdz\" (UID: \"961b3ff1-cf90-46fc-b536-c39950aa859e\") " pod="openshift-service-ca/service-ca-685df94d57-8wgdz" Jun 01 20:36:20.405207 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.405175 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-8wgdz" Jun 01 20:36:20.525472 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.525446 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-8wgdz"] Jun 01 20:36:20.527704 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:20.527674 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961b3ff1_cf90_46fc_b536_c39950aa859e.slice/crio-6867255f95fe4d95d3b15d76c1ed3e2ae97c7fbd8f57c4414f38bf707ab9efe6 WatchSource:0}: Error finding container 6867255f95fe4d95d3b15d76c1ed3e2ae97c7fbd8f57c4414f38bf707ab9efe6: Status 404 returned error can't find the container with id 6867255f95fe4d95d3b15d76c1ed3e2ae97c7fbd8f57c4414f38bf707ab9efe6 Jun 01 20:36:20.594131 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.594107 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rbqb2\" (UID: \"c3e24a84-f601-4e73-8b1a-1ac84417da87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:20.594264 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:20.594246 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 01 20:36:20.594309 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:20.594301 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls podName:c3e24a84-f601-4e73-8b1a-1ac84417da87 nodeName:}" failed. No retries permitted until 2026-06-01 20:36:28.59428661 +0000 UTC m=+136.842585879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rbqb2" (UID: "c3e24a84-f601-4e73-8b1a-1ac84417da87") : secret "samples-operator-tls" not found Jun 01 20:36:20.694648 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.694592 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:20.694841 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.694677 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:20.694841 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.694744 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:20.694841 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:20.694752 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 01 20:36:20.694841 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:20.694786 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:20.694841 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:20.694829 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert podName:61936f31-2d91-4aae-af35-98648951f7df nodeName:}" failed. No retries permitted until 2026-06-01 20:36:28.694807049 +0000 UTC m=+136.943106329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-lxnc2" (UID: "61936f31-2d91-4aae-af35-98648951f7df") : secret "networking-console-plugin-cert" not found Jun 01 20:36:20.695041 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:20.694848 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls podName:af9cbe11-2466-42c7-9fbd-f83c0ec673f5 nodeName:}" failed. No retries permitted until 2026-06-01 20:36:28.694839062 +0000 UTC m=+136.943138328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-q2lxz" (UID: "af9cbe11-2466-42c7-9fbd-f83c0ec673f5") : secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:20.695041 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:20.694861 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 01 20:36:20.695041 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:20.694877 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7544b464c-n2ttg: secret "image-registry-tls" not found Jun 01 20:36:20.695041 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:20.694932 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls podName:4c176036-c9e0-42c9-bdf8-23edd49632fc nodeName:}" failed. No retries permitted until 2026-06-01 20:36:28.694916037 +0000 UTC m=+136.943215323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls") pod "image-registry-7544b464c-n2ttg" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc") : secret "image-registry-tls" not found Jun 01 20:36:20.712083 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.712053 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x" event={"ID":"376fcf9e-e1cf-4657-830d-3a70318a8919","Type":"ContainerStarted","Data":"bffbd9d7aa691789ecbd36d575805ca1e27243f5bede48a7b556d91639816d58"} Jun 01 20:36:20.712238 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.712090 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x" event={"ID":"376fcf9e-e1cf-4657-830d-3a70318a8919","Type":"ContainerStarted","Data":"dc4369dd7272fdbc3e5bd5bc63cce7989bba4e9d532a857a711e3c13cb5f9845"} Jun 01 20:36:20.713341 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.713322 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-8wgdz" event={"ID":"961b3ff1-cf90-46fc-b536-c39950aa859e","Type":"ContainerStarted","Data":"b52603f91b45a1da0052e48553151a7f6a068ee27e07f451bb59c39c919b5d89"} Jun 01 20:36:20.713416 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.713356 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-8wgdz" event={"ID":"961b3ff1-cf90-46fc-b536-c39950aa859e","Type":"ContainerStarted","Data":"6867255f95fe4d95d3b15d76c1ed3e2ae97c7fbd8f57c4414f38bf707ab9efe6"} Jun 01 20:36:20.724786 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.724739 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-cxk4x" podStartSLOduration=2.269367806 podStartE2EDuration="3.724723951s" podCreationTimestamp="2026-06-01 20:36:17 +0000 UTC" firstStartedPulling="2026-06-01 20:36:18.277726619 +0000 UTC m=+126.526025887" lastFinishedPulling="2026-06-01 20:36:19.733082751 +0000 UTC m=+127.981382032" observedRunningTime="2026-06-01 20:36:20.724240887 +0000 UTC m=+128.972540177" watchObservedRunningTime="2026-06-01 20:36:20.724723951 +0000 UTC m=+128.973023238" Jun 01 20:36:20.737118 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:20.737085 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-8wgdz" podStartSLOduration=0.737073614 podStartE2EDuration="737.073614ms" podCreationTimestamp="2026-06-01 20:36:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 20:36:20.736822616 +0000 UTC m=+128.985121903" watchObservedRunningTime="2026-06-01 20:36:20.737073614 +0000 UTC m=+128.985372899" Jun 01 20:36:21.098022 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:21.097985 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:36:21.098369 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:21.098097 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 01 20:36:21.098369 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:21.098146 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs podName:81a6c9fa-0e20-455d-b262-0711156022fe nodeName:}" failed. No retries permitted until 2026-06-01 20:38:23.098133186 +0000 UTC m=+251.346432450 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs") pod "network-metrics-daemon-2kqdx" (UID: "81a6c9fa-0e20-455d-b262-0711156022fe") : secret "metrics-daemon-secret" not found Jun 01 20:36:23.105538 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:23.105494 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:23.105538 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:23.105537 2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:23.105975 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:23.105902 2561 scope.go:117] "RemoveContainer" containerID="2bbe93e5fa6f514154ddf55c208dae13a897b612b08b14e9d6713780afc518b8" Jun 01 20:36:23.106080 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:23.106062 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-sxx5t_openshift-console-operator(2560e6e6-843a-4326-b1a1-72eb4cbd5e76)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" podUID="2560e6e6-843a-4326-b1a1-72eb4cbd5e76" Jun 01 20:36:28.661706 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:28.661665 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rbqb2\" (UID: \"c3e24a84-f601-4e73-8b1a-1ac84417da87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:28.664189 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:28.664165 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3e24a84-f601-4e73-8b1a-1ac84417da87-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rbqb2\" (UID: \"c3e24a84-f601-4e73-8b1a-1ac84417da87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:28.699048 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:28.699009 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" Jun 01 20:36:28.762989 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:28.762957 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:28.763140 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:28.763017 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:28.763140 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:28.763123 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:28.763244 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:28.763198 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:28.763244 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:28.763216 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 01 20:36:28.763347 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:28.763270 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert podName:61936f31-2d91-4aae-af35-98648951f7df nodeName:}" failed. No retries permitted until 2026-06-01 20:36:44.763251273 +0000 UTC m=+153.011550539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-lxnc2" (UID: "61936f31-2d91-4aae-af35-98648951f7df") : secret "networking-console-plugin-cert" not found Jun 01 20:36:28.763347 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:36:28.763288 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls podName:af9cbe11-2466-42c7-9fbd-f83c0ec673f5 nodeName:}" failed. No retries permitted until 2026-06-01 20:36:44.763279949 +0000 UTC m=+153.011579214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-q2lxz" (UID: "af9cbe11-2466-42c7-9fbd-f83c0ec673f5") : secret "cluster-monitoring-operator-tls" not found Jun 01 20:36:28.765289 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:28.765269 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls\") pod \"image-registry-7544b464c-n2ttg\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:28.810048 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:28.810018 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:28.816651 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:28.816609 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2"] Jun 01 20:36:28.934541 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:28.934466 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7544b464c-n2ttg"] Jun 01 20:36:28.937281 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:28.937251 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c176036_c9e0_42c9_bdf8_23edd49632fc.slice/crio-4fe1e3d1c6b64dcc92761d6dab2e9c0f535e29145f97356a13984baa42212054 WatchSource:0}: Error finding container 4fe1e3d1c6b64dcc92761d6dab2e9c0f535e29145f97356a13984baa42212054: Status 404 returned error can't find the container with id 4fe1e3d1c6b64dcc92761d6dab2e9c0f535e29145f97356a13984baa42212054 Jun 01 20:36:29.740618 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:29.740554 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" event={"ID":"4c176036-c9e0-42c9-bdf8-23edd49632fc","Type":"ContainerStarted","Data":"62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5"} Jun 01 20:36:29.741168 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:29.741125 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" event={"ID":"4c176036-c9e0-42c9-bdf8-23edd49632fc","Type":"ContainerStarted","Data":"4fe1e3d1c6b64dcc92761d6dab2e9c0f535e29145f97356a13984baa42212054"} Jun 01 20:36:29.741868 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:29.741824 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" event={"ID":"c3e24a84-f601-4e73-8b1a-1ac84417da87","Type":"ContainerStarted","Data":"22b93e7082925cd5daa754707112e9f1235b15ea53d1afb45124e71fe22d3320"} Jun 01 20:36:29.756470 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:29.756433 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" podStartSLOduration=17.756423067 podStartE2EDuration="17.756423067s" podCreationTimestamp="2026-06-01 20:36:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 20:36:29.755619254 +0000 UTC m=+138.003918540" watchObservedRunningTime="2026-06-01 20:36:29.756423067 +0000 UTC m=+138.004722389" Jun 01 20:36:30.744841 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:30.744808 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:31.748081 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:31.748047 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" event={"ID":"c3e24a84-f601-4e73-8b1a-1ac84417da87","Type":"ContainerStarted","Data":"8ded2651bf2715a9d42b11059f6bb6c1ce80fc1b997f6f9c82dd58b21aa49c70"} Jun 01 20:36:31.748481 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:31.748086 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" event={"ID":"c3e24a84-f601-4e73-8b1a-1ac84417da87","Type":"ContainerStarted","Data":"90d52d1d5e195fe5fd7ed4751bddaecb6c9aeee676a76a72879f772535e35ba8"} Jun 01 20:36:31.762120 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:31.762074 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rbqb2" podStartSLOduration=17.496629633 podStartE2EDuration="19.762061411s" podCreationTimestamp="2026-06-01 20:36:12 +0000 UTC" firstStartedPulling="2026-06-01 20:36:28.859958113 +0000 UTC m=+137.108257391" lastFinishedPulling="2026-06-01 20:36:31.1253899 +0000 UTC m=+139.373689169" observedRunningTime="2026-06-01 20:36:31.761450166 +0000 UTC m=+140.009749452" watchObservedRunningTime="2026-06-01 20:36:31.762061411 +0000 UTC m=+140.010360696" Jun 01 20:36:38.273640 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:38.273607 2561 scope.go:117] "RemoveContainer" containerID="2bbe93e5fa6f514154ddf55c208dae13a897b612b08b14e9d6713780afc518b8" Jun 01 20:36:38.765973 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:38.765946 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:36:38.766139 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:38.766020 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" event={"ID":"2560e6e6-843a-4326-b1a1-72eb4cbd5e76","Type":"ContainerStarted","Data":"ec0b9634709c7fc07c5fb04d58e36befbab4cf4d0d09053a73e945ef8885d0dd"} Jun 01 20:36:38.766303 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:38.766285 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:38.771553 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:38.771517 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" Jun 01 20:36:38.783462 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:38.783405 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-sxx5t" podStartSLOduration=23.568277547 podStartE2EDuration="26.783390807s" podCreationTimestamp="2026-06-01 20:36:12 +0000 UTC" firstStartedPulling="2026-06-01 20:36:13.25880583 +0000 UTC m=+121.507105094" lastFinishedPulling="2026-06-01 20:36:16.473919091 +0000 UTC m=+124.722218354" observedRunningTime="2026-06-01 20:36:38.782693109 +0000 UTC m=+147.030992396" watchObservedRunningTime="2026-06-01 20:36:38.783390807 +0000 UTC m=+147.031690095" Jun 01 20:36:40.629298 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.629264 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h457v"] Jun 01 20:36:40.634792 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.634769 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.636580 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.636557 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 01 20:36:40.637060 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.637032 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 01 20:36:40.637060 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.637033 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 01 20:36:40.637193 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.637083 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 01 20:36:40.637193 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.637059 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hfgrl\"" Jun 01 20:36:40.641569 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.641551 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h457v"] Jun 01 20:36:40.664037 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.664010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4f42dc9a-7154-4a30-90a4-64328ad9c784-crio-socket\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.664137 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.664059 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89ljn\" (UniqueName: \"kubernetes.io/projected/4f42dc9a-7154-4a30-90a4-64328ad9c784-kube-api-access-89ljn\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.664137 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.664095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f42dc9a-7154-4a30-90a4-64328ad9c784-data-volume\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.664216 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.664159 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f42dc9a-7154-4a30-90a4-64328ad9c784-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.664257 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.664239 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f42dc9a-7154-4a30-90a4-64328ad9c784-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.703117 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.703085 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-62qdf"] Jun 01 20:36:40.707201 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.707175 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-62qdf" Jun 01 20:36:40.709136 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.709116 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 01 20:36:40.709261 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.709116 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6qdlx\"" Jun 01 20:36:40.709261 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.709118 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 01 20:36:40.715435 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.715413 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-62qdf"] Jun 01 20:36:40.719011 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.718993 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7544b464c-n2ttg"] Jun 01 20:36:40.750146 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.750124 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c66656f99-87l5s"] Jun 01 20:36:40.753964 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.753941 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.762849 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.762829 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c66656f99-87l5s"] Jun 01 20:36:40.765009 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.764979 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f42dc9a-7154-4a30-90a4-64328ad9c784-data-volume\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.765109 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.765041 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f42dc9a-7154-4a30-90a4-64328ad9c784-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.765187 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.765152 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4zln\" (UniqueName: \"kubernetes.io/projected/767443fd-16fc-4ca9-8d7f-987c1da9217a-kube-api-access-p4zln\") pod \"downloads-c65b8dc4b-62qdf\" (UID: \"767443fd-16fc-4ca9-8d7f-987c1da9217a\") " pod="openshift-console/downloads-c65b8dc4b-62qdf" Jun 01 20:36:40.765246 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.765188 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f42dc9a-7154-4a30-90a4-64328ad9c784-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.765246 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.765226 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4f42dc9a-7154-4a30-90a4-64328ad9c784-crio-socket\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.765351 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.765265 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89ljn\" (UniqueName: \"kubernetes.io/projected/4f42dc9a-7154-4a30-90a4-64328ad9c784-kube-api-access-89ljn\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.765351 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.765315 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f42dc9a-7154-4a30-90a4-64328ad9c784-data-volume\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.765454 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.765382 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4f42dc9a-7154-4a30-90a4-64328ad9c784-crio-socket\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.765892 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.765876 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4f42dc9a-7154-4a30-90a4-64328ad9c784-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.767693 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.767675 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4f42dc9a-7154-4a30-90a4-64328ad9c784-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.780126 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.780109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89ljn\" (UniqueName: \"kubernetes.io/projected/4f42dc9a-7154-4a30-90a4-64328ad9c784-kube-api-access-89ljn\") pod \"insights-runtime-extractor-h457v\" (UID: \"4f42dc9a-7154-4a30-90a4-64328ad9c784\") " pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.866559 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.866529 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4zln\" (UniqueName: \"kubernetes.io/projected/767443fd-16fc-4ca9-8d7f-987c1da9217a-kube-api-access-p4zln\") pod \"downloads-c65b8dc4b-62qdf\" (UID: \"767443fd-16fc-4ca9-8d7f-987c1da9217a\") " pod="openshift-console/downloads-c65b8dc4b-62qdf" Jun 01 20:36:40.866726 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.866571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac79082b-22a1-452d-aa81-9fa3a2e9a525-trusted-ca\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.866726 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.866595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac79082b-22a1-452d-aa81-9fa3a2e9a525-bound-sa-token\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.866726 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.866680 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac79082b-22a1-452d-aa81-9fa3a2e9a525-registry-certificates\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.866845 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.866744 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac79082b-22a1-452d-aa81-9fa3a2e9a525-image-registry-private-configuration\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.866890 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.866866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac79082b-22a1-452d-aa81-9fa3a2e9a525-registry-tls\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.866936 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.866917 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac79082b-22a1-452d-aa81-9fa3a2e9a525-installation-pull-secrets\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.867018 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.867003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r45r\" (UniqueName: \"kubernetes.io/projected/ac79082b-22a1-452d-aa81-9fa3a2e9a525-kube-api-access-5r45r\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.867063 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.867048 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac79082b-22a1-452d-aa81-9fa3a2e9a525-ca-trust-extracted\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.885230 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.885168 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4zln\" (UniqueName: \"kubernetes.io/projected/767443fd-16fc-4ca9-8d7f-987c1da9217a-kube-api-access-p4zln\") pod \"downloads-c65b8dc4b-62qdf\" (UID: \"767443fd-16fc-4ca9-8d7f-987c1da9217a\") " pod="openshift-console/downloads-c65b8dc4b-62qdf" Jun 01 20:36:40.944077 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.944017 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h457v" Jun 01 20:36:40.967413 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.967388 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac79082b-22a1-452d-aa81-9fa3a2e9a525-bound-sa-token\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.967534 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.967428 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac79082b-22a1-452d-aa81-9fa3a2e9a525-registry-certificates\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.967534 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.967479 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac79082b-22a1-452d-aa81-9fa3a2e9a525-image-registry-private-configuration\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.967534 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.967504 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac79082b-22a1-452d-aa81-9fa3a2e9a525-registry-tls\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.967759 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.967536 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac79082b-22a1-452d-aa81-9fa3a2e9a525-installation-pull-secrets\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.967759 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.967584 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5r45r\" (UniqueName: \"kubernetes.io/projected/ac79082b-22a1-452d-aa81-9fa3a2e9a525-kube-api-access-5r45r\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.967759 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.967619 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac79082b-22a1-452d-aa81-9fa3a2e9a525-ca-trust-extracted\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.967904 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.967779 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac79082b-22a1-452d-aa81-9fa3a2e9a525-trusted-ca\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.968165 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.968138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac79082b-22a1-452d-aa81-9fa3a2e9a525-ca-trust-extracted\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.968419 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.968391 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac79082b-22a1-452d-aa81-9fa3a2e9a525-registry-certificates\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.969009 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.968986 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac79082b-22a1-452d-aa81-9fa3a2e9a525-trusted-ca\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.970318 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.970294 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac79082b-22a1-452d-aa81-9fa3a2e9a525-installation-pull-secrets\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.970464 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.970447 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac79082b-22a1-452d-aa81-9fa3a2e9a525-registry-tls\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.970614 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.970595 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac79082b-22a1-452d-aa81-9fa3a2e9a525-image-registry-private-configuration\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.974153 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.974136 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r45r\" (UniqueName: \"kubernetes.io/projected/ac79082b-22a1-452d-aa81-9fa3a2e9a525-kube-api-access-5r45r\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:40.974291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:40.974275 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac79082b-22a1-452d-aa81-9fa3a2e9a525-bound-sa-token\") pod \"image-registry-6c66656f99-87l5s\" (UID: \"ac79082b-22a1-452d-aa81-9fa3a2e9a525\") " pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:41.017327 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.017296 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-62qdf" Jun 01 20:36:41.064244 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.064075 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:41.072576 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.072550 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h457v"] Jun 01 20:36:41.077804 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:41.077776 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f42dc9a_7154_4a30_90a4_64328ad9c784.slice/crio-f034fa9bc14a6762f54983f2f0da2055ecc5813cf2b7de94291a06b6347f15ab WatchSource:0}: Error finding container f034fa9bc14a6762f54983f2f0da2055ecc5813cf2b7de94291a06b6347f15ab: Status 404 returned error can't find the container with id f034fa9bc14a6762f54983f2f0da2055ecc5813cf2b7de94291a06b6347f15ab Jun 01 20:36:41.167897 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.167877 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-62qdf"] Jun 01 20:36:41.170246 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:41.170222 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767443fd_16fc_4ca9_8d7f_987c1da9217a.slice/crio-73d721f4c30c97b62dc1eced8c649899ca514e8e8f00b5e60af5c6dc0abb9793 WatchSource:0}: Error finding container 73d721f4c30c97b62dc1eced8c649899ca514e8e8f00b5e60af5c6dc0abb9793: Status 404 returned error can't find the container with id 73d721f4c30c97b62dc1eced8c649899ca514e8e8f00b5e60af5c6dc0abb9793 Jun 01 20:36:41.224933 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.222185 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c66656f99-87l5s"] Jun 01 20:36:41.225118 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:41.225090 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac79082b_22a1_452d_aa81_9fa3a2e9a525.slice/crio-056acacbc03946ae8f7109a7ab7ce00627b2f1e21e35c86fcb0967e25ad2454c WatchSource:0}: Error finding container 056acacbc03946ae8f7109a7ab7ce00627b2f1e21e35c86fcb0967e25ad2454c: Status 404 returned error can't find the container with id 056acacbc03946ae8f7109a7ab7ce00627b2f1e21e35c86fcb0967e25ad2454c Jun 01 20:36:41.776016 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.775988 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-62qdf" event={"ID":"767443fd-16fc-4ca9-8d7f-987c1da9217a","Type":"ContainerStarted","Data":"73d721f4c30c97b62dc1eced8c649899ca514e8e8f00b5e60af5c6dc0abb9793"} Jun 01 20:36:41.777272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.777248 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c66656f99-87l5s" event={"ID":"ac79082b-22a1-452d-aa81-9fa3a2e9a525","Type":"ContainerStarted","Data":"4e9893a81280105a1321293385655734a1407ae365502382570a5373d4550da1"} Jun 01 20:36:41.777381 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.777279 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c66656f99-87l5s" event={"ID":"ac79082b-22a1-452d-aa81-9fa3a2e9a525","Type":"ContainerStarted","Data":"056acacbc03946ae8f7109a7ab7ce00627b2f1e21e35c86fcb0967e25ad2454c"} Jun 01 20:36:41.777381 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.777367 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:36:41.778822 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.778803 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h457v" event={"ID":"4f42dc9a-7154-4a30-90a4-64328ad9c784","Type":"ContainerStarted","Data":"c701c007ae8946490d2ceb1b7fb9708162d5864290995f7963e77cffa0be17bf"} Jun 01 20:36:41.778899 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.778831 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h457v" event={"ID":"4f42dc9a-7154-4a30-90a4-64328ad9c784","Type":"ContainerStarted","Data":"03ab7ae00845e3aab3f510541eeb245dba6efc070e3612abddb59e9f94d19457"} Jun 01 20:36:41.778899 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.778844 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h457v" event={"ID":"4f42dc9a-7154-4a30-90a4-64328ad9c784","Type":"ContainerStarted","Data":"f034fa9bc14a6762f54983f2f0da2055ecc5813cf2b7de94291a06b6347f15ab"} Jun 01 20:36:41.793121 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:41.793082 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c66656f99-87l5s" podStartSLOduration=1.793071062 podStartE2EDuration="1.793071062s" podCreationTimestamp="2026-06-01 20:36:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 20:36:41.792289479 +0000 UTC m=+150.040588764" watchObservedRunningTime="2026-06-01 20:36:41.793071062 +0000 UTC m=+150.041370342" Jun 01 20:36:43.789654 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:43.789473 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h457v" event={"ID":"4f42dc9a-7154-4a30-90a4-64328ad9c784","Type":"ContainerStarted","Data":"dbe1c6067c6850d1276778358576a01a3981239432c48185b9b2a255bdc08343"} Jun 01 20:36:43.805803 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:43.805746 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h457v" podStartSLOduration=1.722106079 podStartE2EDuration="3.80572846s" podCreationTimestamp="2026-06-01 20:36:40 +0000 UTC" firstStartedPulling="2026-06-01 20:36:41.162883172 +0000 UTC m=+149.411182437" lastFinishedPulling="2026-06-01 20:36:43.246505543 +0000 UTC m=+151.494804818" observedRunningTime="2026-06-01 20:36:43.804086291 +0000 UTC m=+152.052385598" watchObservedRunningTime="2026-06-01 20:36:43.80572846 +0000 UTC m=+152.054027746" Jun 01 20:36:44.805249 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:44.805213 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:44.805786 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:44.805261 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:44.807918 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:44.807896 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/af9cbe11-2466-42c7-9fbd-f83c0ec673f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-q2lxz\" (UID: \"af9cbe11-2466-42c7-9fbd-f83c0ec673f5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:44.808027 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:44.807994 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61936f31-2d91-4aae-af35-98648951f7df-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-lxnc2\" (UID: \"61936f31-2d91-4aae-af35-98648951f7df\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:44.987972 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:44.987936 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" Jun 01 20:36:44.996648 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:44.996592 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" Jun 01 20:36:45.118938 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:45.118833 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2"] Jun 01 20:36:45.121654 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:45.121594 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61936f31_2d91_4aae_af35_98648951f7df.slice/crio-b3c59eef2dd17c893c06aa50b932fa77725e27a390f1e1e871e0f5fc4580eb8c WatchSource:0}: Error finding container b3c59eef2dd17c893c06aa50b932fa77725e27a390f1e1e871e0f5fc4580eb8c: Status 404 returned error can't find the container with id b3c59eef2dd17c893c06aa50b932fa77725e27a390f1e1e871e0f5fc4580eb8c Jun 01 20:36:45.140655 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:45.140610 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz"] Jun 01 20:36:45.143322 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:45.143296 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9cbe11_2466_42c7_9fbd_f83c0ec673f5.slice/crio-aae5268f2d6d5951d3e6e128c2fc5aaac7f43c2bb376046329d596e452549472 WatchSource:0}: Error finding container aae5268f2d6d5951d3e6e128c2fc5aaac7f43c2bb376046329d596e452549472: Status 404 returned error can't find the container with id aae5268f2d6d5951d3e6e128c2fc5aaac7f43c2bb376046329d596e452549472 Jun 01 20:36:45.797562 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:45.797524 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" event={"ID":"af9cbe11-2466-42c7-9fbd-f83c0ec673f5","Type":"ContainerStarted","Data":"aae5268f2d6d5951d3e6e128c2fc5aaac7f43c2bb376046329d596e452549472"} Jun 01 20:36:45.799204 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:45.799175 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" event={"ID":"61936f31-2d91-4aae-af35-98648951f7df","Type":"ContainerStarted","Data":"b3c59eef2dd17c893c06aa50b932fa77725e27a390f1e1e871e0f5fc4580eb8c"} Jun 01 20:36:47.807349 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:47.807307 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" event={"ID":"af9cbe11-2466-42c7-9fbd-f83c0ec673f5","Type":"ContainerStarted","Data":"5d8a5fed9df79bbe1be76f15748edc6742d7cee67561166ff964afb5857c5b99"} Jun 01 20:36:47.809167 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:47.809132 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" event={"ID":"61936f31-2d91-4aae-af35-98648951f7df","Type":"ContainerStarted","Data":"11b9ee638d33a03c521dd6ef4612aa5760db4377811782edf3eaac95f5d491d4"} Jun 01 20:36:47.821584 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:47.821526 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-q2lxz" podStartSLOduration=33.531432894 podStartE2EDuration="35.821507033s" podCreationTimestamp="2026-06-01 20:36:12 +0000 UTC" firstStartedPulling="2026-06-01 20:36:45.145322531 +0000 UTC m=+153.393621796" lastFinishedPulling="2026-06-01 20:36:47.435396658 +0000 UTC m=+155.683695935" observedRunningTime="2026-06-01 20:36:47.819751793 +0000 UTC m=+156.068051080" watchObservedRunningTime="2026-06-01 20:36:47.821507033 +0000 UTC m=+156.069806320" Jun 01 20:36:47.833360 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:47.833307 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-lxnc2" podStartSLOduration=33.544457093 podStartE2EDuration="35.833291938s" podCreationTimestamp="2026-06-01 20:36:12 +0000 UTC" firstStartedPulling="2026-06-01 20:36:45.1240612 +0000 UTC m=+153.372360467" lastFinishedPulling="2026-06-01 20:36:47.412896042 +0000 UTC m=+155.661195312" observedRunningTime="2026-06-01 20:36:47.831960489 +0000 UTC m=+156.080259780" watchObservedRunningTime="2026-06-01 20:36:47.833291938 +0000 UTC m=+156.081591228" Jun 01 20:36:50.724912 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:50.724874 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:36:56.378646 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.378552 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cth5d"] Jun 01 20:36:56.382480 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.382455 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.385060 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.384744 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 01 20:36:56.385060 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.384860 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 01 20:36:56.385248 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.385097 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 01 20:36:56.385313 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.385262 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 01 20:36:56.385569 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.385546 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-scssc\"" Jun 01 20:36:56.514143 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.514106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-textfile\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.514319 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.514196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-root\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.514319 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.514224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-wtmp\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.514319 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.514251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmwbj\" (UniqueName: \"kubernetes.io/projected/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-kube-api-access-vmwbj\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.514319 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.514298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.514528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.514344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-tls\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.514528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.514391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-sys\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.514528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.514417 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.514528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.514474 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-metrics-client-ca\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.615700 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.615666 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-tls\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.615871 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.615715 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-sys\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.615871 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.615780 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.615871 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.615828 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-metrics-client-ca\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.616087 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.615887 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-textfile\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.616087 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.615969 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-root\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.616087 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.615995 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-wtmp\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.616087 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.616021 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmwbj\" (UniqueName: \"kubernetes.io/projected/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-kube-api-access-vmwbj\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.616087 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.616061 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.616328 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.616059 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-root\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.616328 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.616138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-wtmp\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.616328 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.616253 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-sys\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.616950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.616894 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-textfile\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.616950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.616902 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.616950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.616923 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-metrics-client-ca\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.618656 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.618597 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.618844 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.618806 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-node-exporter-tls\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.623408 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.623382 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmwbj\" (UniqueName: \"kubernetes.io/projected/fd797ee9-bdfe-44b4-9c87-54dc23575e8e-kube-api-access-vmwbj\") pod \"node-exporter-cth5d\" (UID: \"fd797ee9-bdfe-44b4-9c87-54dc23575e8e\") " pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:56.694877 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:56.694769 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cth5d" Jun 01 20:36:57.460683 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:36:57.460654 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd797ee9_bdfe_44b4_9c87_54dc23575e8e.slice/crio-49f40a8b8864941b33340ef78e1fdf270691043cba4b34d53e2d485b2a6b611a WatchSource:0}: Error finding container 49f40a8b8864941b33340ef78e1fdf270691043cba4b34d53e2d485b2a6b611a: Status 404 returned error can't find the container with id 49f40a8b8864941b33340ef78e1fdf270691043cba4b34d53e2d485b2a6b611a Jun 01 20:36:57.838341 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:57.838252 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-62qdf" event={"ID":"767443fd-16fc-4ca9-8d7f-987c1da9217a","Type":"ContainerStarted","Data":"e14ce9744e201ac9d59edc1cd8d7404a01fec76054117613b2dac02244cae245"} Jun 01 20:36:57.838758 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:57.838717 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-62qdf" Jun 01 20:36:57.840750 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:57.840714 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cth5d" event={"ID":"fd797ee9-bdfe-44b4-9c87-54dc23575e8e","Type":"ContainerStarted","Data":"49f40a8b8864941b33340ef78e1fdf270691043cba4b34d53e2d485b2a6b611a"} Jun 01 20:36:57.846264 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:57.846226 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-62qdf" Jun 01 20:36:57.856743 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:57.856328 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-62qdf" podStartSLOduration=1.475429713 podStartE2EDuration="17.856312292s" podCreationTimestamp="2026-06-01 20:36:40 +0000 UTC" firstStartedPulling="2026-06-01 20:36:41.172074684 +0000 UTC m=+149.420373947" lastFinishedPulling="2026-06-01 20:36:57.552957248 +0000 UTC m=+165.801256526" observedRunningTime="2026-06-01 20:36:57.854552235 +0000 UTC m=+166.102851523" watchObservedRunningTime="2026-06-01 20:36:57.856312292 +0000 UTC m=+166.104611580" Jun 01 20:36:58.845758 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:58.845680 2561 generic.go:358] "Generic (PLEG): container finished" podID="fd797ee9-bdfe-44b4-9c87-54dc23575e8e" containerID="84d7b43de458c8404c920f103f5692fcf06c5ff0ee4afa94b81b45b9ba226dfc" exitCode=0 Jun 01 20:36:58.846179 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:58.845889 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cth5d" event={"ID":"fd797ee9-bdfe-44b4-9c87-54dc23575e8e","Type":"ContainerDied","Data":"84d7b43de458c8404c920f103f5692fcf06c5ff0ee4afa94b81b45b9ba226dfc"} Jun 01 20:36:59.380076 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.380036 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8599ff694f-96zk8"] Jun 01 20:36:59.387195 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.387163 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.390400 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.390207 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b7jsfenb4f85s\"" Jun 01 20:36:59.391184 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.391160 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6vklg\"" Jun 01 20:36:59.391429 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.391409 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 01 20:36:59.391518 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.391493 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 01 20:36:59.391518 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.391498 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 01 20:36:59.391648 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.391506 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 01 20:36:59.391797 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.391781 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 01 20:36:59.396018 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.395988 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8599ff694f-96zk8"] Jun 01 20:36:59.546951 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.546913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.547138 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.547044 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-metrics-client-ca\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.547138 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.547094 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-grpc-tls\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.547138 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.547130 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnkmb\" (UniqueName: \"kubernetes.io/projected/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-kube-api-access-pnkmb\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.547299 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.547164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.547299 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.547195 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.547299 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.547263 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-tls\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.547429 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.547380 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.648452 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.648359 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.648452 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.648437 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-metrics-client-ca\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.648701 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.648476 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-grpc-tls\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.648701 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.648509 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnkmb\" (UniqueName: \"kubernetes.io/projected/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-kube-api-access-pnkmb\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.648701 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.648542 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.648701 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.648574 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.648701 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.648647 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-tls\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.648952 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.648732 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.649577 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.649522 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-metrics-client-ca\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.652056 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.651935 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.652672 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.652238 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-grpc-tls\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.652672 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.652597 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.653435 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.653411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.653766 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.653742 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-tls\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.653846 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.653805 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.657444 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.657420 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnkmb\" (UniqueName: \"kubernetes.io/projected/48f0bd24-cdf3-4106-bb31-f3c2e2313fcf-kube-api-access-pnkmb\") pod \"thanos-querier-8599ff694f-96zk8\" (UID: \"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf\") " pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.702398 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.702361 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:36:59.852122 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.852078 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cth5d" event={"ID":"fd797ee9-bdfe-44b4-9c87-54dc23575e8e","Type":"ContainerStarted","Data":"a02606f629b12a2609e0935f2d7833f51f151f436e2db3556ebd9530c407dcb2"} Jun 01 20:36:59.852122 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.852129 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cth5d" event={"ID":"fd797ee9-bdfe-44b4-9c87-54dc23575e8e","Type":"ContainerStarted","Data":"3536898b9ac39937bf4a56579779cf6c118d7d1cbd356f620ae7cf9fc5073708"} Jun 01 20:36:59.868260 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.868206 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8599ff694f-96zk8"] Jun 01 20:36:59.872420 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:36:59.872367 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cth5d" podStartSLOduration=2.856369328 podStartE2EDuration="3.872348204s" podCreationTimestamp="2026-06-01 20:36:56 +0000 UTC" firstStartedPulling="2026-06-01 20:36:57.462785872 +0000 UTC m=+165.711085141" lastFinishedPulling="2026-06-01 20:36:58.478764749 +0000 UTC m=+166.727064017" observedRunningTime="2026-06-01 20:36:59.871145949 +0000 UTC m=+168.119445235" watchObservedRunningTime="2026-06-01 20:36:59.872348204 +0000 UTC m=+168.120647494" Jun 01 20:37:00.857348 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:00.857304 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" event={"ID":"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf","Type":"ContainerStarted","Data":"1e5b2481a8fe5f8b5cc3b4b9b22567489fa04d7bff0bdc50566b50c958bef33c"} Jun 01 20:37:01.185599 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:01.185520 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq"] Jun 01 20:37:01.217177 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:01.217122 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq"] Jun 01 20:37:01.217333 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:01.217267 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq" Jun 01 20:37:01.219953 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:01.219930 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-52mn5\"" Jun 01 20:37:01.220078 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:01.219987 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 01 20:37:01.363931 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:01.363899 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8ea95b8-4140-4d89-82ff-b985794cd773-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-8b2wq\" (UID: \"a8ea95b8-4140-4d89-82ff-b985794cd773\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq" Jun 01 20:37:01.464968 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:01.464896 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8ea95b8-4140-4d89-82ff-b985794cd773-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-8b2wq\" (UID: \"a8ea95b8-4140-4d89-82ff-b985794cd773\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq" Jun 01 20:37:01.468059 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:01.468034 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8ea95b8-4140-4d89-82ff-b985794cd773-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-8b2wq\" (UID: \"a8ea95b8-4140-4d89-82ff-b985794cd773\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq" Jun 01 20:37:01.532175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:01.532136 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq" Jun 01 20:37:01.681678 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:01.681592 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq"] Jun 01 20:37:02.384253 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.384209 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-75c4bd57c5-g45dc"] Jun 01 20:37:02.393519 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:37:02.393487 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ea95b8_4140_4d89_82ff_b985794cd773.slice/crio-96225edc810d3602f774217058d5fd3aa0175ffd4d2f2121da41f5601828191d WatchSource:0}: Error finding container 96225edc810d3602f774217058d5fd3aa0175ffd4d2f2121da41f5601828191d: Status 404 returned error can't find the container with id 96225edc810d3602f774217058d5fd3aa0175ffd4d2f2121da41f5601828191d Jun 01 20:37:02.409745 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.409708 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75c4bd57c5-g45dc"] Jun 01 20:37:02.409863 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.409836 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.411846 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.411814 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hg7dv\"" Jun 01 20:37:02.412419 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.412137 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 01 20:37:02.412419 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.412148 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 01 20:37:02.412419 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.412151 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 01 20:37:02.412419 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.412404 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 01 20:37:02.412707 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.412404 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 01 20:37:02.417167 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.417145 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 01 20:37:02.577784 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.577750 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-service-ca\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.577971 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.577795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-serving-cert\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.577971 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.577833 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-oauth-config\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.577971 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.577927 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-console-config\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.577971 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.577963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-trusted-ca-bundle\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.578179 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.578033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-oauth-serving-cert\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.578179 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.578064 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5x9j\" (UniqueName: \"kubernetes.io/projected/76fd132a-5a53-473a-b076-18631a405d6c-kube-api-access-r5x9j\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.678977 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.678897 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-service-ca\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.678977 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.678939 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-serving-cert\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.679191 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.678980 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-oauth-config\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.679191 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.679054 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-console-config\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.679191 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.679091 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-trusted-ca-bundle\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.679191 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.679115 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-oauth-serving-cert\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.679191 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.679146 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5x9j\" (UniqueName: \"kubernetes.io/projected/76fd132a-5a53-473a-b076-18631a405d6c-kube-api-access-r5x9j\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.679915 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.679730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-service-ca\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.679915 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.679782 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-console-config\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.680114 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.680064 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-oauth-serving-cert\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.680431 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.680406 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-trusted-ca-bundle\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.682246 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.682221 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-oauth-config\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.682467 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.682441 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-serving-cert\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.692939 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.692909 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5x9j\" (UniqueName: \"kubernetes.io/projected/76fd132a-5a53-473a-b076-18631a405d6c-kube-api-access-r5x9j\") pod \"console-75c4bd57c5-g45dc\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.722033 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.721806 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:02.786570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.786547 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c66656f99-87l5s" Jun 01 20:37:02.867197 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.867129 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq" event={"ID":"a8ea95b8-4140-4d89-82ff-b985794cd773","Type":"ContainerStarted","Data":"96225edc810d3602f774217058d5fd3aa0175ffd4d2f2121da41f5601828191d"} Jun 01 20:37:02.955717 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:02.955676 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75c4bd57c5-g45dc"] Jun 01 20:37:02.960343 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:37:02.960301 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76fd132a_5a53_473a_b076_18631a405d6c.slice/crio-2b3824746366056b3a1e5942648d7efac2e47ac8aca6b6668275eebefb9c0c7a WatchSource:0}: Error finding container 2b3824746366056b3a1e5942648d7efac2e47ac8aca6b6668275eebefb9c0c7a: Status 404 returned error can't find the container with id 2b3824746366056b3a1e5942648d7efac2e47ac8aca6b6668275eebefb9c0c7a Jun 01 20:37:03.875575 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:03.875491 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" event={"ID":"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf","Type":"ContainerStarted","Data":"bd9adb02322653e3ed6a7f717d1c26ab6dc60159d139776e288d113cf8901633"} Jun 01 20:37:03.875575 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:03.875537 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" event={"ID":"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf","Type":"ContainerStarted","Data":"11ab6c638a729fdf903f17842d081f12898bc6461eceaab73e4c654af00cdaee"} Jun 01 20:37:03.875575 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:03.875551 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" event={"ID":"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf","Type":"ContainerStarted","Data":"048a62ee227a277ece1f242ef8a17081f1e8209cef19dabd710a94d234deba74"} Jun 01 20:37:03.878213 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:03.878161 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c4bd57c5-g45dc" event={"ID":"76fd132a-5a53-473a-b076-18631a405d6c","Type":"ContainerStarted","Data":"2b3824746366056b3a1e5942648d7efac2e47ac8aca6b6668275eebefb9c0c7a"} Jun 01 20:37:05.720829 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:37:05.720776 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vjnlg" podUID="62c63df5-42a6-417b-a170-cab4a4e85c2a" Jun 01 20:37:05.735956 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:37:05.735912 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-xk4vw" podUID="e2c491b3-caaf-4355-abbb-f8767dc02bbc" Jun 01 20:37:05.739995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:05.739954 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" podUID="4c176036-c9e0-42c9-bdf8-23edd49632fc" containerName="registry" containerID="cri-o://62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5" gracePeriod=30 Jun 01 20:37:05.884754 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:05.884722 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vjnlg" Jun 01 20:37:06.287435 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:37:06.287393 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2kqdx" podUID="81a6c9fa-0e20-455d-b262-0711156022fe" Jun 01 20:37:06.658287 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.658257 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:37:06.726771 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.726746 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-certificates\") pod \"4c176036-c9e0-42c9-bdf8-23edd49632fc\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " Jun 01 20:37:06.727245 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.727162 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4c176036-c9e0-42c9-bdf8-23edd49632fc" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:37:06.827503 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.827433 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-image-registry-private-configuration\") pod \"4c176036-c9e0-42c9-bdf8-23edd49632fc\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " Jun 01 20:37:06.827503 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.827474 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rpvs\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-kube-api-access-4rpvs\") pod \"4c176036-c9e0-42c9-bdf8-23edd49632fc\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " Jun 01 20:37:06.827503 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.827506 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-installation-pull-secrets\") pod \"4c176036-c9e0-42c9-bdf8-23edd49632fc\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " Jun 01 20:37:06.827841 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.827616 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls\") pod \"4c176036-c9e0-42c9-bdf8-23edd49632fc\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " Jun 01 20:37:06.827841 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.827741 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c176036-c9e0-42c9-bdf8-23edd49632fc-ca-trust-extracted\") pod \"4c176036-c9e0-42c9-bdf8-23edd49632fc\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " Jun 01 20:37:06.827841 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.827809 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-trusted-ca\") pod \"4c176036-c9e0-42c9-bdf8-23edd49632fc\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " Jun 01 20:37:06.827841 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.827837 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-bound-sa-token\") pod \"4c176036-c9e0-42c9-bdf8-23edd49632fc\" (UID: \"4c176036-c9e0-42c9-bdf8-23edd49632fc\") " Jun 01 20:37:06.828166 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.828143 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-certificates\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:37:06.828942 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.828912 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4c176036-c9e0-42c9-bdf8-23edd49632fc" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:37:06.829933 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.829900 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4c176036-c9e0-42c9-bdf8-23edd49632fc" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 01 20:37:06.830024 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.829966 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4c176036-c9e0-42c9-bdf8-23edd49632fc" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:37:06.830098 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.830074 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4c176036-c9e0-42c9-bdf8-23edd49632fc" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 01 20:37:06.830155 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.830075 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-kube-api-access-4rpvs" (OuterVolumeSpecName: "kube-api-access-4rpvs") pod "4c176036-c9e0-42c9-bdf8-23edd49632fc" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc"). InnerVolumeSpecName "kube-api-access-4rpvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:37:06.830320 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.830306 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4c176036-c9e0-42c9-bdf8-23edd49632fc" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:37:06.836054 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.836026 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c176036-c9e0-42c9-bdf8-23edd49632fc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4c176036-c9e0-42c9-bdf8-23edd49632fc" (UID: "4c176036-c9e0-42c9-bdf8-23edd49632fc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:37:06.888971 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.888941 2561 generic.go:358] "Generic (PLEG): container finished" podID="4c176036-c9e0-42c9-bdf8-23edd49632fc" containerID="62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5" exitCode=0 Jun 01 20:37:06.889086 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.888982 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" event={"ID":"4c176036-c9e0-42c9-bdf8-23edd49632fc","Type":"ContainerDied","Data":"62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5"} Jun 01 20:37:06.889086 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.889013 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" Jun 01 20:37:06.889086 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.889024 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7544b464c-n2ttg" event={"ID":"4c176036-c9e0-42c9-bdf8-23edd49632fc","Type":"ContainerDied","Data":"4fe1e3d1c6b64dcc92761d6dab2e9c0f535e29145f97356a13984baa42212054"} Jun 01 20:37:06.889086 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.889048 2561 scope.go:117] "RemoveContainer" containerID="62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5" Jun 01 20:37:06.891765 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.891740 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" event={"ID":"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf","Type":"ContainerStarted","Data":"f501d7f2f792b1060af3df3a53b4a2f117347b2fe72a9f34d979ebe337e3e82d"} Jun 01 20:37:06.891870 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.891771 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" event={"ID":"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf","Type":"ContainerStarted","Data":"66e3046acb1024e4a2c8a68d1b26d58eb203b1625c6e8134ac93f27dc2bcf5dc"} Jun 01 20:37:06.894321 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.894298 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq" event={"ID":"a8ea95b8-4140-4d89-82ff-b985794cd773","Type":"ContainerStarted","Data":"e6e85532294ba8b572fe083ce693048f008b56b0b7c08e2f19f85cdb58c3caee"} Jun 01 20:37:06.898212 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.898188 2561 scope.go:117] "RemoveContainer" containerID="62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5" Jun 01 20:37:06.898487 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:37:06.898466 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5\": container with ID starting with 62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5 not found: ID does not exist" containerID="62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5" Jun 01 20:37:06.898563 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.898493 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5"} err="failed to get container status \"62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5\": rpc error: code = NotFound desc = could not find container \"62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5\": container with ID starting with 62aeb69601dc4e34c62f0a58a17e21cf843cd527ec638f5bb788987eb30defd5 not found: ID does not exist" Jun 01 20:37:06.910256 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.910237 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7544b464c-n2ttg"] Jun 01 20:37:06.913090 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.913069 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7544b464c-n2ttg"] Jun 01 20:37:06.928777 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.928753 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-image-registry-private-configuration\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:37:06.928777 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.928774 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rpvs\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-kube-api-access-4rpvs\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:37:06.928874 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.928786 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4c176036-c9e0-42c9-bdf8-23edd49632fc-installation-pull-secrets\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:37:06.928874 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.928796 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-registry-tls\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:37:06.928874 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.928805 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4c176036-c9e0-42c9-bdf8-23edd49632fc-ca-trust-extracted\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:37:06.928874 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.928813 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c176036-c9e0-42c9-bdf8-23edd49632fc-trusted-ca\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:37:06.928874 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.928822 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4c176036-c9e0-42c9-bdf8-23edd49632fc-bound-sa-token\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:37:06.934118 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.934074 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq" podStartSLOduration=1.845291005 podStartE2EDuration="5.934061366s" podCreationTimestamp="2026-06-01 20:37:01 +0000 UTC" firstStartedPulling="2026-06-01 20:37:02.396178852 +0000 UTC m=+170.644478117" lastFinishedPulling="2026-06-01 20:37:06.484949206 +0000 UTC m=+174.733248478" observedRunningTime="2026-06-01 20:37:06.933614615 +0000 UTC m=+175.181913901" watchObservedRunningTime="2026-06-01 20:37:06.934061366 +0000 UTC m=+175.182360653" Jun 01 20:37:06.948201 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.948179 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq" Jun 01 20:37:06.948308 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:06.948243 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8b2wq" Jun 01 20:37:07.900589 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:07.900505 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" event={"ID":"48f0bd24-cdf3-4106-bb31-f3c2e2313fcf","Type":"ContainerStarted","Data":"55d5419cf6c0e321a3da8eded8296e5b0aa495edb25a4b9463dfb691ec79ac49"} Jun 01 20:37:07.901082 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:07.900729 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:37:07.901936 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:07.901910 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c4bd57c5-g45dc" event={"ID":"76fd132a-5a53-473a-b076-18631a405d6c","Type":"ContainerStarted","Data":"03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51"} Jun 01 20:37:07.925100 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:07.925055 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" podStartSLOduration=2.316674157 podStartE2EDuration="8.925041127s" podCreationTimestamp="2026-06-01 20:36:59 +0000 UTC" firstStartedPulling="2026-06-01 20:36:59.876580993 +0000 UTC m=+168.124880259" lastFinishedPulling="2026-06-01 20:37:06.484947959 +0000 UTC m=+174.733247229" observedRunningTime="2026-06-01 20:37:07.923516231 +0000 UTC m=+176.171815516" watchObservedRunningTime="2026-06-01 20:37:07.925041127 +0000 UTC m=+176.173340427" Jun 01 20:37:07.939759 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:07.939722 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-75c4bd57c5-g45dc" podStartSLOduration=2.004304641 podStartE2EDuration="5.939711418s" podCreationTimestamp="2026-06-01 20:37:02 +0000 UTC" firstStartedPulling="2026-06-01 20:37:02.962744322 +0000 UTC m=+171.211043587" lastFinishedPulling="2026-06-01 20:37:06.898151095 +0000 UTC m=+175.146450364" observedRunningTime="2026-06-01 20:37:07.938934062 +0000 UTC m=+176.187233349" watchObservedRunningTime="2026-06-01 20:37:07.939711418 +0000 UTC m=+176.188010758" Jun 01 20:37:08.276377 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:08.276347 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c176036-c9e0-42c9-bdf8-23edd49632fc" path="/var/lib/kubelet/pods/4c176036-c9e0-42c9-bdf8-23edd49632fc/volumes" Jun 01 20:37:08.910456 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:08.910430 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8599ff694f-96zk8" Jun 01 20:37:10.653066 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:10.653028 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:37:10.653440 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:10.653118 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:37:10.655411 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:10.655391 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/62c63df5-42a6-417b-a170-cab4a4e85c2a-metrics-tls\") pod \"dns-default-vjnlg\" (UID: \"62c63df5-42a6-417b-a170-cab4a4e85c2a\") " pod="openshift-dns/dns-default-vjnlg" Jun 01 20:37:10.655483 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:10.655467 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2c491b3-caaf-4355-abbb-f8767dc02bbc-cert\") pod \"ingress-canary-xk4vw\" (UID: \"e2c491b3-caaf-4355-abbb-f8767dc02bbc\") " pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:37:10.687339 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:10.687312 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rq65\"" Jun 01 20:37:10.695939 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:10.695915 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vjnlg" Jun 01 20:37:10.813605 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:10.813574 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vjnlg"] Jun 01 20:37:10.816609 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:37:10.816573 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c63df5_42a6_417b_a170_cab4a4e85c2a.slice/crio-dc81b7ed58a9c68af372844fd23d51cce9ac8ac7683183b6843d1a2b27175951 WatchSource:0}: Error finding container dc81b7ed58a9c68af372844fd23d51cce9ac8ac7683183b6843d1a2b27175951: Status 404 returned error can't find the container with id dc81b7ed58a9c68af372844fd23d51cce9ac8ac7683183b6843d1a2b27175951 Jun 01 20:37:10.912684 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:10.912583 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjnlg" event={"ID":"62c63df5-42a6-417b-a170-cab4a4e85c2a","Type":"ContainerStarted","Data":"dc81b7ed58a9c68af372844fd23d51cce9ac8ac7683183b6843d1a2b27175951"} Jun 01 20:37:12.722184 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:12.722108 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:12.722184 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:12.722154 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:12.726790 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:12.726766 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:12.924029 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:12.923991 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:37:13.923362 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:13.923327 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjnlg" event={"ID":"62c63df5-42a6-417b-a170-cab4a4e85c2a","Type":"ContainerStarted","Data":"a5f910e4e2ae9eccbe2b56b6581c7741ea1102a22822d5741eb276a3e150001c"} Jun 01 20:37:13.923362 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:13.923367 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjnlg" event={"ID":"62c63df5-42a6-417b-a170-cab4a4e85c2a","Type":"ContainerStarted","Data":"d63f39a7558d2b316103ec5bc0910617c132416a4a3f994becedf2ebdb5a8215"} Jun 01 20:37:13.939006 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:13.938961 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-vjnlg" podStartSLOduration=129.88577499 podStartE2EDuration="2m11.938947815s" podCreationTimestamp="2026-06-01 20:35:02 +0000 UTC" firstStartedPulling="2026-06-01 20:37:10.819097698 +0000 UTC m=+179.067396975" lastFinishedPulling="2026-06-01 20:37:12.872270521 +0000 UTC m=+181.120569800" observedRunningTime="2026-06-01 20:37:13.937119786 +0000 UTC m=+182.185419071" watchObservedRunningTime="2026-06-01 20:37:13.938947815 +0000 UTC m=+182.187247098" Jun 01 20:37:14.926606 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:14.926579 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vjnlg" Jun 01 20:37:18.273429 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:18.273396 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:37:20.276832 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:20.276802 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:37:20.278888 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:20.278869 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rzs9n\"" Jun 01 20:37:20.287255 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:20.287240 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xk4vw" Jun 01 20:37:20.408207 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:20.408173 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xk4vw"] Jun 01 20:37:20.411204 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:37:20.411176 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c491b3_caaf_4355_abbb_f8767dc02bbc.slice/crio-66e6429889d0006e2914fb97661de1684600abd032c3bdfe88b1617c2526b4ab WatchSource:0}: Error finding container 66e6429889d0006e2914fb97661de1684600abd032c3bdfe88b1617c2526b4ab: Status 404 returned error can't find the container with id 66e6429889d0006e2914fb97661de1684600abd032c3bdfe88b1617c2526b4ab Jun 01 20:37:20.945226 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:20.945186 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xk4vw" event={"ID":"e2c491b3-caaf-4355-abbb-f8767dc02bbc","Type":"ContainerStarted","Data":"66e6429889d0006e2914fb97661de1684600abd032c3bdfe88b1617c2526b4ab"} Jun 01 20:37:22.952301 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:22.952269 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xk4vw" event={"ID":"e2c491b3-caaf-4355-abbb-f8767dc02bbc","Type":"ContainerStarted","Data":"a00f3646ed2d1a9d17879f38aca1f813b5588e550c8c331622487ec1da24a410"} Jun 01 20:37:22.965226 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:22.965180 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xk4vw" podStartSLOduration=139.250386259 podStartE2EDuration="2m20.965168217s" podCreationTimestamp="2026-06-01 20:35:02 +0000 UTC" firstStartedPulling="2026-06-01 20:37:20.413177886 +0000 UTC m=+188.661477151" lastFinishedPulling="2026-06-01 20:37:22.127959845 +0000 UTC m=+190.376259109" observedRunningTime="2026-06-01 20:37:22.964603385 +0000 UTC m=+191.212902673" watchObservedRunningTime="2026-06-01 20:37:22.965168217 +0000 UTC m=+191.213467502" Jun 01 20:37:24.932074 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:24.932042 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vjnlg" Jun 01 20:37:32.045054 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:32.045020 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xk4vw_e2c491b3-caaf-4355-abbb-f8767dc02bbc/serve-healthcheck-canary/0.log" Jun 01 20:37:43.010362 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:43.010329 2561 generic.go:358] "Generic (PLEG): container finished" podID="6710a661-ae89-40c4-b4c5-5ab71d659495" containerID="f84176f39d3dea064510d6f06b047556bc9452050772aaa9b1a322547797e139" exitCode=0 Jun 01 20:37:43.010809 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:43.010398 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" event={"ID":"6710a661-ae89-40c4-b4c5-5ab71d659495","Type":"ContainerDied","Data":"f84176f39d3dea064510d6f06b047556bc9452050772aaa9b1a322547797e139"} Jun 01 20:37:43.010809 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:43.010773 2561 scope.go:117] "RemoveContainer" containerID="f84176f39d3dea064510d6f06b047556bc9452050772aaa9b1a322547797e139" Jun 01 20:37:44.015374 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:44.015345 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-8nwjp" event={"ID":"6710a661-ae89-40c4-b4c5-5ab71d659495","Type":"ContainerStarted","Data":"f9f4f4e9348a7efd88c4680225fe664a72b817cd04e22ff4d5ac2658b8202ad2"} Jun 01 20:37:48.027853 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:48.027822 2561 generic.go:358] "Generic (PLEG): container finished" podID="2b70d650-c8dc-4bd2-ba65-eaff1e51937e" containerID="7d2937ab11c9e753021b4a9f4f584afbeae8bcfbf088aaabaf9c5b459abd166c" exitCode=0 Jun 01 20:37:48.028255 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:48.027895 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" event={"ID":"2b70d650-c8dc-4bd2-ba65-eaff1e51937e","Type":"ContainerDied","Data":"7d2937ab11c9e753021b4a9f4f584afbeae8bcfbf088aaabaf9c5b459abd166c"} Jun 01 20:37:48.028255 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:48.028229 2561 scope.go:117] "RemoveContainer" containerID="7d2937ab11c9e753021b4a9f4f584afbeae8bcfbf088aaabaf9c5b459abd166c" Jun 01 20:37:49.032613 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:37:49.032577 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-clz2x" event={"ID":"2b70d650-c8dc-4bd2-ba65-eaff1e51937e","Type":"ContainerStarted","Data":"1007b51d8649a033cd8bd783f8411aeb7e132110722b77a72a82525cfcdaf00a"} Jun 01 20:38:23.170996 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:23.170958 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:38:23.173377 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:23.173353 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81a6c9fa-0e20-455d-b262-0711156022fe-metrics-certs\") pod \"network-metrics-daemon-2kqdx\" (UID: \"81a6c9fa-0e20-455d-b262-0711156022fe\") " pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:38:23.376986 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:23.376951 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gkzmp\"" Jun 01 20:38:23.384617 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:23.384594 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2kqdx" Jun 01 20:38:23.505166 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:23.505135 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2kqdx"] Jun 01 20:38:23.508194 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:38:23.508165 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a6c9fa_0e20_455d_b262_0711156022fe.slice/crio-cc70ac66fef858eb7cffd0d92e1ec10e330f3c57b62ef962f9e08c9467f28101 WatchSource:0}: Error finding container cc70ac66fef858eb7cffd0d92e1ec10e330f3c57b62ef962f9e08c9467f28101: Status 404 returned error can't find the container with id cc70ac66fef858eb7cffd0d92e1ec10e330f3c57b62ef962f9e08c9467f28101 Jun 01 20:38:24.137941 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:24.137854 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2kqdx" event={"ID":"81a6c9fa-0e20-455d-b262-0711156022fe","Type":"ContainerStarted","Data":"cc70ac66fef858eb7cffd0d92e1ec10e330f3c57b62ef962f9e08c9467f28101"} Jun 01 20:38:25.876875 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.876843 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c6f4bdb5f-42sb8"] Jun 01 20:38:25.877204 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.877140 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c176036-c9e0-42c9-bdf8-23edd49632fc" containerName="registry" Jun 01 20:38:25.877204 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.877152 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c176036-c9e0-42c9-bdf8-23edd49632fc" containerName="registry" Jun 01 20:38:25.877289 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.877206 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c176036-c9e0-42c9-bdf8-23edd49632fc" containerName="registry" Jun 01 20:38:25.880214 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.880193 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:25.887665 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.887638 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6f4bdb5f-42sb8"] Jun 01 20:38:25.993495 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.993460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-config\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:25.993683 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.993528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdvc5\" (UniqueName: \"kubernetes.io/projected/287b8552-0fa3-41c5-bd73-5792f1f525c8-kube-api-access-jdvc5\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:25.993683 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.993595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-oauth-serving-cert\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:25.993683 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.993655 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-trusted-ca-bundle\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:25.993683 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.993678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-serving-cert\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:25.993817 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.993696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-service-ca\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:25.993817 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:25.993712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-oauth-config\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.094926 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.094893 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-oauth-serving-cert\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.094926 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.094932 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-trusted-ca-bundle\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.095152 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.094952 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-serving-cert\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.095152 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.094970 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-service-ca\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.095152 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.094995 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-oauth-config\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.095152 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.095029 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-config\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.095152 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.095087 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdvc5\" (UniqueName: \"kubernetes.io/projected/287b8552-0fa3-41c5-bd73-5792f1f525c8-kube-api-access-jdvc5\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.095877 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.095738 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-oauth-serving-cert\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.095877 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.095840 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-trusted-ca-bundle\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.095877 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.095847 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-config\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.096042 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.095847 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-service-ca\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.097436 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.097419 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-oauth-config\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.097529 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.097511 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-serving-cert\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.101866 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.101843 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdvc5\" (UniqueName: \"kubernetes.io/projected/287b8552-0fa3-41c5-bd73-5792f1f525c8-kube-api-access-jdvc5\") pod \"console-5c6f4bdb5f-42sb8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.191374 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.191300 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:26.315753 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:26.315720 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6f4bdb5f-42sb8"] Jun 01 20:38:26.318610 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:38:26.318583 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287b8552_0fa3_41c5_bd73_5792f1f525c8.slice/crio-0af18bdda965045074699d870c7a21ab96fce5fd40a00672cfea1c23747fd32c WatchSource:0}: Error finding container 0af18bdda965045074699d870c7a21ab96fce5fd40a00672cfea1c23747fd32c: Status 404 returned error can't find the container with id 0af18bdda965045074699d870c7a21ab96fce5fd40a00672cfea1c23747fd32c Jun 01 20:38:27.148943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:27.148902 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2kqdx" event={"ID":"81a6c9fa-0e20-455d-b262-0711156022fe","Type":"ContainerStarted","Data":"d765cab076e7efaf2d7092907902b1c4c11041c8b73c5401f6b67d8d7c72a39f"} Jun 01 20:38:27.149360 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:27.148951 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2kqdx" event={"ID":"81a6c9fa-0e20-455d-b262-0711156022fe","Type":"ContainerStarted","Data":"e31c4283c75e0fdabb6c96ec25e5ed8eca2ff9b83dcbfc4c1f2ec7a974ef94d9"} Jun 01 20:38:27.150239 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:27.150215 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6f4bdb5f-42sb8" event={"ID":"287b8552-0fa3-41c5-bd73-5792f1f525c8","Type":"ContainerStarted","Data":"5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50"} Jun 01 20:38:27.150334 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:27.150243 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6f4bdb5f-42sb8" event={"ID":"287b8552-0fa3-41c5-bd73-5792f1f525c8","Type":"ContainerStarted","Data":"0af18bdda965045074699d870c7a21ab96fce5fd40a00672cfea1c23747fd32c"} Jun 01 20:38:27.164513 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:27.164470 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2kqdx" podStartSLOduration=252.031960544 podStartE2EDuration="4m15.164458395s" podCreationTimestamp="2026-06-01 20:34:12 +0000 UTC" firstStartedPulling="2026-06-01 20:38:23.509979237 +0000 UTC m=+251.758278501" lastFinishedPulling="2026-06-01 20:38:26.642477079 +0000 UTC m=+254.890776352" observedRunningTime="2026-06-01 20:38:27.162906933 +0000 UTC m=+255.411206230" watchObservedRunningTime="2026-06-01 20:38:27.164458395 +0000 UTC m=+255.412757717" Jun 01 20:38:27.177224 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:27.177183 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5c6f4bdb5f-42sb8" podStartSLOduration=2.177169276 podStartE2EDuration="2.177169276s" podCreationTimestamp="2026-06-01 20:38:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 20:38:27.176827977 +0000 UTC m=+255.425127267" watchObservedRunningTime="2026-06-01 20:38:27.177169276 +0000 UTC m=+255.425468563" Jun 01 20:38:36.192079 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.192045 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:36.192460 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.192090 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:36.196933 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.196910 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:36.667462 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.667426 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6f4bdb5f-42sb8"] Jun 01 20:38:36.696065 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.696034 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-759cccfc49-q9xvg"] Jun 01 20:38:36.699385 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.699368 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.709136 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.709105 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759cccfc49-q9xvg"] Jun 01 20:38:36.782659 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.782603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-trusted-ca-bundle\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.782659 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.782662 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-oauth-config\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.782858 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.782707 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-serving-cert\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.782858 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.782735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-config\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.782858 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.782752 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-oauth-serving-cert\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.782858 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.782795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-service-ca\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.782858 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.782816 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dwsn\" (UniqueName: \"kubernetes.io/projected/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-kube-api-access-8dwsn\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.883406 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.883363 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-service-ca\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.883590 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.883419 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dwsn\" (UniqueName: \"kubernetes.io/projected/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-kube-api-access-8dwsn\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.883590 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.883458 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-trusted-ca-bundle\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.883590 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.883481 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-oauth-config\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.883590 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.883510 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-serving-cert\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.883590 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.883550 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-config\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.883590 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.883570 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-oauth-serving-cert\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.884490 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.884459 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-service-ca\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.884681 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.884605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-oauth-serving-cert\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.884772 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.884713 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-trusted-ca-bundle\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.885376 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.885348 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-config\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.889944 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.886611 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-serving-cert\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.889944 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.886736 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-oauth-config\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:36.891668 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:36.891647 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dwsn\" (UniqueName: \"kubernetes.io/projected/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-kube-api-access-8dwsn\") pod \"console-759cccfc49-q9xvg\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:37.010525 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:37.010483 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:37.137274 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:37.137150 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759cccfc49-q9xvg"] Jun 01 20:38:37.139991 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:38:37.139958 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02273e74_51f0_4ed8_ac1c_bfcf59ae63a9.slice/crio-c8a193aec44a74ad0c765ddfc51b09f545d47c26498004e4c72d89592272364c WatchSource:0}: Error finding container c8a193aec44a74ad0c765ddfc51b09f545d47c26498004e4c72d89592272364c: Status 404 returned error can't find the container with id c8a193aec44a74ad0c765ddfc51b09f545d47c26498004e4c72d89592272364c Jun 01 20:38:37.178785 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:37.178754 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759cccfc49-q9xvg" event={"ID":"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9","Type":"ContainerStarted","Data":"c8a193aec44a74ad0c765ddfc51b09f545d47c26498004e4c72d89592272364c"} Jun 01 20:38:37.182802 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:37.182782 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:38:38.183933 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:38.183898 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759cccfc49-q9xvg" event={"ID":"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9","Type":"ContainerStarted","Data":"4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb"} Jun 01 20:38:38.200609 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:38.200569 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-759cccfc49-q9xvg" podStartSLOduration=2.200552628 podStartE2EDuration="2.200552628s" podCreationTimestamp="2026-06-01 20:38:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 20:38:38.198317105 +0000 UTC m=+266.446616391" watchObservedRunningTime="2026-06-01 20:38:38.200552628 +0000 UTC m=+266.448851914" Jun 01 20:38:47.010833 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:47.010797 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:47.010833 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:47.010843 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:47.015380 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:47.015357 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:47.214155 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:47.214130 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:38:47.247313 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:38:47.247280 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75c4bd57c5-g45dc"] Jun 01 20:39:03.203396 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.203346 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5c6f4bdb5f-42sb8" podUID="287b8552-0fa3-41c5-bd73-5792f1f525c8" containerName="console" containerID="cri-o://5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50" gracePeriod=15 Jun 01 20:39:03.458873 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.458850 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c6f4bdb5f-42sb8_287b8552-0fa3-41c5-bd73-5792f1f525c8/console/0.log" Jun 01 20:39:03.459002 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.458926 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:39:03.606933 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.606896 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdvc5\" (UniqueName: \"kubernetes.io/projected/287b8552-0fa3-41c5-bd73-5792f1f525c8-kube-api-access-jdvc5\") pod \"287b8552-0fa3-41c5-bd73-5792f1f525c8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " Jun 01 20:39:03.607103 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.606947 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-serving-cert\") pod \"287b8552-0fa3-41c5-bd73-5792f1f525c8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " Jun 01 20:39:03.607103 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.606967 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-config\") pod \"287b8552-0fa3-41c5-bd73-5792f1f525c8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " Jun 01 20:39:03.607103 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.606983 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-oauth-serving-cert\") pod \"287b8552-0fa3-41c5-bd73-5792f1f525c8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " Jun 01 20:39:03.607250 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.607104 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-trusted-ca-bundle\") pod \"287b8552-0fa3-41c5-bd73-5792f1f525c8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " Jun 01 20:39:03.607331 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.607309 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-oauth-config\") pod \"287b8552-0fa3-41c5-bd73-5792f1f525c8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " Jun 01 20:39:03.607392 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.607355 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-service-ca\") pod \"287b8552-0fa3-41c5-bd73-5792f1f525c8\" (UID: \"287b8552-0fa3-41c5-bd73-5792f1f525c8\") " Jun 01 20:39:03.607456 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.607423 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-config" (OuterVolumeSpecName: "console-config") pod "287b8552-0fa3-41c5-bd73-5792f1f525c8" (UID: "287b8552-0fa3-41c5-bd73-5792f1f525c8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:39:03.607599 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.607585 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-config\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:03.607728 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.607695 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "287b8552-0fa3-41c5-bd73-5792f1f525c8" (UID: "287b8552-0fa3-41c5-bd73-5792f1f525c8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:39:03.607831 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.607746 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "287b8552-0fa3-41c5-bd73-5792f1f525c8" (UID: "287b8552-0fa3-41c5-bd73-5792f1f525c8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:39:03.607831 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.607742 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-service-ca" (OuterVolumeSpecName: "service-ca") pod "287b8552-0fa3-41c5-bd73-5792f1f525c8" (UID: "287b8552-0fa3-41c5-bd73-5792f1f525c8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:39:03.609312 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.609286 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "287b8552-0fa3-41c5-bd73-5792f1f525c8" (UID: "287b8552-0fa3-41c5-bd73-5792f1f525c8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 01 20:39:03.609522 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.609505 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "287b8552-0fa3-41c5-bd73-5792f1f525c8" (UID: "287b8552-0fa3-41c5-bd73-5792f1f525c8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 01 20:39:03.609671 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.609650 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/287b8552-0fa3-41c5-bd73-5792f1f525c8-kube-api-access-jdvc5" (OuterVolumeSpecName: "kube-api-access-jdvc5") pod "287b8552-0fa3-41c5-bd73-5792f1f525c8" (UID: "287b8552-0fa3-41c5-bd73-5792f1f525c8"). InnerVolumeSpecName "kube-api-access-jdvc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:39:03.708256 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.708200 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-serving-cert\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:03.708256 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.708249 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-oauth-serving-cert\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:03.708256 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.708260 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-trusted-ca-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:03.708256 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.708278 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/287b8552-0fa3-41c5-bd73-5792f1f525c8-console-oauth-config\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:03.708529 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.708288 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/287b8552-0fa3-41c5-bd73-5792f1f525c8-service-ca\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:03.708529 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:03.708298 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdvc5\" (UniqueName: \"kubernetes.io/projected/287b8552-0fa3-41c5-bd73-5792f1f525c8-kube-api-access-jdvc5\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:04.271214 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:04.271186 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c6f4bdb5f-42sb8_287b8552-0fa3-41c5-bd73-5792f1f525c8/console/0.log" Jun 01 20:39:04.271644 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:04.271226 2561 generic.go:358] "Generic (PLEG): container finished" podID="287b8552-0fa3-41c5-bd73-5792f1f525c8" containerID="5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50" exitCode=2 Jun 01 20:39:04.271644 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:04.271298 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6f4bdb5f-42sb8" event={"ID":"287b8552-0fa3-41c5-bd73-5792f1f525c8","Type":"ContainerDied","Data":"5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50"} Jun 01 20:39:04.271644 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:04.271313 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6f4bdb5f-42sb8" Jun 01 20:39:04.271644 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:04.271324 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6f4bdb5f-42sb8" event={"ID":"287b8552-0fa3-41c5-bd73-5792f1f525c8","Type":"ContainerDied","Data":"0af18bdda965045074699d870c7a21ab96fce5fd40a00672cfea1c23747fd32c"} Jun 01 20:39:04.271644 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:04.271338 2561 scope.go:117] "RemoveContainer" containerID="5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50" Jun 01 20:39:04.281190 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:04.281169 2561 scope.go:117] "RemoveContainer" containerID="5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50" Jun 01 20:39:04.281408 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:39:04.281378 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50\": container with ID starting with 5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50 not found: ID does not exist" containerID="5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50" Jun 01 20:39:04.281454 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:04.281416 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50"} err="failed to get container status \"5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50\": rpc error: code = NotFound desc = could not find container \"5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50\": container with ID starting with 5105c053c5c1a59085a20d1562b5f4e64033ed53c4ed617bbdb2e8cd29369d50 not found: ID does not exist" Jun 01 20:39:04.292421 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:04.292398 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6f4bdb5f-42sb8"] Jun 01 20:39:04.295494 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:04.295473 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c6f4bdb5f-42sb8"] Jun 01 20:39:06.261289 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.261254 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gxsq2"] Jun 01 20:39:06.261689 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.261570 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287b8552-0fa3-41c5-bd73-5792f1f525c8" containerName="console" Jun 01 20:39:06.261689 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.261582 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="287b8552-0fa3-41c5-bd73-5792f1f525c8" containerName="console" Jun 01 20:39:06.261689 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.261660 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="287b8552-0fa3-41c5-bd73-5792f1f525c8" containerName="console" Jun 01 20:39:06.267285 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.267266 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxsq2" Jun 01 20:39:06.269191 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.269155 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 01 20:39:06.269817 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.269777 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gxsq2"] Jun 01 20:39:06.278795 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.278773 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="287b8552-0fa3-41c5-bd73-5792f1f525c8" path="/var/lib/kubelet/pods/287b8552-0fa3-41c5-bd73-5792f1f525c8/volumes" Jun 01 20:39:06.326456 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.326427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08b2ef89-0cc9-4dc6-af22-b19d4910c08d-kubelet-config\") pod \"global-pull-secret-syncer-gxsq2\" (UID: \"08b2ef89-0cc9-4dc6-af22-b19d4910c08d\") " pod="kube-system/global-pull-secret-syncer-gxsq2" Jun 01 20:39:06.326607 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.326504 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08b2ef89-0cc9-4dc6-af22-b19d4910c08d-original-pull-secret\") pod \"global-pull-secret-syncer-gxsq2\" (UID: \"08b2ef89-0cc9-4dc6-af22-b19d4910c08d\") " pod="kube-system/global-pull-secret-syncer-gxsq2" Jun 01 20:39:06.326607 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.326540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08b2ef89-0cc9-4dc6-af22-b19d4910c08d-dbus\") pod \"global-pull-secret-syncer-gxsq2\" (UID: \"08b2ef89-0cc9-4dc6-af22-b19d4910c08d\") " pod="kube-system/global-pull-secret-syncer-gxsq2" Jun 01 20:39:06.427304 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.427265 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08b2ef89-0cc9-4dc6-af22-b19d4910c08d-original-pull-secret\") pod \"global-pull-secret-syncer-gxsq2\" (UID: \"08b2ef89-0cc9-4dc6-af22-b19d4910c08d\") " pod="kube-system/global-pull-secret-syncer-gxsq2" Jun 01 20:39:06.427458 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.427314 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08b2ef89-0cc9-4dc6-af22-b19d4910c08d-dbus\") pod \"global-pull-secret-syncer-gxsq2\" (UID: \"08b2ef89-0cc9-4dc6-af22-b19d4910c08d\") " pod="kube-system/global-pull-secret-syncer-gxsq2" Jun 01 20:39:06.427458 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.427345 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08b2ef89-0cc9-4dc6-af22-b19d4910c08d-kubelet-config\") pod \"global-pull-secret-syncer-gxsq2\" (UID: \"08b2ef89-0cc9-4dc6-af22-b19d4910c08d\") " pod="kube-system/global-pull-secret-syncer-gxsq2" Jun 01 20:39:06.427567 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.427476 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08b2ef89-0cc9-4dc6-af22-b19d4910c08d-kubelet-config\") pod \"global-pull-secret-syncer-gxsq2\" (UID: \"08b2ef89-0cc9-4dc6-af22-b19d4910c08d\") " pod="kube-system/global-pull-secret-syncer-gxsq2" Jun 01 20:39:06.427567 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.427513 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08b2ef89-0cc9-4dc6-af22-b19d4910c08d-dbus\") pod \"global-pull-secret-syncer-gxsq2\" (UID: \"08b2ef89-0cc9-4dc6-af22-b19d4910c08d\") " pod="kube-system/global-pull-secret-syncer-gxsq2" Jun 01 20:39:06.429661 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.429639 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08b2ef89-0cc9-4dc6-af22-b19d4910c08d-original-pull-secret\") pod \"global-pull-secret-syncer-gxsq2\" (UID: \"08b2ef89-0cc9-4dc6-af22-b19d4910c08d\") " pod="kube-system/global-pull-secret-syncer-gxsq2" Jun 01 20:39:06.577497 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.577427 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxsq2" Jun 01 20:39:06.698872 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:06.698716 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gxsq2"] Jun 01 20:39:06.701689 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:39:06.701659 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b2ef89_0cc9_4dc6_af22_b19d4910c08d.slice/crio-75807c126d7d539ee175891c154f0af1f0d4cc33c84670b7bb0059d114dc0524 WatchSource:0}: Error finding container 75807c126d7d539ee175891c154f0af1f0d4cc33c84670b7bb0059d114dc0524: Status 404 returned error can't find the container with id 75807c126d7d539ee175891c154f0af1f0d4cc33c84670b7bb0059d114dc0524 Jun 01 20:39:07.282103 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:07.282068 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gxsq2" event={"ID":"08b2ef89-0cc9-4dc6-af22-b19d4910c08d","Type":"ContainerStarted","Data":"75807c126d7d539ee175891c154f0af1f0d4cc33c84670b7bb0059d114dc0524"} Jun 01 20:39:12.190192 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.190163 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:39:12.191541 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.191515 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:39:12.200421 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.200403 2561 kubelet.go:1628] "Image garbage collection succeeded" Jun 01 20:39:12.271348 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.271121 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-75c4bd57c5-g45dc" podUID="76fd132a-5a53-473a-b076-18631a405d6c" containerName="console" containerID="cri-o://03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51" gracePeriod=15 Jun 01 20:39:12.299398 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.299354 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gxsq2" event={"ID":"08b2ef89-0cc9-4dc6-af22-b19d4910c08d","Type":"ContainerStarted","Data":"432ea9bf8b4667c58778614366a6e73949ac237bc65cbf9798263d04ae740ffa"} Jun 01 20:39:12.313081 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.313025 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gxsq2" podStartSLOduration=1.03264747 podStartE2EDuration="6.313010546s" podCreationTimestamp="2026-06-01 20:39:06 +0000 UTC" firstStartedPulling="2026-06-01 20:39:06.703545083 +0000 UTC m=+294.951844347" lastFinishedPulling="2026-06-01 20:39:11.983908148 +0000 UTC m=+300.232207423" observedRunningTime="2026-06-01 20:39:12.311650496 +0000 UTC m=+300.559949788" watchObservedRunningTime="2026-06-01 20:39:12.313010546 +0000 UTC m=+300.561309831" Jun 01 20:39:12.527751 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.527690 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75c4bd57c5-g45dc_76fd132a-5a53-473a-b076-18631a405d6c/console/0.log" Jun 01 20:39:12.527870 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.527753 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:39:12.573524 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.573484 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-console-config\") pod \"76fd132a-5a53-473a-b076-18631a405d6c\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " Jun 01 20:39:12.573721 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.573541 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5x9j\" (UniqueName: \"kubernetes.io/projected/76fd132a-5a53-473a-b076-18631a405d6c-kube-api-access-r5x9j\") pod \"76fd132a-5a53-473a-b076-18631a405d6c\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " Jun 01 20:39:12.573721 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.573557 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-oauth-serving-cert\") pod \"76fd132a-5a53-473a-b076-18631a405d6c\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " Jun 01 20:39:12.573721 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.573581 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-trusted-ca-bundle\") pod \"76fd132a-5a53-473a-b076-18631a405d6c\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " Jun 01 20:39:12.573721 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.573614 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-oauth-config\") pod \"76fd132a-5a53-473a-b076-18631a405d6c\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " Jun 01 20:39:12.573721 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.573703 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-serving-cert\") pod \"76fd132a-5a53-473a-b076-18631a405d6c\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " Jun 01 20:39:12.573986 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.573757 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-service-ca\") pod \"76fd132a-5a53-473a-b076-18631a405d6c\" (UID: \"76fd132a-5a53-473a-b076-18631a405d6c\") " Jun 01 20:39:12.574042 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.573985 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-console-config" (OuterVolumeSpecName: "console-config") pod "76fd132a-5a53-473a-b076-18631a405d6c" (UID: "76fd132a-5a53-473a-b076-18631a405d6c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:39:12.574094 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.574044 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "76fd132a-5a53-473a-b076-18631a405d6c" (UID: "76fd132a-5a53-473a-b076-18631a405d6c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:39:12.574135 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.573998 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "76fd132a-5a53-473a-b076-18631a405d6c" (UID: "76fd132a-5a53-473a-b076-18631a405d6c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:39:12.574197 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.574183 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-service-ca" (OuterVolumeSpecName: "service-ca") pod "76fd132a-5a53-473a-b076-18631a405d6c" (UID: "76fd132a-5a53-473a-b076-18631a405d6c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:39:12.576098 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.576073 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76fd132a-5a53-473a-b076-18631a405d6c-kube-api-access-r5x9j" (OuterVolumeSpecName: "kube-api-access-r5x9j") pod "76fd132a-5a53-473a-b076-18631a405d6c" (UID: "76fd132a-5a53-473a-b076-18631a405d6c"). InnerVolumeSpecName "kube-api-access-r5x9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:39:12.576193 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.576092 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "76fd132a-5a53-473a-b076-18631a405d6c" (UID: "76fd132a-5a53-473a-b076-18631a405d6c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 01 20:39:12.576193 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.576154 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "76fd132a-5a53-473a-b076-18631a405d6c" (UID: "76fd132a-5a53-473a-b076-18631a405d6c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 01 20:39:12.674683 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.674645 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-serving-cert\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:12.674683 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.674682 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-service-ca\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:12.674897 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.674695 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-console-config\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:12.674897 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.674704 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5x9j\" (UniqueName: \"kubernetes.io/projected/76fd132a-5a53-473a-b076-18631a405d6c-kube-api-access-r5x9j\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:12.674897 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.674714 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-oauth-serving-cert\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:12.674897 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.674723 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76fd132a-5a53-473a-b076-18631a405d6c-trusted-ca-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:12.674897 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:12.674731 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76fd132a-5a53-473a-b076-18631a405d6c-console-oauth-config\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:39:13.303167 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:13.303133 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75c4bd57c5-g45dc_76fd132a-5a53-473a-b076-18631a405d6c/console/0.log" Jun 01 20:39:13.303662 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:13.303179 2561 generic.go:358] "Generic (PLEG): container finished" podID="76fd132a-5a53-473a-b076-18631a405d6c" containerID="03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51" exitCode=2 Jun 01 20:39:13.303662 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:13.303245 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c4bd57c5-g45dc" Jun 01 20:39:13.303662 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:13.303266 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c4bd57c5-g45dc" event={"ID":"76fd132a-5a53-473a-b076-18631a405d6c","Type":"ContainerDied","Data":"03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51"} Jun 01 20:39:13.303662 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:13.303298 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c4bd57c5-g45dc" event={"ID":"76fd132a-5a53-473a-b076-18631a405d6c","Type":"ContainerDied","Data":"2b3824746366056b3a1e5942648d7efac2e47ac8aca6b6668275eebefb9c0c7a"} Jun 01 20:39:13.303662 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:13.303313 2561 scope.go:117] "RemoveContainer" containerID="03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51" Jun 01 20:39:13.311960 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:13.311942 2561 scope.go:117] "RemoveContainer" containerID="03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51" Jun 01 20:39:13.312200 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:39:13.312180 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51\": container with ID starting with 03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51 not found: ID does not exist" containerID="03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51" Jun 01 20:39:13.312259 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:13.312213 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51"} err="failed to get container status \"03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51\": rpc error: code = NotFound desc = could not find container \"03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51\": container with ID starting with 03db31a13da5f82c95b8b29da0abf15e512532f2bb82c589757807c1ea95ce51 not found: ID does not exist" Jun 01 20:39:13.322808 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:13.322783 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75c4bd57c5-g45dc"] Jun 01 20:39:13.325602 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:13.325579 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75c4bd57c5-g45dc"] Jun 01 20:39:14.276977 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:39:14.276940 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76fd132a-5a53-473a-b076-18631a405d6c" path="/var/lib/kubelet/pods/76fd132a-5a53-473a-b076-18631a405d6c/volumes" Jun 01 20:41:03.465277 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.465242 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk"] Jun 01 20:41:03.465793 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.465571 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76fd132a-5a53-473a-b076-18631a405d6c" containerName="console" Jun 01 20:41:03.465793 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.465582 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="76fd132a-5a53-473a-b076-18631a405d6c" containerName="console" Jun 01 20:41:03.465793 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.465666 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="76fd132a-5a53-473a-b076-18631a405d6c" containerName="console" Jun 01 20:41:03.468659 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.468641 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:03.471128 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.471100 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 01 20:41:03.471262 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.471100 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 01 20:41:03.472041 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.472002 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8bssn\"" Jun 01 20:41:03.484813 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.484783 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk"] Jun 01 20:41:03.554576 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.554534 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:03.554780 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.554596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzhrf\" (UniqueName: \"kubernetes.io/projected/828d61bd-c5c7-4430-879c-be96b26f0262-kube-api-access-gzhrf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:03.554780 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.554665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:03.655227 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.655189 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzhrf\" (UniqueName: \"kubernetes.io/projected/828d61bd-c5c7-4430-879c-be96b26f0262-kube-api-access-gzhrf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:03.655397 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.655240 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:03.655397 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.655281 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:03.655645 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.655611 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:03.655693 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.655670 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:03.663369 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.663343 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzhrf\" (UniqueName: \"kubernetes.io/projected/828d61bd-c5c7-4430-879c-be96b26f0262-kube-api-access-gzhrf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:03.779242 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.779146 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:03.902981 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.902950 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk"] Jun 01 20:41:03.905025 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:41:03.904993 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828d61bd_c5c7_4430_879c_be96b26f0262.slice/crio-4d915961116cc7e9b1faafbde5f4fd048aafd3e2dbe025fe203077b26544caa0 WatchSource:0}: Error finding container 4d915961116cc7e9b1faafbde5f4fd048aafd3e2dbe025fe203077b26544caa0: Status 404 returned error can't find the container with id 4d915961116cc7e9b1faafbde5f4fd048aafd3e2dbe025fe203077b26544caa0 Jun 01 20:41:03.907157 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:03.907138 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 01 20:41:04.634350 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:04.634316 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" event={"ID":"828d61bd-c5c7-4430-879c-be96b26f0262","Type":"ContainerStarted","Data":"4d915961116cc7e9b1faafbde5f4fd048aafd3e2dbe025fe203077b26544caa0"} Jun 01 20:41:17.676480 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:17.676438 2561 generic.go:358] "Generic (PLEG): container finished" podID="828d61bd-c5c7-4430-879c-be96b26f0262" containerID="8efdacd1b4618c943e2b7c4c2e04b42d55f4e9a6e0fc043a18813e7646677ebc" exitCode=0 Jun 01 20:41:17.676965 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:17.676529 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" event={"ID":"828d61bd-c5c7-4430-879c-be96b26f0262","Type":"ContainerDied","Data":"8efdacd1b4618c943e2b7c4c2e04b42d55f4e9a6e0fc043a18813e7646677ebc"} Jun 01 20:41:20.687202 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:20.687105 2561 generic.go:358] "Generic (PLEG): container finished" podID="828d61bd-c5c7-4430-879c-be96b26f0262" containerID="b8be3a54388e43b4f4f22658f161cad18cea04eff61cb71a8723890901b12a55" exitCode=0 Jun 01 20:41:20.687202 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:20.687168 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" event={"ID":"828d61bd-c5c7-4430-879c-be96b26f0262","Type":"ContainerDied","Data":"b8be3a54388e43b4f4f22658f161cad18cea04eff61cb71a8723890901b12a55"} Jun 01 20:41:34.734609 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:34.734569 2561 generic.go:358] "Generic (PLEG): container finished" podID="828d61bd-c5c7-4430-879c-be96b26f0262" containerID="694ac6b317c299d12e52dcfd44cad666094bb56a6ceaf0aff2a961c1afbe6837" exitCode=0 Jun 01 20:41:34.735077 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:34.734662 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" event={"ID":"828d61bd-c5c7-4430-879c-be96b26f0262","Type":"ContainerDied","Data":"694ac6b317c299d12e52dcfd44cad666094bb56a6ceaf0aff2a961c1afbe6837"} Jun 01 20:41:35.869193 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:35.869173 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:35.907793 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:35.907760 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-util\") pod \"828d61bd-c5c7-4430-879c-be96b26f0262\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " Jun 01 20:41:35.907957 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:35.907809 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-bundle\") pod \"828d61bd-c5c7-4430-879c-be96b26f0262\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " Jun 01 20:41:35.907957 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:35.907837 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzhrf\" (UniqueName: \"kubernetes.io/projected/828d61bd-c5c7-4430-879c-be96b26f0262-kube-api-access-gzhrf\") pod \"828d61bd-c5c7-4430-879c-be96b26f0262\" (UID: \"828d61bd-c5c7-4430-879c-be96b26f0262\") " Jun 01 20:41:35.908456 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:35.908429 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-bundle" (OuterVolumeSpecName: "bundle") pod "828d61bd-c5c7-4430-879c-be96b26f0262" (UID: "828d61bd-c5c7-4430-879c-be96b26f0262"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:41:35.910085 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:35.910062 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/828d61bd-c5c7-4430-879c-be96b26f0262-kube-api-access-gzhrf" (OuterVolumeSpecName: "kube-api-access-gzhrf") pod "828d61bd-c5c7-4430-879c-be96b26f0262" (UID: "828d61bd-c5c7-4430-879c-be96b26f0262"). InnerVolumeSpecName "kube-api-access-gzhrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:41:35.912178 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:35.912155 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-util" (OuterVolumeSpecName: "util") pod "828d61bd-c5c7-4430-879c-be96b26f0262" (UID: "828d61bd-c5c7-4430-879c-be96b26f0262"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:41:36.008716 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:36.008605 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzhrf\" (UniqueName: \"kubernetes.io/projected/828d61bd-c5c7-4430-879c-be96b26f0262-kube-api-access-gzhrf\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:41:36.008716 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:36.008658 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-util\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:41:36.008716 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:36.008671 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/828d61bd-c5c7-4430-879c-be96b26f0262-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:41:36.742761 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:36.742731 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" event={"ID":"828d61bd-c5c7-4430-879c-be96b26f0262","Type":"ContainerDied","Data":"4d915961116cc7e9b1faafbde5f4fd048aafd3e2dbe025fe203077b26544caa0"} Jun 01 20:41:36.742919 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:36.742767 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d915961116cc7e9b1faafbde5f4fd048aafd3e2dbe025fe203077b26544caa0" Jun 01 20:41:36.742919 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:36.742780 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddcvgk" Jun 01 20:41:45.589857 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.589814 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9"] Jun 01 20:41:45.590316 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.590246 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="828d61bd-c5c7-4430-879c-be96b26f0262" containerName="util" Jun 01 20:41:45.590316 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.590264 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="828d61bd-c5c7-4430-879c-be96b26f0262" containerName="util" Jun 01 20:41:45.590316 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.590285 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="828d61bd-c5c7-4430-879c-be96b26f0262" containerName="extract" Jun 01 20:41:45.590316 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.590292 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="828d61bd-c5c7-4430-879c-be96b26f0262" containerName="extract" Jun 01 20:41:45.590316 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.590305 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="828d61bd-c5c7-4430-879c-be96b26f0262" containerName="pull" Jun 01 20:41:45.590316 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.590314 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="828d61bd-c5c7-4430-879c-be96b26f0262" containerName="pull" Jun 01 20:41:45.590613 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.590395 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="828d61bd-c5c7-4430-879c-be96b26f0262" containerName="extract" Jun 01 20:41:45.593001 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.592978 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:45.595206 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.595182 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8bssn\"" Jun 01 20:41:45.595322 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.595212 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 01 20:41:45.595575 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.595558 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 01 20:41:45.599081 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.599063 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9"] Jun 01 20:41:45.684870 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.684835 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:45.685019 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.684900 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:45.685019 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.684938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzckl\" (UniqueName: \"kubernetes.io/projected/a39e882f-e658-4275-aac3-740447da1794-kube-api-access-xzckl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:45.785508 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.785475 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:45.785697 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.785546 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:45.785697 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.785580 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzckl\" (UniqueName: \"kubernetes.io/projected/a39e882f-e658-4275-aac3-740447da1794-kube-api-access-xzckl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:45.785879 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.785860 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:45.785917 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.785890 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:45.794955 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.794933 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzckl\" (UniqueName: \"kubernetes.io/projected/a39e882f-e658-4275-aac3-740447da1794-kube-api-access-xzckl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:45.902775 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:45.902690 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:46.025257 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:46.025227 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9"] Jun 01 20:41:46.028179 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:41:46.028152 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39e882f_e658_4275_aac3_740447da1794.slice/crio-9b88aa534178688e349599f9170aa63ccbebbd5b538ac6aadbb7b5fef4e2588c WatchSource:0}: Error finding container 9b88aa534178688e349599f9170aa63ccbebbd5b538ac6aadbb7b5fef4e2588c: Status 404 returned error can't find the container with id 9b88aa534178688e349599f9170aa63ccbebbd5b538ac6aadbb7b5fef4e2588c Jun 01 20:41:46.771372 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:46.771336 2561 generic.go:358] "Generic (PLEG): container finished" podID="a39e882f-e658-4275-aac3-740447da1794" containerID="9245e15b906728a07c078cde570cd6492ee36e715fa3298b27aef43f1aaf2bed" exitCode=0 Jun 01 20:41:46.771862 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:46.771384 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" event={"ID":"a39e882f-e658-4275-aac3-740447da1794","Type":"ContainerDied","Data":"9245e15b906728a07c078cde570cd6492ee36e715fa3298b27aef43f1aaf2bed"} Jun 01 20:41:46.771862 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:46.771407 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" event={"ID":"a39e882f-e658-4275-aac3-740447da1794","Type":"ContainerStarted","Data":"9b88aa534178688e349599f9170aa63ccbebbd5b538ac6aadbb7b5fef4e2588c"} Jun 01 20:41:47.979098 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:47.979057 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-9dbb9"] Jun 01 20:41:47.982423 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:47.982400 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-9dbb9" Jun 01 20:41:47.984365 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:47.984345 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 01 20:41:47.984845 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:47.984828 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jlprr\"" Jun 01 20:41:47.984921 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:47.984835 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 01 20:41:47.990945 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:47.990920 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-9dbb9"] Jun 01 20:41:48.104437 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:48.104396 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfkz6\" (UniqueName: \"kubernetes.io/projected/4ce1df31-b54f-459e-81b9-3fbe3050cdbb-kube-api-access-rfkz6\") pod \"cert-manager-cainjector-68b757865b-9dbb9\" (UID: \"4ce1df31-b54f-459e-81b9-3fbe3050cdbb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-9dbb9" Jun 01 20:41:48.104603 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:48.104460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ce1df31-b54f-459e-81b9-3fbe3050cdbb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-9dbb9\" (UID: \"4ce1df31-b54f-459e-81b9-3fbe3050cdbb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-9dbb9" Jun 01 20:41:48.205604 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:48.205564 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfkz6\" (UniqueName: \"kubernetes.io/projected/4ce1df31-b54f-459e-81b9-3fbe3050cdbb-kube-api-access-rfkz6\") pod \"cert-manager-cainjector-68b757865b-9dbb9\" (UID: \"4ce1df31-b54f-459e-81b9-3fbe3050cdbb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-9dbb9" Jun 01 20:41:48.205805 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:48.205646 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ce1df31-b54f-459e-81b9-3fbe3050cdbb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-9dbb9\" (UID: \"4ce1df31-b54f-459e-81b9-3fbe3050cdbb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-9dbb9" Jun 01 20:41:48.212866 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:48.212838 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ce1df31-b54f-459e-81b9-3fbe3050cdbb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-9dbb9\" (UID: \"4ce1df31-b54f-459e-81b9-3fbe3050cdbb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-9dbb9" Jun 01 20:41:48.213061 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:48.213037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfkz6\" (UniqueName: \"kubernetes.io/projected/4ce1df31-b54f-459e-81b9-3fbe3050cdbb-kube-api-access-rfkz6\") pod \"cert-manager-cainjector-68b757865b-9dbb9\" (UID: \"4ce1df31-b54f-459e-81b9-3fbe3050cdbb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-9dbb9" Jun 01 20:41:48.301050 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:48.300978 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-9dbb9" Jun 01 20:41:48.430791 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:48.430757 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-9dbb9"] Jun 01 20:41:48.435023 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:41:48.434985 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ce1df31_b54f_459e_81b9_3fbe3050cdbb.slice/crio-45427d18ce10d85932b20b6017729a6eaa667d965e9f73bf4c05b915b1dd35d4 WatchSource:0}: Error finding container 45427d18ce10d85932b20b6017729a6eaa667d965e9f73bf4c05b915b1dd35d4: Status 404 returned error can't find the container with id 45427d18ce10d85932b20b6017729a6eaa667d965e9f73bf4c05b915b1dd35d4 Jun 01 20:41:48.779961 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:48.779924 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-9dbb9" event={"ID":"4ce1df31-b54f-459e-81b9-3fbe3050cdbb","Type":"ContainerStarted","Data":"45427d18ce10d85932b20b6017729a6eaa667d965e9f73bf4c05b915b1dd35d4"} Jun 01 20:41:49.784809 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:49.784723 2561 generic.go:358] "Generic (PLEG): container finished" podID="a39e882f-e658-4275-aac3-740447da1794" containerID="88cbe32d4442f97cb7d301dc4baaff031316e33688dc0fd05c3208b73dfb3057" exitCode=0 Jun 01 20:41:49.785132 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:49.784808 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" event={"ID":"a39e882f-e658-4275-aac3-740447da1794","Type":"ContainerDied","Data":"88cbe32d4442f97cb7d301dc4baaff031316e33688dc0fd05c3208b73dfb3057"} Jun 01 20:41:50.790530 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:50.790490 2561 generic.go:358] "Generic (PLEG): container finished" podID="a39e882f-e658-4275-aac3-740447da1794" containerID="9869128d8ee7db33f3c66884f6827890eeb48c7aae2d415725064e2abc728ee5" exitCode=0 Jun 01 20:41:50.790995 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:50.790589 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" event={"ID":"a39e882f-e658-4275-aac3-740447da1794","Type":"ContainerDied","Data":"9869128d8ee7db33f3c66884f6827890eeb48c7aae2d415725064e2abc728ee5"} Jun 01 20:41:51.939683 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.939659 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:51.975024 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.974995 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-pgj6h"] Jun 01 20:41:51.975345 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.975328 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39e882f-e658-4275-aac3-740447da1794" containerName="extract" Jun 01 20:41:51.975345 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.975347 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39e882f-e658-4275-aac3-740447da1794" containerName="extract" Jun 01 20:41:51.975501 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.975367 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39e882f-e658-4275-aac3-740447da1794" containerName="util" Jun 01 20:41:51.975501 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.975377 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39e882f-e658-4275-aac3-740447da1794" containerName="util" Jun 01 20:41:51.975501 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.975395 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39e882f-e658-4275-aac3-740447da1794" containerName="pull" Jun 01 20:41:51.975501 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.975404 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39e882f-e658-4275-aac3-740447da1794" containerName="pull" Jun 01 20:41:51.975501 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.975475 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="a39e882f-e658-4275-aac3-740447da1794" containerName="extract" Jun 01 20:41:51.979021 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.979000 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" Jun 01 20:41:51.980931 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.980909 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-v4dl8\"" Jun 01 20:41:51.987808 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:51.987784 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-pgj6h"] Jun 01 20:41:52.034074 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.034046 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-util\") pod \"a39e882f-e658-4275-aac3-740447da1794\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " Jun 01 20:41:52.034200 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.034124 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzckl\" (UniqueName: \"kubernetes.io/projected/a39e882f-e658-4275-aac3-740447da1794-kube-api-access-xzckl\") pod \"a39e882f-e658-4275-aac3-740447da1794\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " Jun 01 20:41:52.034200 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.034181 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-bundle\") pod \"a39e882f-e658-4275-aac3-740447da1794\" (UID: \"a39e882f-e658-4275-aac3-740447da1794\") " Jun 01 20:41:52.034357 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.034337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrt2l\" (UniqueName: \"kubernetes.io/projected/fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9-kube-api-access-rrt2l\") pod \"cert-manager-webhook-587ccfb98-pgj6h\" (UID: \"fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" Jun 01 20:41:52.034444 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.034428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-pgj6h\" (UID: \"fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" Jun 01 20:41:52.034570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.034547 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-bundle" (OuterVolumeSpecName: "bundle") pod "a39e882f-e658-4275-aac3-740447da1794" (UID: "a39e882f-e658-4275-aac3-740447da1794"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:41:52.036149 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.036125 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39e882f-e658-4275-aac3-740447da1794-kube-api-access-xzckl" (OuterVolumeSpecName: "kube-api-access-xzckl") pod "a39e882f-e658-4275-aac3-740447da1794" (UID: "a39e882f-e658-4275-aac3-740447da1794"). InnerVolumeSpecName "kube-api-access-xzckl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:41:52.038809 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.038782 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-util" (OuterVolumeSpecName: "util") pod "a39e882f-e658-4275-aac3-740447da1794" (UID: "a39e882f-e658-4275-aac3-740447da1794"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:41:52.135201 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.135106 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrt2l\" (UniqueName: \"kubernetes.io/projected/fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9-kube-api-access-rrt2l\") pod \"cert-manager-webhook-587ccfb98-pgj6h\" (UID: \"fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" Jun 01 20:41:52.135201 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.135180 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-pgj6h\" (UID: \"fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" Jun 01 20:41:52.135410 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.135237 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-util\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:41:52.135410 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.135253 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzckl\" (UniqueName: \"kubernetes.io/projected/a39e882f-e658-4275-aac3-740447da1794-kube-api-access-xzckl\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:41:52.135410 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.135268 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39e882f-e658-4275-aac3-740447da1794-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:41:52.145483 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.145460 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-pgj6h\" (UID: \"fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" Jun 01 20:41:52.145671 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.145648 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrt2l\" (UniqueName: \"kubernetes.io/projected/fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9-kube-api-access-rrt2l\") pod \"cert-manager-webhook-587ccfb98-pgj6h\" (UID: \"fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9\") " pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" Jun 01 20:41:52.288606 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.288583 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" Jun 01 20:41:52.413750 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.413598 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-pgj6h"] Jun 01 20:41:52.416161 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:41:52.416128 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe8ed6d9_3bb4_48b9_9496_ae84de73d4e9.slice/crio-9e3f32321d09366c746ef30ca2b495dc39ef23b2306366a51763e2a92052fc07 WatchSource:0}: Error finding container 9e3f32321d09366c746ef30ca2b495dc39ef23b2306366a51763e2a92052fc07: Status 404 returned error can't find the container with id 9e3f32321d09366c746ef30ca2b495dc39ef23b2306366a51763e2a92052fc07 Jun 01 20:41:52.798052 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.798008 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" event={"ID":"a39e882f-e658-4275-aac3-740447da1794","Type":"ContainerDied","Data":"9b88aa534178688e349599f9170aa63ccbebbd5b538ac6aadbb7b5fef4e2588c"} Jun 01 20:41:52.798052 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.798055 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b88aa534178688e349599f9170aa63ccbebbd5b538ac6aadbb7b5fef4e2588c" Jun 01 20:41:52.798288 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.798030 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7h7r9" Jun 01 20:41:52.799198 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:52.799168 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" event={"ID":"fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9","Type":"ContainerStarted","Data":"9e3f32321d09366c746ef30ca2b495dc39ef23b2306366a51763e2a92052fc07"} Jun 01 20:41:55.814052 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:55.814014 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-9dbb9" event={"ID":"4ce1df31-b54f-459e-81b9-3fbe3050cdbb","Type":"ContainerStarted","Data":"f0dd005445103525a83faae0e280fd1df9a680b4cb9ba62c68428acfa7d6b786"} Jun 01 20:41:55.815391 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:55.815367 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" event={"ID":"fe8ed6d9-3bb4-48b9-9496-ae84de73d4e9","Type":"ContainerStarted","Data":"df304ed64040bdf6adcbd9f49e7dfb866c98a54bd735314e075ab257fe24dadf"} Jun 01 20:41:55.820195 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:55.815961 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" Jun 01 20:41:55.831926 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:55.831876 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-9dbb9" podStartSLOduration=2.490714511 podStartE2EDuration="8.831862219s" podCreationTimestamp="2026-06-01 20:41:47 +0000 UTC" firstStartedPulling="2026-06-01 20:41:48.437469436 +0000 UTC m=+456.685768707" lastFinishedPulling="2026-06-01 20:41:54.778617143 +0000 UTC m=+463.026916415" observedRunningTime="2026-06-01 20:41:55.830907307 +0000 UTC m=+464.079206603" watchObservedRunningTime="2026-06-01 20:41:55.831862219 +0000 UTC m=+464.080161501" Jun 01 20:41:55.846444 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:41:55.846390 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" podStartSLOduration=2.357883752 podStartE2EDuration="4.846376513s" podCreationTimestamp="2026-06-01 20:41:51 +0000 UTC" firstStartedPulling="2026-06-01 20:41:52.418268399 +0000 UTC m=+460.666567663" lastFinishedPulling="2026-06-01 20:41:54.906761157 +0000 UTC m=+463.155060424" observedRunningTime="2026-06-01 20:41:55.844346358 +0000 UTC m=+464.092645643" watchObservedRunningTime="2026-06-01 20:41:55.846376513 +0000 UTC m=+464.094675800" Jun 01 20:42:01.822460 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:01.822425 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-pgj6h" Jun 01 20:42:10.818935 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.818894 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf"] Jun 01 20:42:10.823291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.823269 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:10.828433 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.828408 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8bssn\"" Jun 01 20:42:10.828617 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.828409 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 01 20:42:10.828725 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.828409 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 01 20:42:10.828725 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.828426 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf"] Jun 01 20:42:10.888844 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.888808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr75v\" (UniqueName: \"kubernetes.io/projected/6eb00224-ae3e-43c3-a30b-b133682d1e18-kube-api-access-pr75v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:10.889012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.888860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:10.889012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.888938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:10.990343 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.990314 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:10.990500 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.990402 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pr75v\" (UniqueName: \"kubernetes.io/projected/6eb00224-ae3e-43c3-a30b-b133682d1e18-kube-api-access-pr75v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:10.990500 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.990448 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:10.990778 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.990757 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:10.990821 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.990773 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:10.997832 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:10.997800 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr75v\" (UniqueName: \"kubernetes.io/projected/6eb00224-ae3e-43c3-a30b-b133682d1e18-kube-api-access-pr75v\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:11.133781 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:11.133700 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:11.258858 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:11.258833 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf"] Jun 01 20:42:11.261014 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:42:11.260976 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb00224_ae3e_43c3_a30b_b133682d1e18.slice/crio-8ab33dcb35299d655aeff8d5a1375129bdebf8c2e8cada9985cd2e83a73ea765 WatchSource:0}: Error finding container 8ab33dcb35299d655aeff8d5a1375129bdebf8c2e8cada9985cd2e83a73ea765: Status 404 returned error can't find the container with id 8ab33dcb35299d655aeff8d5a1375129bdebf8c2e8cada9985cd2e83a73ea765 Jun 01 20:42:11.869179 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:11.869146 2561 generic.go:358] "Generic (PLEG): container finished" podID="6eb00224-ae3e-43c3-a30b-b133682d1e18" containerID="4decf9bd5badfa721c560577702515bb14cd195a775bbf8b68b3cffa072340dc" exitCode=0 Jun 01 20:42:11.869556 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:11.869228 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" event={"ID":"6eb00224-ae3e-43c3-a30b-b133682d1e18","Type":"ContainerDied","Data":"4decf9bd5badfa721c560577702515bb14cd195a775bbf8b68b3cffa072340dc"} Jun 01 20:42:11.869556 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:11.869255 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" event={"ID":"6eb00224-ae3e-43c3-a30b-b133682d1e18","Type":"ContainerStarted","Data":"8ab33dcb35299d655aeff8d5a1375129bdebf8c2e8cada9985cd2e83a73ea765"} Jun 01 20:42:12.875291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:12.875191 2561 generic.go:358] "Generic (PLEG): container finished" podID="6eb00224-ae3e-43c3-a30b-b133682d1e18" containerID="20c72762bd9c59869d24a0f06ee3b87bbe545bdaf544199d0b990d212c510a0d" exitCode=0 Jun 01 20:42:12.875291 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:12.875251 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" event={"ID":"6eb00224-ae3e-43c3-a30b-b133682d1e18","Type":"ContainerDied","Data":"20c72762bd9c59869d24a0f06ee3b87bbe545bdaf544199d0b990d212c510a0d"} Jun 01 20:42:13.880835 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:13.880798 2561 generic.go:358] "Generic (PLEG): container finished" podID="6eb00224-ae3e-43c3-a30b-b133682d1e18" containerID="5f09f5bc0ab5880b3b73428647a66e112a490f93234829e4c11fd63c9bd47aa6" exitCode=0 Jun 01 20:42:13.881203 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:13.880881 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" event={"ID":"6eb00224-ae3e-43c3-a30b-b133682d1e18","Type":"ContainerDied","Data":"5f09f5bc0ab5880b3b73428647a66e112a490f93234829e4c11fd63c9bd47aa6"} Jun 01 20:42:15.008311 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.008284 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:15.127699 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.127660 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-bundle\") pod \"6eb00224-ae3e-43c3-a30b-b133682d1e18\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " Jun 01 20:42:15.127699 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.127706 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-util\") pod \"6eb00224-ae3e-43c3-a30b-b133682d1e18\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " Jun 01 20:42:15.127943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.127755 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr75v\" (UniqueName: \"kubernetes.io/projected/6eb00224-ae3e-43c3-a30b-b133682d1e18-kube-api-access-pr75v\") pod \"6eb00224-ae3e-43c3-a30b-b133682d1e18\" (UID: \"6eb00224-ae3e-43c3-a30b-b133682d1e18\") " Jun 01 20:42:15.128357 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.128329 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-bundle" (OuterVolumeSpecName: "bundle") pod "6eb00224-ae3e-43c3-a30b-b133682d1e18" (UID: "6eb00224-ae3e-43c3-a30b-b133682d1e18"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:42:15.129794 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.129767 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eb00224-ae3e-43c3-a30b-b133682d1e18-kube-api-access-pr75v" (OuterVolumeSpecName: "kube-api-access-pr75v") pod "6eb00224-ae3e-43c3-a30b-b133682d1e18" (UID: "6eb00224-ae3e-43c3-a30b-b133682d1e18"). InnerVolumeSpecName "kube-api-access-pr75v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:42:15.133409 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.133382 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-util" (OuterVolumeSpecName: "util") pod "6eb00224-ae3e-43c3-a30b-b133682d1e18" (UID: "6eb00224-ae3e-43c3-a30b-b133682d1e18"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:42:15.228660 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.228606 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:42:15.228660 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.228646 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb00224-ae3e-43c3-a30b-b133682d1e18-util\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:42:15.228660 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.228659 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr75v\" (UniqueName: \"kubernetes.io/projected/6eb00224-ae3e-43c3-a30b-b133682d1e18-kube-api-access-pr75v\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:42:15.889132 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.889095 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" event={"ID":"6eb00224-ae3e-43c3-a30b-b133682d1e18","Type":"ContainerDied","Data":"8ab33dcb35299d655aeff8d5a1375129bdebf8c2e8cada9985cd2e83a73ea765"} Jun 01 20:42:15.889132 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.889113 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcnmkf" Jun 01 20:42:15.889132 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:15.889127 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ab33dcb35299d655aeff8d5a1375129bdebf8c2e8cada9985cd2e83a73ea765" Jun 01 20:42:23.568643 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.568602 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4"] Jun 01 20:42:23.569015 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.568931 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb00224-ae3e-43c3-a30b-b133682d1e18" containerName="util" Jun 01 20:42:23.569015 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.568941 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb00224-ae3e-43c3-a30b-b133682d1e18" containerName="util" Jun 01 20:42:23.569015 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.568959 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb00224-ae3e-43c3-a30b-b133682d1e18" containerName="extract" Jun 01 20:42:23.569015 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.568965 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb00224-ae3e-43c3-a30b-b133682d1e18" containerName="extract" Jun 01 20:42:23.569015 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.568971 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb00224-ae3e-43c3-a30b-b133682d1e18" containerName="pull" Jun 01 20:42:23.569015 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.568976 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb00224-ae3e-43c3-a30b-b133682d1e18" containerName="pull" Jun 01 20:42:23.569235 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.569020 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="6eb00224-ae3e-43c3-a30b-b133682d1e18" containerName="extract" Jun 01 20:42:23.573092 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.573073 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.575939 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.575892 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 01 20:42:23.576348 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.576283 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 01 20:42:23.576348 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.576337 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 01 20:42:23.576501 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.576462 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zv4vq\"" Jun 01 20:42:23.576715 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.576699 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 01 20:42:23.590989 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.590967 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4"] Jun 01 20:42:23.702880 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.702833 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e899c007-d8af-4ba8-bcf4-badc727f3359-manifests\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.703036 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.702903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92hn4\" (UniqueName: \"kubernetes.io/projected/e899c007-d8af-4ba8-bcf4-badc727f3359-kube-api-access-92hn4\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.703036 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.702946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e899c007-d8af-4ba8-bcf4-badc727f3359-webhook-cert\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.703036 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.702966 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e899c007-d8af-4ba8-bcf4-badc727f3359-tmp\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.703036 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.702995 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e899c007-d8af-4ba8-bcf4-badc727f3359-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.804083 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.804049 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92hn4\" (UniqueName: \"kubernetes.io/projected/e899c007-d8af-4ba8-bcf4-badc727f3359-kube-api-access-92hn4\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.804234 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.804096 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e899c007-d8af-4ba8-bcf4-badc727f3359-webhook-cert\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.804234 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.804119 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e899c007-d8af-4ba8-bcf4-badc727f3359-tmp\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.804320 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.804232 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e899c007-d8af-4ba8-bcf4-badc727f3359-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.804320 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.804304 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e899c007-d8af-4ba8-bcf4-badc727f3359-manifests\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.804668 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.804620 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e899c007-d8af-4ba8-bcf4-badc727f3359-manifests\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.806451 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.806429 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e899c007-d8af-4ba8-bcf4-badc727f3359-tmp\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.806568 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.806550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e899c007-d8af-4ba8-bcf4-badc727f3359-webhook-cert\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.806647 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.806580 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e899c007-d8af-4ba8-bcf4-badc727f3359-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.811155 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.811124 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92hn4\" (UniqueName: \"kubernetes.io/projected/e899c007-d8af-4ba8-bcf4-badc727f3359-kube-api-access-92hn4\") pod \"opendatahub-operator-controller-manager-64857648b-zncx4\" (UID: \"e899c007-d8af-4ba8-bcf4-badc727f3359\") " pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:23.883744 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:23.883653 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:24.021336 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:24.021269 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4"] Jun 01 20:42:24.024566 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:42:24.024535 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode899c007_d8af_4ba8_bcf4_badc727f3359.slice/crio-b21eb4fb8e620b2595164742db76feb74fd1416edcf9ee5c46e485bbb3e2447d WatchSource:0}: Error finding container b21eb4fb8e620b2595164742db76feb74fd1416edcf9ee5c46e485bbb3e2447d: Status 404 returned error can't find the container with id b21eb4fb8e620b2595164742db76feb74fd1416edcf9ee5c46e485bbb3e2447d Jun 01 20:42:24.922974 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:24.922934 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" event={"ID":"e899c007-d8af-4ba8-bcf4-badc727f3359","Type":"ContainerStarted","Data":"b21eb4fb8e620b2595164742db76feb74fd1416edcf9ee5c46e485bbb3e2447d"} Jun 01 20:42:27.934184 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:27.934150 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" event={"ID":"e899c007-d8af-4ba8-bcf4-badc727f3359","Type":"ContainerStarted","Data":"a8adf515f7b2182c83f977b91230ace792acafe09d4360cf347afeb0f20a60ee"} Jun 01 20:42:28.938985 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:28.938946 2561 generic.go:358] "Generic (PLEG): container finished" podID="e899c007-d8af-4ba8-bcf4-badc727f3359" containerID="a8adf515f7b2182c83f977b91230ace792acafe09d4360cf347afeb0f20a60ee" exitCode=0 Jun 01 20:42:28.939466 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:28.938993 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" event={"ID":"e899c007-d8af-4ba8-bcf4-badc727f3359","Type":"ContainerDied","Data":"a8adf515f7b2182c83f977b91230ace792acafe09d4360cf347afeb0f20a60ee"} Jun 01 20:42:29.943781 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:29.943741 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" event={"ID":"e899c007-d8af-4ba8-bcf4-badc727f3359","Type":"ContainerStarted","Data":"4a99e1c1b4313c211bcb346ef06061352c22908ef57cdca2c5fb8a7498172914"} Jun 01 20:42:29.944277 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:29.943876 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:29.963418 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:29.963375 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" podStartSLOduration=1.7428941660000001 podStartE2EDuration="6.963361513s" podCreationTimestamp="2026-06-01 20:42:23 +0000 UTC" firstStartedPulling="2026-06-01 20:42:24.026204265 +0000 UTC m=+492.274503529" lastFinishedPulling="2026-06-01 20:42:29.246671597 +0000 UTC m=+497.494970876" observedRunningTime="2026-06-01 20:42:29.960870614 +0000 UTC m=+498.209169923" watchObservedRunningTime="2026-06-01 20:42:29.963361513 +0000 UTC m=+498.211660799" Jun 01 20:42:40.952129 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:40.952100 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64857648b-zncx4" Jun 01 20:42:43.182789 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.182750 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-v8mfp"] Jun 01 20:42:43.193941 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.193908 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-v8mfp"] Jun 01 20:42:43.194098 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.194033 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-v8mfp" Jun 01 20:42:43.195920 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.195894 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 01 20:42:43.196036 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.195900 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lsb88\"" Jun 01 20:42:43.258733 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.258698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f0eb3dd-0418-4f1f-b849-078cc25a26de-cert\") pod \"odh-model-controller-76588b95-v8mfp\" (UID: \"9f0eb3dd-0418-4f1f-b849-078cc25a26de\") " pod="opendatahub/odh-model-controller-76588b95-v8mfp" Jun 01 20:42:43.258879 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.258770 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xqvt\" (UniqueName: \"kubernetes.io/projected/9f0eb3dd-0418-4f1f-b849-078cc25a26de-kube-api-access-5xqvt\") pod \"odh-model-controller-76588b95-v8mfp\" (UID: \"9f0eb3dd-0418-4f1f-b849-078cc25a26de\") " pod="opendatahub/odh-model-controller-76588b95-v8mfp" Jun 01 20:42:43.359449 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.359417 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f0eb3dd-0418-4f1f-b849-078cc25a26de-cert\") pod \"odh-model-controller-76588b95-v8mfp\" (UID: \"9f0eb3dd-0418-4f1f-b849-078cc25a26de\") " pod="opendatahub/odh-model-controller-76588b95-v8mfp" Jun 01 20:42:43.359645 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.359490 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xqvt\" (UniqueName: \"kubernetes.io/projected/9f0eb3dd-0418-4f1f-b849-078cc25a26de-kube-api-access-5xqvt\") pod \"odh-model-controller-76588b95-v8mfp\" (UID: \"9f0eb3dd-0418-4f1f-b849-078cc25a26de\") " pod="opendatahub/odh-model-controller-76588b95-v8mfp" Jun 01 20:42:43.361855 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.361837 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f0eb3dd-0418-4f1f-b849-078cc25a26de-cert\") pod \"odh-model-controller-76588b95-v8mfp\" (UID: \"9f0eb3dd-0418-4f1f-b849-078cc25a26de\") " pod="opendatahub/odh-model-controller-76588b95-v8mfp" Jun 01 20:42:43.367038 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.367021 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xqvt\" (UniqueName: \"kubernetes.io/projected/9f0eb3dd-0418-4f1f-b849-078cc25a26de-kube-api-access-5xqvt\") pod \"odh-model-controller-76588b95-v8mfp\" (UID: \"9f0eb3dd-0418-4f1f-b849-078cc25a26de\") " pod="opendatahub/odh-model-controller-76588b95-v8mfp" Jun 01 20:42:43.504410 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.504362 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-v8mfp" Jun 01 20:42:43.619101 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.619065 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-zpjj7"] Jun 01 20:42:43.623669 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.623644 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-zpjj7" Jun 01 20:42:43.625780 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.625759 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 01 20:42:43.629993 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.629969 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-zpjj7"] Jun 01 20:42:43.636360 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.636340 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-v8mfp"] Jun 01 20:42:43.639497 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:42:43.639468 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f0eb3dd_0418_4f1f_b849_078cc25a26de.slice/crio-bf7e9302a92e4773a60465b2f3a1b42f4b5039c139357f4fbf7de0ed72ee3598 WatchSource:0}: Error finding container bf7e9302a92e4773a60465b2f3a1b42f4b5039c139357f4fbf7de0ed72ee3598: Status 404 returned error can't find the container with id bf7e9302a92e4773a60465b2f3a1b42f4b5039c139357f4fbf7de0ed72ee3598 Jun 01 20:42:43.662111 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.662091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4stw2\" (UniqueName: \"kubernetes.io/projected/da06a516-5dff-4896-9fd3-a0533050736c-kube-api-access-4stw2\") pod \"model-serving-api-6577596cd5-zpjj7\" (UID: \"da06a516-5dff-4896-9fd3-a0533050736c\") " pod="opendatahub/model-serving-api-6577596cd5-zpjj7" Jun 01 20:42:43.662220 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.662145 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da06a516-5dff-4896-9fd3-a0533050736c-tls-certs\") pod \"model-serving-api-6577596cd5-zpjj7\" (UID: \"da06a516-5dff-4896-9fd3-a0533050736c\") " pod="opendatahub/model-serving-api-6577596cd5-zpjj7" Jun 01 20:42:43.763170 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.763089 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da06a516-5dff-4896-9fd3-a0533050736c-tls-certs\") pod \"model-serving-api-6577596cd5-zpjj7\" (UID: \"da06a516-5dff-4896-9fd3-a0533050736c\") " pod="opendatahub/model-serving-api-6577596cd5-zpjj7" Jun 01 20:42:43.763170 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.763148 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4stw2\" (UniqueName: \"kubernetes.io/projected/da06a516-5dff-4896-9fd3-a0533050736c-kube-api-access-4stw2\") pod \"model-serving-api-6577596cd5-zpjj7\" (UID: \"da06a516-5dff-4896-9fd3-a0533050736c\") " pod="opendatahub/model-serving-api-6577596cd5-zpjj7" Jun 01 20:42:43.765471 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.765442 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da06a516-5dff-4896-9fd3-a0533050736c-tls-certs\") pod \"model-serving-api-6577596cd5-zpjj7\" (UID: \"da06a516-5dff-4896-9fd3-a0533050736c\") " pod="opendatahub/model-serving-api-6577596cd5-zpjj7" Jun 01 20:42:43.773186 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.773163 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4stw2\" (UniqueName: \"kubernetes.io/projected/da06a516-5dff-4896-9fd3-a0533050736c-kube-api-access-4stw2\") pod \"model-serving-api-6577596cd5-zpjj7\" (UID: \"da06a516-5dff-4896-9fd3-a0533050736c\") " pod="opendatahub/model-serving-api-6577596cd5-zpjj7" Jun 01 20:42:43.937316 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:43.937281 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-zpjj7" Jun 01 20:42:44.006647 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:44.000653 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-v8mfp" event={"ID":"9f0eb3dd-0418-4f1f-b849-078cc25a26de","Type":"ContainerStarted","Data":"bf7e9302a92e4773a60465b2f3a1b42f4b5039c139357f4fbf7de0ed72ee3598"} Jun 01 20:42:44.086748 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:44.086724 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-zpjj7"] Jun 01 20:42:44.088755 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:42:44.088725 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda06a516_5dff_4896_9fd3_a0533050736c.slice/crio-e4260ce579ae8fe2926c54d1fcd799b2189fe36c9feaa316c4a8b68a9ed91d10 WatchSource:0}: Error finding container e4260ce579ae8fe2926c54d1fcd799b2189fe36c9feaa316c4a8b68a9ed91d10: Status 404 returned error can't find the container with id e4260ce579ae8fe2926c54d1fcd799b2189fe36c9feaa316c4a8b68a9ed91d10 Jun 01 20:42:45.006456 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.006417 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-zpjj7" event={"ID":"da06a516-5dff-4896-9fd3-a0533050736c","Type":"ContainerStarted","Data":"e4260ce579ae8fe2926c54d1fcd799b2189fe36c9feaa316c4a8b68a9ed91d10"} Jun 01 20:42:45.806524 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.806489 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7"] Jun 01 20:42:45.810754 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.810728 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:45.812840 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.812816 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 01 20:42:45.813088 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.813071 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8bssn\"" Jun 01 20:42:45.813523 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.813371 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 01 20:42:45.817235 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.817213 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7"] Jun 01 20:42:45.882657 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.882405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:45.882657 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.882463 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg5dv\" (UniqueName: \"kubernetes.io/projected/d26dae80-9f39-46c7-a778-a706a98861be-kube-api-access-cg5dv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:45.882657 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.882527 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:45.983960 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.983924 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:45.984163 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.984004 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:45.984163 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.984041 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg5dv\" (UniqueName: \"kubernetes.io/projected/d26dae80-9f39-46c7-a778-a706a98861be-kube-api-access-cg5dv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:45.984364 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.984341 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:45.984364 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.984356 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:45.992098 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:45.992067 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg5dv\" (UniqueName: \"kubernetes.io/projected/d26dae80-9f39-46c7-a778-a706a98861be-kube-api-access-cg5dv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:46.025642 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.025469 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk"] Jun 01 20:42:46.037027 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.036991 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:46.038657 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.038615 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk"] Jun 01 20:42:46.040160 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.040142 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 01 20:42:46.040160 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.040154 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 01 20:42:46.040345 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.040220 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 01 20:42:46.040401 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.040358 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cpxv9\"" Jun 01 20:42:46.040401 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.040388 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 01 20:42:46.085532 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.085473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d93a883-3b82-4bc8-9a57-c0f4e610442c-tmp\") pod \"kube-auth-proxy-6855b9fc46-sfbxk\" (UID: \"4d93a883-3b82-4bc8-9a57-c0f4e610442c\") " pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:46.085532 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.085510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr77b\" (UniqueName: \"kubernetes.io/projected/4d93a883-3b82-4bc8-9a57-c0f4e610442c-kube-api-access-vr77b\") pod \"kube-auth-proxy-6855b9fc46-sfbxk\" (UID: \"4d93a883-3b82-4bc8-9a57-c0f4e610442c\") " pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:46.085770 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.085613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d93a883-3b82-4bc8-9a57-c0f4e610442c-tls-certs\") pod \"kube-auth-proxy-6855b9fc46-sfbxk\" (UID: \"4d93a883-3b82-4bc8-9a57-c0f4e610442c\") " pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:46.124163 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.124134 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:46.186517 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.186485 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d93a883-3b82-4bc8-9a57-c0f4e610442c-tmp\") pod \"kube-auth-proxy-6855b9fc46-sfbxk\" (UID: \"4d93a883-3b82-4bc8-9a57-c0f4e610442c\") " pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:46.186687 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.186525 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vr77b\" (UniqueName: \"kubernetes.io/projected/4d93a883-3b82-4bc8-9a57-c0f4e610442c-kube-api-access-vr77b\") pod \"kube-auth-proxy-6855b9fc46-sfbxk\" (UID: \"4d93a883-3b82-4bc8-9a57-c0f4e610442c\") " pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:46.186687 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.186604 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d93a883-3b82-4bc8-9a57-c0f4e610442c-tls-certs\") pod \"kube-auth-proxy-6855b9fc46-sfbxk\" (UID: \"4d93a883-3b82-4bc8-9a57-c0f4e610442c\") " pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:46.186811 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:42:46.186737 2561 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 01 20:42:46.186811 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:42:46.186791 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d93a883-3b82-4bc8-9a57-c0f4e610442c-tls-certs podName:4d93a883-3b82-4bc8-9a57-c0f4e610442c nodeName:}" failed. No retries permitted until 2026-06-01 20:42:46.686773656 +0000 UTC m=+514.935072921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4d93a883-3b82-4bc8-9a57-c0f4e610442c-tls-certs") pod "kube-auth-proxy-6855b9fc46-sfbxk" (UID: "4d93a883-3b82-4bc8-9a57-c0f4e610442c") : secret "kube-auth-proxy-tls" not found Jun 01 20:42:46.189040 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.189013 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d93a883-3b82-4bc8-9a57-c0f4e610442c-tmp\") pod \"kube-auth-proxy-6855b9fc46-sfbxk\" (UID: \"4d93a883-3b82-4bc8-9a57-c0f4e610442c\") " pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:46.200134 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.200109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr77b\" (UniqueName: \"kubernetes.io/projected/4d93a883-3b82-4bc8-9a57-c0f4e610442c-kube-api-access-vr77b\") pod \"kube-auth-proxy-6855b9fc46-sfbxk\" (UID: \"4d93a883-3b82-4bc8-9a57-c0f4e610442c\") " pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:46.691674 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.691610 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d93a883-3b82-4bc8-9a57-c0f4e610442c-tls-certs\") pod \"kube-auth-proxy-6855b9fc46-sfbxk\" (UID: \"4d93a883-3b82-4bc8-9a57-c0f4e610442c\") " pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:46.694299 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.694269 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d93a883-3b82-4bc8-9a57-c0f4e610442c-tls-certs\") pod \"kube-auth-proxy-6855b9fc46-sfbxk\" (UID: \"4d93a883-3b82-4bc8-9a57-c0f4e610442c\") " pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:46.949206 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:46.949129 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" Jun 01 20:42:48.250894 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:48.250755 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7"] Jun 01 20:42:48.255392 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:42:48.255365 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26dae80_9f39_46c7_a778_a706a98861be.slice/crio-ca11d5d39c6a55656560243fa75f215eaab995f3a04b0ebeb67a730a04bdfdab WatchSource:0}: Error finding container ca11d5d39c6a55656560243fa75f215eaab995f3a04b0ebeb67a730a04bdfdab: Status 404 returned error can't find the container with id ca11d5d39c6a55656560243fa75f215eaab995f3a04b0ebeb67a730a04bdfdab Jun 01 20:42:48.278640 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:48.278599 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk"] Jun 01 20:42:48.285696 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:42:48.285674 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d93a883_3b82_4bc8_9a57_c0f4e610442c.slice/crio-9600d4b9c05da575a4e10d2c7b79c97d72b3eff441df1adfb5f353b4e2534878 WatchSource:0}: Error finding container 9600d4b9c05da575a4e10d2c7b79c97d72b3eff441df1adfb5f353b4e2534878: Status 404 returned error can't find the container with id 9600d4b9c05da575a4e10d2c7b79c97d72b3eff441df1adfb5f353b4e2534878 Jun 01 20:42:49.027048 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:49.026980 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-v8mfp" event={"ID":"9f0eb3dd-0418-4f1f-b849-078cc25a26de","Type":"ContainerStarted","Data":"1ca1c31897541eea4c475a70deb7e8eb66c612290fd5ca22cdbf5f4d9804e1b0"} Jun 01 20:42:49.027048 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:49.027027 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-v8mfp" Jun 01 20:42:49.028654 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:49.028603 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-zpjj7" event={"ID":"da06a516-5dff-4896-9fd3-a0533050736c","Type":"ContainerStarted","Data":"5d8f65ff167ffcaa2ca2ee86ddf8ea48eea4022cbb98d239ed3c86f7db466d35"} Jun 01 20:42:49.028818 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:49.028681 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-zpjj7" Jun 01 20:42:49.030439 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:49.030410 2561 generic.go:358] "Generic (PLEG): container finished" podID="d26dae80-9f39-46c7-a778-a706a98861be" containerID="70ec0085e15b90c0de8ed81c288d68a6d084c48806a2f8d594b62b841a44c555" exitCode=0 Jun 01 20:42:49.030559 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:49.030484 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" event={"ID":"d26dae80-9f39-46c7-a778-a706a98861be","Type":"ContainerDied","Data":"70ec0085e15b90c0de8ed81c288d68a6d084c48806a2f8d594b62b841a44c555"} Jun 01 20:42:49.030559 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:49.030519 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" event={"ID":"d26dae80-9f39-46c7-a778-a706a98861be","Type":"ContainerStarted","Data":"ca11d5d39c6a55656560243fa75f215eaab995f3a04b0ebeb67a730a04bdfdab"} Jun 01 20:42:49.031841 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:49.031815 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" event={"ID":"4d93a883-3b82-4bc8-9a57-c0f4e610442c","Type":"ContainerStarted","Data":"9600d4b9c05da575a4e10d2c7b79c97d72b3eff441df1adfb5f353b4e2534878"} Jun 01 20:42:49.041806 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:49.041730 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-v8mfp" podStartSLOduration=1.576080012 podStartE2EDuration="6.041714809s" podCreationTimestamp="2026-06-01 20:42:43 +0000 UTC" firstStartedPulling="2026-06-01 20:42:43.64100143 +0000 UTC m=+511.889300708" lastFinishedPulling="2026-06-01 20:42:48.106636229 +0000 UTC m=+516.354935505" observedRunningTime="2026-06-01 20:42:49.041062267 +0000 UTC m=+517.289361553" watchObservedRunningTime="2026-06-01 20:42:49.041714809 +0000 UTC m=+517.290014096" Jun 01 20:42:49.078780 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:49.078733 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-zpjj7" podStartSLOduration=2.050578322 podStartE2EDuration="6.07872203s" podCreationTimestamp="2026-06-01 20:42:43 +0000 UTC" firstStartedPulling="2026-06-01 20:42:44.090326573 +0000 UTC m=+512.338625836" lastFinishedPulling="2026-06-01 20:42:48.118470278 +0000 UTC m=+516.366769544" observedRunningTime="2026-06-01 20:42:49.077818275 +0000 UTC m=+517.326117562" watchObservedRunningTime="2026-06-01 20:42:49.07872203 +0000 UTC m=+517.327021315" Jun 01 20:42:51.040463 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:51.040426 2561 generic.go:358] "Generic (PLEG): container finished" podID="d26dae80-9f39-46c7-a778-a706a98861be" containerID="3c03791efa307e546c1b6edd5199a4418a61f9f19e40fce44d6f019494aff1b1" exitCode=0 Jun 01 20:42:51.040951 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:51.040513 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" event={"ID":"d26dae80-9f39-46c7-a778-a706a98861be","Type":"ContainerDied","Data":"3c03791efa307e546c1b6edd5199a4418a61f9f19e40fce44d6f019494aff1b1"} Jun 01 20:42:51.042643 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:51.042593 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" event={"ID":"4d93a883-3b82-4bc8-9a57-c0f4e610442c","Type":"ContainerStarted","Data":"b702c415e8397c6f80ec01461e38790ace7bf36808b7a9ba6acea98ba4c098bf"} Jun 01 20:42:51.119124 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:51.119072 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6855b9fc46-sfbxk" podStartSLOduration=3.058801345 podStartE2EDuration="5.119052518s" podCreationTimestamp="2026-06-01 20:42:46 +0000 UTC" firstStartedPulling="2026-06-01 20:42:48.287355016 +0000 UTC m=+516.535654280" lastFinishedPulling="2026-06-01 20:42:50.34760619 +0000 UTC m=+518.595905453" observedRunningTime="2026-06-01 20:42:51.11631424 +0000 UTC m=+519.364613527" watchObservedRunningTime="2026-06-01 20:42:51.119052518 +0000 UTC m=+519.367351805" Jun 01 20:42:52.050101 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.050049 2561 generic.go:358] "Generic (PLEG): container finished" podID="d26dae80-9f39-46c7-a778-a706a98861be" containerID="fdf05b2dd80b0739a5146ef2fee6ac851ca3141426647464f6969a2c1071b366" exitCode=0 Jun 01 20:42:52.050584 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.050543 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" event={"ID":"d26dae80-9f39-46c7-a778-a706a98861be","Type":"ContainerDied","Data":"fdf05b2dd80b0739a5146ef2fee6ac851ca3141426647464f6969a2c1071b366"} Jun 01 20:42:52.613951 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.613916 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm"] Jun 01 20:42:52.617801 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.617772 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" Jun 01 20:42:52.619837 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.619812 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4vf29\"" Jun 01 20:42:52.619954 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.619852 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 01 20:42:52.626314 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.625871 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm"] Jun 01 20:42:52.629262 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.629240 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz"] Jun 01 20:42:52.632430 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.632411 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" Jun 01 20:42:52.634768 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.634745 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 01 20:42:52.634871 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.634849 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wmr7s\"" Jun 01 20:42:52.642874 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.642738 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz"] Jun 01 20:42:52.644597 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.644564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91d7f537-b2be-4723-a56a-d72c9013d6ad-cert\") pod \"kserve-controller-manager-7c99ffcdcd-s7ljm\" (UID: \"91d7f537-b2be-4723-a56a-d72c9013d6ad\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" Jun 01 20:42:52.644707 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.644652 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crx2z\" (UniqueName: \"kubernetes.io/projected/91d7f537-b2be-4723-a56a-d72c9013d6ad-kube-api-access-crx2z\") pod \"kserve-controller-manager-7c99ffcdcd-s7ljm\" (UID: \"91d7f537-b2be-4723-a56a-d72c9013d6ad\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" Jun 01 20:42:52.745212 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.745171 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rkhn\" (UniqueName: \"kubernetes.io/projected/e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c-kube-api-access-8rkhn\") pod \"llmisvc-controller-manager-c6b9847d7-x2wvz\" (UID: \"e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" Jun 01 20:42:52.745396 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.745226 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crx2z\" (UniqueName: \"kubernetes.io/projected/91d7f537-b2be-4723-a56a-d72c9013d6ad-kube-api-access-crx2z\") pod \"kserve-controller-manager-7c99ffcdcd-s7ljm\" (UID: \"91d7f537-b2be-4723-a56a-d72c9013d6ad\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" Jun 01 20:42:52.745396 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.745264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c-cert\") pod \"llmisvc-controller-manager-c6b9847d7-x2wvz\" (UID: \"e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" Jun 01 20:42:52.745396 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.745321 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91d7f537-b2be-4723-a56a-d72c9013d6ad-cert\") pod \"kserve-controller-manager-7c99ffcdcd-s7ljm\" (UID: \"91d7f537-b2be-4723-a56a-d72c9013d6ad\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" Jun 01 20:42:52.745559 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:42:52.745442 2561 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 01 20:42:52.745559 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:42:52.745513 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91d7f537-b2be-4723-a56a-d72c9013d6ad-cert podName:91d7f537-b2be-4723-a56a-d72c9013d6ad nodeName:}" failed. No retries permitted until 2026-06-01 20:42:53.245491304 +0000 UTC m=+521.493790574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91d7f537-b2be-4723-a56a-d72c9013d6ad-cert") pod "kserve-controller-manager-7c99ffcdcd-s7ljm" (UID: "91d7f537-b2be-4723-a56a-d72c9013d6ad") : secret "kserve-webhook-server-cert" not found Jun 01 20:42:52.756831 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.756800 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crx2z\" (UniqueName: \"kubernetes.io/projected/91d7f537-b2be-4723-a56a-d72c9013d6ad-kube-api-access-crx2z\") pod \"kserve-controller-manager-7c99ffcdcd-s7ljm\" (UID: \"91d7f537-b2be-4723-a56a-d72c9013d6ad\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" Jun 01 20:42:52.846726 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.846687 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rkhn\" (UniqueName: \"kubernetes.io/projected/e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c-kube-api-access-8rkhn\") pod \"llmisvc-controller-manager-c6b9847d7-x2wvz\" (UID: \"e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" Jun 01 20:42:52.846932 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.846750 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c-cert\") pod \"llmisvc-controller-manager-c6b9847d7-x2wvz\" (UID: \"e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" Jun 01 20:42:52.846932 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:42:52.846895 2561 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 01 20:42:52.847052 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:42:52.846956 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c-cert podName:e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c nodeName:}" failed. No retries permitted until 2026-06-01 20:42:53.346937226 +0000 UTC m=+521.595236495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c-cert") pod "llmisvc-controller-manager-c6b9847d7-x2wvz" (UID: "e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c") : secret "llmisvc-webhook-server-cert" not found Jun 01 20:42:52.856100 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:52.856071 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rkhn\" (UniqueName: \"kubernetes.io/projected/e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c-kube-api-access-8rkhn\") pod \"llmisvc-controller-manager-c6b9847d7-x2wvz\" (UID: \"e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" Jun 01 20:42:53.182290 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.182271 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:53.251212 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.251175 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-util\") pod \"d26dae80-9f39-46c7-a778-a706a98861be\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " Jun 01 20:42:53.251399 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.251280 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg5dv\" (UniqueName: \"kubernetes.io/projected/d26dae80-9f39-46c7-a778-a706a98861be-kube-api-access-cg5dv\") pod \"d26dae80-9f39-46c7-a778-a706a98861be\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " Jun 01 20:42:53.251399 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.251320 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-bundle\") pod \"d26dae80-9f39-46c7-a778-a706a98861be\" (UID: \"d26dae80-9f39-46c7-a778-a706a98861be\") " Jun 01 20:42:53.251588 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.251398 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91d7f537-b2be-4723-a56a-d72c9013d6ad-cert\") pod \"kserve-controller-manager-7c99ffcdcd-s7ljm\" (UID: \"91d7f537-b2be-4723-a56a-d72c9013d6ad\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" Jun 01 20:42:53.252273 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.252235 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-bundle" (OuterVolumeSpecName: "bundle") pod "d26dae80-9f39-46c7-a778-a706a98861be" (UID: "d26dae80-9f39-46c7-a778-a706a98861be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:42:53.253526 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.253496 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d26dae80-9f39-46c7-a778-a706a98861be-kube-api-access-cg5dv" (OuterVolumeSpecName: "kube-api-access-cg5dv") pod "d26dae80-9f39-46c7-a778-a706a98861be" (UID: "d26dae80-9f39-46c7-a778-a706a98861be"). InnerVolumeSpecName "kube-api-access-cg5dv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:42:53.253973 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.253956 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91d7f537-b2be-4723-a56a-d72c9013d6ad-cert\") pod \"kserve-controller-manager-7c99ffcdcd-s7ljm\" (UID: \"91d7f537-b2be-4723-a56a-d72c9013d6ad\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" Jun 01 20:42:53.256460 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.256428 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-util" (OuterVolumeSpecName: "util") pod "d26dae80-9f39-46c7-a778-a706a98861be" (UID: "d26dae80-9f39-46c7-a778-a706a98861be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:42:53.351970 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.351884 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c-cert\") pod \"llmisvc-controller-manager-c6b9847d7-x2wvz\" (UID: \"e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" Jun 01 20:42:53.351970 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.351949 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg5dv\" (UniqueName: \"kubernetes.io/projected/d26dae80-9f39-46c7-a778-a706a98861be-kube-api-access-cg5dv\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:42:53.351970 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.351964 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:42:53.351970 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.351972 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d26dae80-9f39-46c7-a778-a706a98861be-util\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:42:53.354254 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.354233 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c-cert\") pod \"llmisvc-controller-manager-c6b9847d7-x2wvz\" (UID: \"e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" Jun 01 20:42:53.531918 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.531883 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" Jun 01 20:42:53.544701 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.544677 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" Jun 01 20:42:53.669427 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.669402 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm"] Jun 01 20:42:53.672548 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:42:53.672523 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d7f537_b2be_4723_a56a_d72c9013d6ad.slice/crio-c11b7d9870a25ef6e1e8381acdbd1cb9dc232f4635b2bf49cefbc1773d8f3a0c WatchSource:0}: Error finding container c11b7d9870a25ef6e1e8381acdbd1cb9dc232f4635b2bf49cefbc1773d8f3a0c: Status 404 returned error can't find the container with id c11b7d9870a25ef6e1e8381acdbd1cb9dc232f4635b2bf49cefbc1773d8f3a0c Jun 01 20:42:53.695535 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:53.695512 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz"] Jun 01 20:42:53.697250 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:42:53.697221 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode5f3a6c3_00ce_4ce5_86f0_4c34f9eb568c.slice/crio-5088f80e318fb6afff7081185d9e0ea46b6314bb65422732b32b286e8bb062a6 WatchSource:0}: Error finding container 5088f80e318fb6afff7081185d9e0ea46b6314bb65422732b32b286e8bb062a6: Status 404 returned error can't find the container with id 5088f80e318fb6afff7081185d9e0ea46b6314bb65422732b32b286e8bb062a6 Jun 01 20:42:54.060040 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:54.059998 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" event={"ID":"e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c","Type":"ContainerStarted","Data":"5088f80e318fb6afff7081185d9e0ea46b6314bb65422732b32b286e8bb062a6"} Jun 01 20:42:54.061124 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:54.061096 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" event={"ID":"91d7f537-b2be-4723-a56a-d72c9013d6ad","Type":"ContainerStarted","Data":"c11b7d9870a25ef6e1e8381acdbd1cb9dc232f4635b2bf49cefbc1773d8f3a0c"} Jun 01 20:42:54.062892 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:54.062869 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" event={"ID":"d26dae80-9f39-46c7-a778-a706a98861be","Type":"ContainerDied","Data":"ca11d5d39c6a55656560243fa75f215eaab995f3a04b0ebeb67a730a04bdfdab"} Jun 01 20:42:54.062892 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:54.062896 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca11d5d39c6a55656560243fa75f215eaab995f3a04b0ebeb67a730a04bdfdab" Jun 01 20:42:54.063018 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:54.062940 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835qrnw7" Jun 01 20:42:58.079198 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:58.079153 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" event={"ID":"91d7f537-b2be-4723-a56a-d72c9013d6ad","Type":"ContainerStarted","Data":"c1de6586df51a6c9e4146398628fed76c289261404a27f0ccd96f1b6ecab2a31"} Jun 01 20:42:58.079691 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:58.079214 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" Jun 01 20:42:58.080444 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:58.080424 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" event={"ID":"e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c","Type":"ContainerStarted","Data":"26cda1f58c930ca299bf291b8dff25576f8f9425ae4c539a007fd9b7bf5fc9e9"} Jun 01 20:42:58.080595 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:58.080576 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" Jun 01 20:42:58.095051 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:58.095006 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" podStartSLOduration=2.430483715 podStartE2EDuration="6.094994173s" podCreationTimestamp="2026-06-01 20:42:52 +0000 UTC" firstStartedPulling="2026-06-01 20:42:53.674335885 +0000 UTC m=+521.922635149" lastFinishedPulling="2026-06-01 20:42:57.338846332 +0000 UTC m=+525.587145607" observedRunningTime="2026-06-01 20:42:58.092598002 +0000 UTC m=+526.340897288" watchObservedRunningTime="2026-06-01 20:42:58.094994173 +0000 UTC m=+526.343293488" Jun 01 20:42:58.107876 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:42:58.107830 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" podStartSLOduration=2.463824678 podStartE2EDuration="6.107820523s" podCreationTimestamp="2026-06-01 20:42:52 +0000 UTC" firstStartedPulling="2026-06-01 20:42:53.698513065 +0000 UTC m=+521.946812333" lastFinishedPulling="2026-06-01 20:42:57.342508911 +0000 UTC m=+525.590808178" observedRunningTime="2026-06-01 20:42:58.106101332 +0000 UTC m=+526.354400619" watchObservedRunningTime="2026-06-01 20:42:58.107820523 +0000 UTC m=+526.356119809" Jun 01 20:43:00.017151 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.017114 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l"] Jun 01 20:43:00.017651 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.017613 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d26dae80-9f39-46c7-a778-a706a98861be" containerName="util" Jun 01 20:43:00.017734 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.017655 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d26dae80-9f39-46c7-a778-a706a98861be" containerName="util" Jun 01 20:43:00.017734 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.017680 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d26dae80-9f39-46c7-a778-a706a98861be" containerName="extract" Jun 01 20:43:00.017734 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.017689 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d26dae80-9f39-46c7-a778-a706a98861be" containerName="extract" Jun 01 20:43:00.017734 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.017723 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d26dae80-9f39-46c7-a778-a706a98861be" containerName="pull" Jun 01 20:43:00.017734 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.017732 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d26dae80-9f39-46c7-a778-a706a98861be" containerName="pull" Jun 01 20:43:00.017978 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.017829 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="d26dae80-9f39-46c7-a778-a706a98861be" containerName="extract" Jun 01 20:43:00.021272 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.021252 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:00.023878 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.023853 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8bssn\"" Jun 01 20:43:00.023992 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.023862 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 01 20:43:00.023992 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.023964 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 01 20:43:00.033070 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.033043 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l"] Jun 01 20:43:00.037938 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.037917 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-v8mfp" Jun 01 20:43:00.040386 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.040368 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-zpjj7" Jun 01 20:43:00.109753 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.109724 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:00.109957 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.109932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:00.110112 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.110085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4x7f\" (UniqueName: \"kubernetes.io/projected/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-kube-api-access-q4x7f\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:00.211060 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.211023 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:00.211249 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.211101 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4x7f\" (UniqueName: \"kubernetes.io/projected/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-kube-api-access-q4x7f\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:00.211249 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.211145 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:00.211493 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.211471 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:00.211546 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.211482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:00.220163 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.220138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4x7f\" (UniqueName: \"kubernetes.io/projected/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-kube-api-access-q4x7f\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:00.332164 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.332077 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:00.493217 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:00.493192 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l"] Jun 01 20:43:01.091981 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.091946 2561 generic.go:358] "Generic (PLEG): container finished" podID="ea6e95e7-c5c2-4161-9dc0-96df9313f10d" containerID="4e1dccbfc4024deaee9e2ca203fc26479d143a7f2afcf9de717d5cd35aa948ed" exitCode=0 Jun 01 20:43:01.092463 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.092030 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" event={"ID":"ea6e95e7-c5c2-4161-9dc0-96df9313f10d","Type":"ContainerDied","Data":"4e1dccbfc4024deaee9e2ca203fc26479d143a7f2afcf9de717d5cd35aa948ed"} Jun 01 20:43:01.092463 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.092065 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" event={"ID":"ea6e95e7-c5c2-4161-9dc0-96df9313f10d","Type":"ContainerStarted","Data":"76bd00d2294f4c6b0e4968729051c14b1ccdf25917284d1ed40ab491330233c8"} Jun 01 20:43:01.251160 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.251127 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qlf47"] Jun 01 20:43:01.254599 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.254576 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" Jun 01 20:43:01.256618 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.256598 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-2zzpl\"" Jun 01 20:43:01.257161 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.257140 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 01 20:43:01.257231 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.257213 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 01 20:43:01.266910 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.266885 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qlf47"] Jun 01 20:43:01.321248 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.321216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjhjj\" (UniqueName: \"kubernetes.io/projected/5a58fb04-9c85-4300-bfc4-5d0c93c23bb8-kube-api-access-bjhjj\") pod \"servicemesh-operator3-55f49c5f94-qlf47\" (UID: \"5a58fb04-9c85-4300-bfc4-5d0c93c23bb8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" Jun 01 20:43:01.321417 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.321287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5a58fb04-9c85-4300-bfc4-5d0c93c23bb8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qlf47\" (UID: \"5a58fb04-9c85-4300-bfc4-5d0c93c23bb8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" Jun 01 20:43:01.370414 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.370321 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6968d4bd4-x6mt6"] Jun 01 20:43:01.374222 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.374199 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6968d4bd4-x6mt6" Jun 01 20:43:01.376505 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.376482 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9vmcn\"" Jun 01 20:43:01.376651 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.376565 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 01 20:43:01.382215 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.382192 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6968d4bd4-x6mt6"] Jun 01 20:43:01.421832 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.421798 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjhjj\" (UniqueName: \"kubernetes.io/projected/5a58fb04-9c85-4300-bfc4-5d0c93c23bb8-kube-api-access-bjhjj\") pod \"servicemesh-operator3-55f49c5f94-qlf47\" (UID: \"5a58fb04-9c85-4300-bfc4-5d0c93c23bb8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" Jun 01 20:43:01.421968 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.421838 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ce295468-bba7-4295-83c5-2e52086cb34a-redirect-config\") pod \"dashboard-redirect-6968d4bd4-x6mt6\" (UID: \"ce295468-bba7-4295-83c5-2e52086cb34a\") " pod="opendatahub/dashboard-redirect-6968d4bd4-x6mt6" Jun 01 20:43:01.421968 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.421882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj7z8\" (UniqueName: \"kubernetes.io/projected/ce295468-bba7-4295-83c5-2e52086cb34a-kube-api-access-tj7z8\") pod \"dashboard-redirect-6968d4bd4-x6mt6\" (UID: \"ce295468-bba7-4295-83c5-2e52086cb34a\") " pod="opendatahub/dashboard-redirect-6968d4bd4-x6mt6" Jun 01 20:43:01.421968 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.421915 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5a58fb04-9c85-4300-bfc4-5d0c93c23bb8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qlf47\" (UID: \"5a58fb04-9c85-4300-bfc4-5d0c93c23bb8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" Jun 01 20:43:01.424304 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.424284 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5a58fb04-9c85-4300-bfc4-5d0c93c23bb8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qlf47\" (UID: \"5a58fb04-9c85-4300-bfc4-5d0c93c23bb8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" Jun 01 20:43:01.433202 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.433174 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjhjj\" (UniqueName: \"kubernetes.io/projected/5a58fb04-9c85-4300-bfc4-5d0c93c23bb8-kube-api-access-bjhjj\") pod \"servicemesh-operator3-55f49c5f94-qlf47\" (UID: \"5a58fb04-9c85-4300-bfc4-5d0c93c23bb8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" Jun 01 20:43:01.523132 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.523098 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ce295468-bba7-4295-83c5-2e52086cb34a-redirect-config\") pod \"dashboard-redirect-6968d4bd4-x6mt6\" (UID: \"ce295468-bba7-4295-83c5-2e52086cb34a\") " pod="opendatahub/dashboard-redirect-6968d4bd4-x6mt6" Jun 01 20:43:01.523293 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.523147 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tj7z8\" (UniqueName: \"kubernetes.io/projected/ce295468-bba7-4295-83c5-2e52086cb34a-kube-api-access-tj7z8\") pod \"dashboard-redirect-6968d4bd4-x6mt6\" (UID: \"ce295468-bba7-4295-83c5-2e52086cb34a\") " pod="opendatahub/dashboard-redirect-6968d4bd4-x6mt6" Jun 01 20:43:01.523797 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.523778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ce295468-bba7-4295-83c5-2e52086cb34a-redirect-config\") pod \"dashboard-redirect-6968d4bd4-x6mt6\" (UID: \"ce295468-bba7-4295-83c5-2e52086cb34a\") " pod="opendatahub/dashboard-redirect-6968d4bd4-x6mt6" Jun 01 20:43:01.537843 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.537817 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj7z8\" (UniqueName: \"kubernetes.io/projected/ce295468-bba7-4295-83c5-2e52086cb34a-kube-api-access-tj7z8\") pod \"dashboard-redirect-6968d4bd4-x6mt6\" (UID: \"ce295468-bba7-4295-83c5-2e52086cb34a\") " pod="opendatahub/dashboard-redirect-6968d4bd4-x6mt6" Jun 01 20:43:01.564424 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.564398 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" Jun 01 20:43:01.686980 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.686949 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6968d4bd4-x6mt6" Jun 01 20:43:01.696375 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.696346 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qlf47"] Jun 01 20:43:01.699840 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:43:01.699812 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a58fb04_9c85_4300_bfc4_5d0c93c23bb8.slice/crio-0d0131f73a0a88bb7a8ff419069b3f0dea0a5d7547792869eabe705baa30058c WatchSource:0}: Error finding container 0d0131f73a0a88bb7a8ff419069b3f0dea0a5d7547792869eabe705baa30058c: Status 404 returned error can't find the container with id 0d0131f73a0a88bb7a8ff419069b3f0dea0a5d7547792869eabe705baa30058c Jun 01 20:43:01.832883 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:01.832858 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6968d4bd4-x6mt6"] Jun 01 20:43:01.834137 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:43:01.834112 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce295468_bba7_4295_83c5_2e52086cb34a.slice/crio-a9dd7f03396e0f47d9482018cebb9a96a5e48c0a1a2f1582874eaa0539a1cbee WatchSource:0}: Error finding container a9dd7f03396e0f47d9482018cebb9a96a5e48c0a1a2f1582874eaa0539a1cbee: Status 404 returned error can't find the container with id a9dd7f03396e0f47d9482018cebb9a96a5e48c0a1a2f1582874eaa0539a1cbee Jun 01 20:43:02.099134 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:02.099098 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6968d4bd4-x6mt6" event={"ID":"ce295468-bba7-4295-83c5-2e52086cb34a","Type":"ContainerStarted","Data":"a9dd7f03396e0f47d9482018cebb9a96a5e48c0a1a2f1582874eaa0539a1cbee"} Jun 01 20:43:02.100794 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:02.100766 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" event={"ID":"ea6e95e7-c5c2-4161-9dc0-96df9313f10d","Type":"ContainerStarted","Data":"ee14861ba40a674d7f0c66d1cc86192a1e1db209294f2d8531e3fee238d58046"} Jun 01 20:43:02.102073 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:02.102051 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" event={"ID":"5a58fb04-9c85-4300-bfc4-5d0c93c23bb8","Type":"ContainerStarted","Data":"0d0131f73a0a88bb7a8ff419069b3f0dea0a5d7547792869eabe705baa30058c"} Jun 01 20:43:03.110781 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:03.110031 2561 generic.go:358] "Generic (PLEG): container finished" podID="ea6e95e7-c5c2-4161-9dc0-96df9313f10d" containerID="ee14861ba40a674d7f0c66d1cc86192a1e1db209294f2d8531e3fee238d58046" exitCode=0 Jun 01 20:43:03.110781 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:03.110138 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" event={"ID":"ea6e95e7-c5c2-4161-9dc0-96df9313f10d","Type":"ContainerDied","Data":"ee14861ba40a674d7f0c66d1cc86192a1e1db209294f2d8531e3fee238d58046"} Jun 01 20:43:04.116639 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:04.116579 2561 generic.go:358] "Generic (PLEG): container finished" podID="ea6e95e7-c5c2-4161-9dc0-96df9313f10d" containerID="caae5ce93877817472f9503c72de69f356e4a35c76a4c65805dfc192260dfac2" exitCode=0 Jun 01 20:43:04.117062 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:04.116657 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" event={"ID":"ea6e95e7-c5c2-4161-9dc0-96df9313f10d","Type":"ContainerDied","Data":"caae5ce93877817472f9503c72de69f356e4a35c76a4c65805dfc192260dfac2"} Jun 01 20:43:05.122656 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.122597 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" event={"ID":"5a58fb04-9c85-4300-bfc4-5d0c93c23bb8","Type":"ContainerStarted","Data":"f02bb799de48242aad1a0f4df16e235a3175b34e66f958e01df5e2aecee39243"} Jun 01 20:43:05.123036 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.122685 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" Jun 01 20:43:05.124005 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.123982 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6968d4bd4-x6mt6" event={"ID":"ce295468-bba7-4295-83c5-2e52086cb34a","Type":"ContainerStarted","Data":"6c81b2597d6458c3909d0988a8417f10a503cf4e8056998cec7454e370f1dbcb"} Jun 01 20:43:05.145094 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.145045 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" podStartSLOduration=0.821431487 podStartE2EDuration="4.145029222s" podCreationTimestamp="2026-06-01 20:43:01 +0000 UTC" firstStartedPulling="2026-06-01 20:43:01.702339503 +0000 UTC m=+529.950638785" lastFinishedPulling="2026-06-01 20:43:05.02593725 +0000 UTC m=+533.274236520" observedRunningTime="2026-06-01 20:43:05.1401025 +0000 UTC m=+533.388401783" watchObservedRunningTime="2026-06-01 20:43:05.145029222 +0000 UTC m=+533.393328507" Jun 01 20:43:05.155517 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.155257 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6968d4bd4-x6mt6" podStartSLOduration=0.969610926 podStartE2EDuration="4.155237082s" podCreationTimestamp="2026-06-01 20:43:01 +0000 UTC" firstStartedPulling="2026-06-01 20:43:01.835424904 +0000 UTC m=+530.083724167" lastFinishedPulling="2026-06-01 20:43:05.021051046 +0000 UTC m=+533.269350323" observedRunningTime="2026-06-01 20:43:05.153357355 +0000 UTC m=+533.401656641" watchObservedRunningTime="2026-06-01 20:43:05.155237082 +0000 UTC m=+533.403536370" Jun 01 20:43:05.272712 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.272651 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:05.359345 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.359298 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-util\") pod \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " Jun 01 20:43:05.359528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.359379 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4x7f\" (UniqueName: \"kubernetes.io/projected/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-kube-api-access-q4x7f\") pod \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " Jun 01 20:43:05.359528 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.359440 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-bundle\") pod \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\" (UID: \"ea6e95e7-c5c2-4161-9dc0-96df9313f10d\") " Jun 01 20:43:05.360556 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.360524 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-bundle" (OuterVolumeSpecName: "bundle") pod "ea6e95e7-c5c2-4161-9dc0-96df9313f10d" (UID: "ea6e95e7-c5c2-4161-9dc0-96df9313f10d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:43:05.361496 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.361466 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-kube-api-access-q4x7f" (OuterVolumeSpecName: "kube-api-access-q4x7f") pod "ea6e95e7-c5c2-4161-9dc0-96df9313f10d" (UID: "ea6e95e7-c5c2-4161-9dc0-96df9313f10d"). InnerVolumeSpecName "kube-api-access-q4x7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:43:05.365193 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.365165 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-util" (OuterVolumeSpecName: "util") pod "ea6e95e7-c5c2-4161-9dc0-96df9313f10d" (UID: "ea6e95e7-c5c2-4161-9dc0-96df9313f10d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:43:05.460695 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.460653 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4x7f\" (UniqueName: \"kubernetes.io/projected/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-kube-api-access-q4x7f\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:43:05.460695 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.460690 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:43:05.460695 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:05.460702 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea6e95e7-c5c2-4161-9dc0-96df9313f10d-util\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:43:06.129293 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:06.129261 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" Jun 01 20:43:06.129293 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:06.129277 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attl8l" event={"ID":"ea6e95e7-c5c2-4161-9dc0-96df9313f10d","Type":"ContainerDied","Data":"76bd00d2294f4c6b0e4968729051c14b1ccdf25917284d1ed40ab491330233c8"} Jun 01 20:43:06.129796 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:06.129314 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76bd00d2294f4c6b0e4968729051c14b1ccdf25917284d1ed40ab491330233c8" Jun 01 20:43:16.131890 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:16.131855 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qlf47" Jun 01 20:43:17.122009 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.121974 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw"] Jun 01 20:43:17.122335 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.122324 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea6e95e7-c5c2-4161-9dc0-96df9313f10d" containerName="util" Jun 01 20:43:17.122380 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.122337 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea6e95e7-c5c2-4161-9dc0-96df9313f10d" containerName="util" Jun 01 20:43:17.122380 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.122352 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea6e95e7-c5c2-4161-9dc0-96df9313f10d" containerName="extract" Jun 01 20:43:17.122380 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.122357 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea6e95e7-c5c2-4161-9dc0-96df9313f10d" containerName="extract" Jun 01 20:43:17.122380 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.122365 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea6e95e7-c5c2-4161-9dc0-96df9313f10d" containerName="pull" Jun 01 20:43:17.122380 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.122370 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea6e95e7-c5c2-4161-9dc0-96df9313f10d" containerName="pull" Jun 01 20:43:17.122533 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.122430 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea6e95e7-c5c2-4161-9dc0-96df9313f10d" containerName="extract" Jun 01 20:43:17.130449 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.130429 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.132683 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.132665 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 01 20:43:17.132996 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.132850 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 01 20:43:17.132996 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.132967 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 01 20:43:17.133113 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.133047 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 01 20:43:17.133113 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.133053 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9xllm\"" Jun 01 20:43:17.141307 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.141285 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw"] Jun 01 20:43:17.260057 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.260025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/da6eeae9-1f97-4402-a046-572f8ee30e2c-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.260057 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.260058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.260265 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.260078 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.260265 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.260142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.260265 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.260208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/da6eeae9-1f97-4402-a046-572f8ee30e2c-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.260265 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.260235 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.260431 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.260292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48kw4\" (UniqueName: \"kubernetes.io/projected/da6eeae9-1f97-4402-a046-572f8ee30e2c-kube-api-access-48kw4\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.361588 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.361554 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/da6eeae9-1f97-4402-a046-572f8ee30e2c-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.361588 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.361598 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.361839 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.361617 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-48kw4\" (UniqueName: \"kubernetes.io/projected/da6eeae9-1f97-4402-a046-572f8ee30e2c-kube-api-access-48kw4\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.361839 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.361694 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/da6eeae9-1f97-4402-a046-572f8ee30e2c-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.361839 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.361720 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.362000 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.361882 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.362000 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.361933 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.362322 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.362293 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.364112 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.364075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/da6eeae9-1f97-4402-a046-572f8ee30e2c-cacerts\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.364237 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.364129 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.364314 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.364301 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/da6eeae9-1f97-4402-a046-572f8ee30e2c-local-certs\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.364439 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.364420 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.378100 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.378040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48kw4\" (UniqueName: \"kubernetes.io/projected/da6eeae9-1f97-4402-a046-572f8ee30e2c-kube-api-access-48kw4\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.378549 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.378533 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da6eeae9-1f97-4402-a046-572f8ee30e2c-istio-token\") pod \"istiod-openshift-gateway-798958bb55-cf7sw\" (UID: \"da6eeae9-1f97-4402-a046-572f8ee30e2c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.441696 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.441656 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:17.596717 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:17.596691 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw"] Jun 01 20:43:17.599447 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:43:17.599415 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6eeae9_1f97_4402_a046_572f8ee30e2c.slice/crio-7cce2ceb3f76f5652b89c71a4c772966aa0a7537307dbb0dc365b6eda87010cd WatchSource:0}: Error finding container 7cce2ceb3f76f5652b89c71a4c772966aa0a7537307dbb0dc365b6eda87010cd: Status 404 returned error can't find the container with id 7cce2ceb3f76f5652b89c71a4c772966aa0a7537307dbb0dc365b6eda87010cd Jun 01 20:43:18.171409 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:18.171375 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" event={"ID":"da6eeae9-1f97-4402-a046-572f8ee30e2c","Type":"ContainerStarted","Data":"7cce2ceb3f76f5652b89c71a4c772966aa0a7537307dbb0dc365b6eda87010cd"} Jun 01 20:43:21.219839 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:21.219796 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 01 20:43:21.220238 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:21.219867 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 01 20:43:22.188817 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:22.188775 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" event={"ID":"da6eeae9-1f97-4402-a046-572f8ee30e2c","Type":"ContainerStarted","Data":"7ed94452308c028b91c56310f0b5d734cc6fa7e08b9d4982e693f27ceb421e38"} Jun 01 20:43:22.189004 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:22.188934 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:22.190895 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:22.190868 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-cf7sw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 01 20:43:22.191032 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:22.190918 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" podUID="da6eeae9-1f97-4402-a046-572f8ee30e2c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 01 20:43:22.211023 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:22.210979 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" podStartSLOduration=1.5928597660000001 podStartE2EDuration="5.210968074s" podCreationTimestamp="2026-06-01 20:43:17 +0000 UTC" firstStartedPulling="2026-06-01 20:43:17.60134034 +0000 UTC m=+545.849639604" lastFinishedPulling="2026-06-01 20:43:21.219448636 +0000 UTC m=+549.467747912" observedRunningTime="2026-06-01 20:43:22.209182451 +0000 UTC m=+550.457481737" watchObservedRunningTime="2026-06-01 20:43:22.210968074 +0000 UTC m=+550.459267359" Jun 01 20:43:23.193675 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:23.193645 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-cf7sw" Jun 01 20:43:29.086005 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:29.085970 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-x2wvz" Jun 01 20:43:29.089073 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:29.089049 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-s7ljm" Jun 01 20:43:45.736495 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:43:45.736452 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759cccfc49-q9xvg"] Jun 01 20:44:00.518445 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.518412 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw"] Jun 01 20:44:00.522070 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.522052 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:00.526549 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.526527 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 01 20:44:00.526678 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.526598 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9gh6b\"" Jun 01 20:44:00.527017 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.527002 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 01 20:44:00.560371 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.560347 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw"] Jun 01 20:44:00.646242 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.646211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:00.646422 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.646253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:00.646422 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.646281 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlhk4\" (UniqueName: \"kubernetes.io/projected/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-kube-api-access-hlhk4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:00.747453 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.747420 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:00.747619 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.747463 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:00.747619 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.747495 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlhk4\" (UniqueName: \"kubernetes.io/projected/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-kube-api-access-hlhk4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:00.747883 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.747859 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:00.747921 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.747893 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:00.761428 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.761405 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlhk4\" (UniqueName: \"kubernetes.io/projected/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-kube-api-access-hlhk4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:00.831650 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.831533 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:00.978394 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:00.978370 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw"] Jun 01 20:44:00.980955 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:44:00.980926 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71421d81_f6b9_4a6a_9cd1_a0ff266aebb8.slice/crio-c9386d8e78be539fa25238e541062d14247cd3b31e91b3498c4a8fa3af95fe1d WatchSource:0}: Error finding container c9386d8e78be539fa25238e541062d14247cd3b31e91b3498c4a8fa3af95fe1d: Status 404 returned error can't find the container with id c9386d8e78be539fa25238e541062d14247cd3b31e91b3498c4a8fa3af95fe1d Jun 01 20:44:01.330755 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.330722 2561 generic.go:358] "Generic (PLEG): container finished" podID="71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" containerID="b4680a65d929aeb195cc1923f2c3186128f4cc1f7eb73d2617a2bb5dedd8b242" exitCode=0 Jun 01 20:44:01.330949 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.330804 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" event={"ID":"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8","Type":"ContainerDied","Data":"b4680a65d929aeb195cc1923f2c3186128f4cc1f7eb73d2617a2bb5dedd8b242"} Jun 01 20:44:01.330949 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.330838 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" event={"ID":"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8","Type":"ContainerStarted","Data":"c9386d8e78be539fa25238e541062d14247cd3b31e91b3498c4a8fa3af95fe1d"} Jun 01 20:44:01.336301 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.336274 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5"] Jun 01 20:44:01.339884 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.339844 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:01.371420 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.371386 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5"] Jun 01 20:44:01.454468 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.454434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:01.454468 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.454469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmrgj\" (UniqueName: \"kubernetes.io/projected/537b130a-96a8-453b-9684-1118a8e456c7-kube-api-access-qmrgj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:01.454697 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.454598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:01.555752 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.555713 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:01.555752 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.555754 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmrgj\" (UniqueName: \"kubernetes.io/projected/537b130a-96a8-453b-9684-1118a8e456c7-kube-api-access-qmrgj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:01.556172 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.555790 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:01.556172 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.556153 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:01.556172 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.556169 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:01.568489 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.568463 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmrgj\" (UniqueName: \"kubernetes.io/projected/537b130a-96a8-453b-9684-1118a8e456c7-kube-api-access-qmrgj\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:01.649422 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.649335 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:01.793672 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.793645 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5"] Jun 01 20:44:01.795772 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:44:01.795741 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537b130a_96a8_453b_9684_1118a8e456c7.slice/crio-87fa094fd88bbfca14ee6b76da46714b65d841c021a40e5931a3a792fb482a0e WatchSource:0}: Error finding container 87fa094fd88bbfca14ee6b76da46714b65d841c021a40e5931a3a792fb482a0e: Status 404 returned error can't find the container with id 87fa094fd88bbfca14ee6b76da46714b65d841c021a40e5931a3a792fb482a0e Jun 01 20:44:01.932013 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.931981 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w"] Jun 01 20:44:01.935482 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.935466 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:01.951469 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:01.951442 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w"] Jun 01 20:44:02.059794 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.059760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:02.059961 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.059847 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:02.059961 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.059894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n76sj\" (UniqueName: \"kubernetes.io/projected/9daaef8c-f3e3-42e1-b257-1234b65a9c65-kube-api-access-n76sj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:02.160930 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.160898 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n76sj\" (UniqueName: \"kubernetes.io/projected/9daaef8c-f3e3-42e1-b257-1234b65a9c65-kube-api-access-n76sj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:02.161023 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.160969 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:02.161085 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.161070 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:02.161417 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.161393 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:02.161485 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.161399 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:02.182530 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.182502 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n76sj\" (UniqueName: \"kubernetes.io/projected/9daaef8c-f3e3-42e1-b257-1234b65a9c65-kube-api-access-n76sj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:02.263149 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.263113 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:02.336211 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.336178 2561 generic.go:358] "Generic (PLEG): container finished" podID="537b130a-96a8-453b-9684-1118a8e456c7" containerID="6f9a4bfc8ff951e56a2862e16c44b2cf097158b87eea27388030b8716acb4bc9" exitCode=0 Jun 01 20:44:02.336391 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.336284 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" event={"ID":"537b130a-96a8-453b-9684-1118a8e456c7","Type":"ContainerDied","Data":"6f9a4bfc8ff951e56a2862e16c44b2cf097158b87eea27388030b8716acb4bc9"} Jun 01 20:44:02.336391 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.336320 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" event={"ID":"537b130a-96a8-453b-9684-1118a8e456c7","Type":"ContainerStarted","Data":"87fa094fd88bbfca14ee6b76da46714b65d841c021a40e5931a3a792fb482a0e"} Jun 01 20:44:02.338124 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.338098 2561 generic.go:358] "Generic (PLEG): container finished" podID="71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" containerID="26a5dbd41b663d85b4d7dcdec07cf5d6bfec6cbcb56f40c5653335ed66f98e4f" exitCode=0 Jun 01 20:44:02.338229 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.338174 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" event={"ID":"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8","Type":"ContainerDied","Data":"26a5dbd41b663d85b4d7dcdec07cf5d6bfec6cbcb56f40c5653335ed66f98e4f"} Jun 01 20:44:02.405661 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.405618 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b"] Jun 01 20:44:02.410770 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.410751 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:02.437705 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.437677 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b"] Jun 01 20:44:02.440248 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.440222 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w"] Jun 01 20:44:02.440442 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:44:02.440421 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9daaef8c_f3e3_42e1_b257_1234b65a9c65.slice/crio-86c850abc7c201e30cbc45e30b8af65b1ef1633816a37b0c29cdf9b1e29e1080 WatchSource:0}: Error finding container 86c850abc7c201e30cbc45e30b8af65b1ef1633816a37b0c29cdf9b1e29e1080: Status 404 returned error can't find the container with id 86c850abc7c201e30cbc45e30b8af65b1ef1633816a37b0c29cdf9b1e29e1080 Jun 01 20:44:02.563917 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.563890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w4h8\" (UniqueName: \"kubernetes.io/projected/e14ac613-10f3-41ab-87dd-c1b06c377456-kube-api-access-2w4h8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:02.564234 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.563933 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:02.564234 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.563992 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:02.665001 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.664927 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:02.665001 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.664991 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:02.665192 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.665103 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2w4h8\" (UniqueName: \"kubernetes.io/projected/e14ac613-10f3-41ab-87dd-c1b06c377456-kube-api-access-2w4h8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:02.665289 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.665268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:02.665346 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.665300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:02.685736 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.685712 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w4h8\" (UniqueName: \"kubernetes.io/projected/e14ac613-10f3-41ab-87dd-c1b06c377456-kube-api-access-2w4h8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:02.720341 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.720315 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:02.864155 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:02.864126 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b"] Jun 01 20:44:02.865279 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:44:02.865254 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14ac613_10f3_41ab_87dd_c1b06c377456.slice/crio-ac6603caf8936d9d80f9149d14b8fe8f78d5c93398c3c8fae7bf1f445af59389 WatchSource:0}: Error finding container ac6603caf8936d9d80f9149d14b8fe8f78d5c93398c3c8fae7bf1f445af59389: Status 404 returned error can't find the container with id ac6603caf8936d9d80f9149d14b8fe8f78d5c93398c3c8fae7bf1f445af59389 Jun 01 20:44:03.344821 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:03.344788 2561 generic.go:358] "Generic (PLEG): container finished" podID="9daaef8c-f3e3-42e1-b257-1234b65a9c65" containerID="07c80b5602a18234e567735d04fc33ec8dbf3fd679e364873fa362bc043a4d52" exitCode=0 Jun 01 20:44:03.345003 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:03.344873 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" event={"ID":"9daaef8c-f3e3-42e1-b257-1234b65a9c65","Type":"ContainerDied","Data":"07c80b5602a18234e567735d04fc33ec8dbf3fd679e364873fa362bc043a4d52"} Jun 01 20:44:03.345003 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:03.344909 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" event={"ID":"9daaef8c-f3e3-42e1-b257-1234b65a9c65","Type":"ContainerStarted","Data":"86c850abc7c201e30cbc45e30b8af65b1ef1633816a37b0c29cdf9b1e29e1080"} Jun 01 20:44:03.346216 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:03.346197 2561 generic.go:358] "Generic (PLEG): container finished" podID="e14ac613-10f3-41ab-87dd-c1b06c377456" containerID="f63786323ca5ec1383fc1604783d82a4bc80ff57724ba0c0bbf1883facf66f0f" exitCode=0 Jun 01 20:44:03.346314 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:03.346273 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" event={"ID":"e14ac613-10f3-41ab-87dd-c1b06c377456","Type":"ContainerDied","Data":"f63786323ca5ec1383fc1604783d82a4bc80ff57724ba0c0bbf1883facf66f0f"} Jun 01 20:44:03.346314 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:03.346300 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" event={"ID":"e14ac613-10f3-41ab-87dd-c1b06c377456","Type":"ContainerStarted","Data":"ac6603caf8936d9d80f9149d14b8fe8f78d5c93398c3c8fae7bf1f445af59389"} Jun 01 20:44:03.347994 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:03.347964 2561 generic.go:358] "Generic (PLEG): container finished" podID="537b130a-96a8-453b-9684-1118a8e456c7" containerID="a29f2a6673edf819fc6c7a4dd798e446d7b3e9ad8cec05f5db8aceb7c06c5ce4" exitCode=0 Jun 01 20:44:03.348083 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:03.348048 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" event={"ID":"537b130a-96a8-453b-9684-1118a8e456c7","Type":"ContainerDied","Data":"a29f2a6673edf819fc6c7a4dd798e446d7b3e9ad8cec05f5db8aceb7c06c5ce4"} Jun 01 20:44:03.350027 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:03.350010 2561 generic.go:358] "Generic (PLEG): container finished" podID="71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" containerID="d9380e834f5a638bcb10cb5d0266535f130a677e10788417b645dcfad8fa5806" exitCode=0 Jun 01 20:44:03.350107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:03.350071 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" event={"ID":"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8","Type":"ContainerDied","Data":"d9380e834f5a638bcb10cb5d0266535f130a677e10788417b645dcfad8fa5806"} Jun 01 20:44:03.498922 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:44:03.498892 2561 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537b130a_96a8_453b_9684_1118a8e456c7.slice/crio-e90ba0fa853fec66389681870933d2973bb107388901e812ebb0a2571d6072f1.scope\": RecentStats: unable to find data in memory cache]" Jun 01 20:44:04.354955 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.354926 2561 generic.go:358] "Generic (PLEG): container finished" podID="9daaef8c-f3e3-42e1-b257-1234b65a9c65" containerID="e7f9dcdabe32384b887ab431594837afba05ada863b5a4a91dff272678bbac62" exitCode=0 Jun 01 20:44:04.355262 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.355015 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" event={"ID":"9daaef8c-f3e3-42e1-b257-1234b65a9c65","Type":"ContainerDied","Data":"e7f9dcdabe32384b887ab431594837afba05ada863b5a4a91dff272678bbac62"} Jun 01 20:44:04.356870 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.356845 2561 generic.go:358] "Generic (PLEG): container finished" podID="e14ac613-10f3-41ab-87dd-c1b06c377456" containerID="a526978e24de8d5585c31436596a9a3ab439786e1bb220b398e3f53a74500a51" exitCode=0 Jun 01 20:44:04.356943 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.356899 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" event={"ID":"e14ac613-10f3-41ab-87dd-c1b06c377456","Type":"ContainerDied","Data":"a526978e24de8d5585c31436596a9a3ab439786e1bb220b398e3f53a74500a51"} Jun 01 20:44:04.358859 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.358842 2561 generic.go:358] "Generic (PLEG): container finished" podID="537b130a-96a8-453b-9684-1118a8e456c7" containerID="e90ba0fa853fec66389681870933d2973bb107388901e812ebb0a2571d6072f1" exitCode=0 Jun 01 20:44:04.358940 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.358915 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" event={"ID":"537b130a-96a8-453b-9684-1118a8e456c7","Type":"ContainerDied","Data":"e90ba0fa853fec66389681870933d2973bb107388901e812ebb0a2571d6072f1"} Jun 01 20:44:04.487492 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.487467 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:04.583254 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.583224 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-bundle\") pod \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " Jun 01 20:44:04.583373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.583264 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlhk4\" (UniqueName: \"kubernetes.io/projected/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-kube-api-access-hlhk4\") pod \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " Jun 01 20:44:04.583373 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.583302 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-util\") pod \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\" (UID: \"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8\") " Jun 01 20:44:04.583773 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.583750 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-bundle" (OuterVolumeSpecName: "bundle") pod "71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" (UID: "71421d81-f6b9-4a6a-9cd1-a0ff266aebb8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:44:04.585410 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.585388 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-kube-api-access-hlhk4" (OuterVolumeSpecName: "kube-api-access-hlhk4") pod "71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" (UID: "71421d81-f6b9-4a6a-9cd1-a0ff266aebb8"). InnerVolumeSpecName "kube-api-access-hlhk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:44:04.588666 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.588642 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-util" (OuterVolumeSpecName: "util") pod "71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" (UID: "71421d81-f6b9-4a6a-9cd1-a0ff266aebb8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:44:04.684812 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.684727 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:04.684812 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.684758 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlhk4\" (UniqueName: \"kubernetes.io/projected/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-kube-api-access-hlhk4\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:04.684812 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:04.684769 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71421d81-f6b9-4a6a-9cd1-a0ff266aebb8-util\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:05.364341 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.364310 2561 generic.go:358] "Generic (PLEG): container finished" podID="9daaef8c-f3e3-42e1-b257-1234b65a9c65" containerID="0495e879ccc037f5d3400c693edec030239a046f059bae66131fa38b2491703c" exitCode=0 Jun 01 20:44:05.364740 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.364387 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" event={"ID":"9daaef8c-f3e3-42e1-b257-1234b65a9c65","Type":"ContainerDied","Data":"0495e879ccc037f5d3400c693edec030239a046f059bae66131fa38b2491703c"} Jun 01 20:44:05.366236 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.366215 2561 generic.go:358] "Generic (PLEG): container finished" podID="e14ac613-10f3-41ab-87dd-c1b06c377456" containerID="8839a90ecdf3c512c6e31211bead30fea4e3436c25c2425ea9f867849591501e" exitCode=0 Jun 01 20:44:05.366311 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.366292 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" event={"ID":"e14ac613-10f3-41ab-87dd-c1b06c377456","Type":"ContainerDied","Data":"8839a90ecdf3c512c6e31211bead30fea4e3436c25c2425ea9f867849591501e"} Jun 01 20:44:05.367918 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.367901 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" Jun 01 20:44:05.368030 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.367924 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw" event={"ID":"71421d81-f6b9-4a6a-9cd1-a0ff266aebb8","Type":"ContainerDied","Data":"c9386d8e78be539fa25238e541062d14247cd3b31e91b3498c4a8fa3af95fe1d"} Jun 01 20:44:05.368030 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.367949 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9386d8e78be539fa25238e541062d14247cd3b31e91b3498c4a8fa3af95fe1d" Jun 01 20:44:05.496997 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.496974 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:05.592107 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.592074 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmrgj\" (UniqueName: \"kubernetes.io/projected/537b130a-96a8-453b-9684-1118a8e456c7-kube-api-access-qmrgj\") pod \"537b130a-96a8-453b-9684-1118a8e456c7\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " Jun 01 20:44:05.592285 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.592127 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-util\") pod \"537b130a-96a8-453b-9684-1118a8e456c7\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " Jun 01 20:44:05.592285 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.592153 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-bundle\") pod \"537b130a-96a8-453b-9684-1118a8e456c7\" (UID: \"537b130a-96a8-453b-9684-1118a8e456c7\") " Jun 01 20:44:05.592771 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.592742 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-bundle" (OuterVolumeSpecName: "bundle") pod "537b130a-96a8-453b-9684-1118a8e456c7" (UID: "537b130a-96a8-453b-9684-1118a8e456c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:44:05.594203 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.594182 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/537b130a-96a8-453b-9684-1118a8e456c7-kube-api-access-qmrgj" (OuterVolumeSpecName: "kube-api-access-qmrgj") pod "537b130a-96a8-453b-9684-1118a8e456c7" (UID: "537b130a-96a8-453b-9684-1118a8e456c7"). InnerVolumeSpecName "kube-api-access-qmrgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:44:05.597486 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.597466 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-util" (OuterVolumeSpecName: "util") pod "537b130a-96a8-453b-9684-1118a8e456c7" (UID: "537b130a-96a8-453b-9684-1118a8e456c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:44:05.693097 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.693006 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-util\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:05.693097 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.693040 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/537b130a-96a8-453b-9684-1118a8e456c7-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:05.693097 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:05.693054 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmrgj\" (UniqueName: \"kubernetes.io/projected/537b130a-96a8-453b-9684-1118a8e456c7-kube-api-access-qmrgj\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:06.378645 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.378583 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" event={"ID":"537b130a-96a8-453b-9684-1118a8e456c7","Type":"ContainerDied","Data":"87fa094fd88bbfca14ee6b76da46714b65d841c021a40e5931a3a792fb482a0e"} Jun 01 20:44:06.378645 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.378636 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5" Jun 01 20:44:06.379038 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.378653 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87fa094fd88bbfca14ee6b76da46714b65d841c021a40e5931a3a792fb482a0e" Jun 01 20:44:06.510061 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.510042 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:06.546743 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.546683 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:06.600824 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.600797 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-util\") pod \"e14ac613-10f3-41ab-87dd-c1b06c377456\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " Jun 01 20:44:06.600962 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.600833 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w4h8\" (UniqueName: \"kubernetes.io/projected/e14ac613-10f3-41ab-87dd-c1b06c377456-kube-api-access-2w4h8\") pod \"e14ac613-10f3-41ab-87dd-c1b06c377456\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " Jun 01 20:44:06.600962 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.600874 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-bundle\") pod \"e14ac613-10f3-41ab-87dd-c1b06c377456\" (UID: \"e14ac613-10f3-41ab-87dd-c1b06c377456\") " Jun 01 20:44:06.601547 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.601493 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-bundle" (OuterVolumeSpecName: "bundle") pod "e14ac613-10f3-41ab-87dd-c1b06c377456" (UID: "e14ac613-10f3-41ab-87dd-c1b06c377456"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:44:06.603008 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.602984 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14ac613-10f3-41ab-87dd-c1b06c377456-kube-api-access-2w4h8" (OuterVolumeSpecName: "kube-api-access-2w4h8") pod "e14ac613-10f3-41ab-87dd-c1b06c377456" (UID: "e14ac613-10f3-41ab-87dd-c1b06c377456"). InnerVolumeSpecName "kube-api-access-2w4h8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:44:06.606040 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.606009 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-util" (OuterVolumeSpecName: "util") pod "e14ac613-10f3-41ab-87dd-c1b06c377456" (UID: "e14ac613-10f3-41ab-87dd-c1b06c377456"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:44:06.701896 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.701864 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-util\") pod \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " Jun 01 20:44:06.701896 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.701901 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-bundle\") pod \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " Jun 01 20:44:06.702092 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.701955 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n76sj\" (UniqueName: \"kubernetes.io/projected/9daaef8c-f3e3-42e1-b257-1234b65a9c65-kube-api-access-n76sj\") pod \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\" (UID: \"9daaef8c-f3e3-42e1-b257-1234b65a9c65\") " Jun 01 20:44:06.702239 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.702222 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-util\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:06.702304 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.702245 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w4h8\" (UniqueName: \"kubernetes.io/projected/e14ac613-10f3-41ab-87dd-c1b06c377456-kube-api-access-2w4h8\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:06.702304 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.702259 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e14ac613-10f3-41ab-87dd-c1b06c377456-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:06.702400 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.702363 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-bundle" (OuterVolumeSpecName: "bundle") pod "9daaef8c-f3e3-42e1-b257-1234b65a9c65" (UID: "9daaef8c-f3e3-42e1-b257-1234b65a9c65"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:44:06.704086 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.704062 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9daaef8c-f3e3-42e1-b257-1234b65a9c65-kube-api-access-n76sj" (OuterVolumeSpecName: "kube-api-access-n76sj") pod "9daaef8c-f3e3-42e1-b257-1234b65a9c65" (UID: "9daaef8c-f3e3-42e1-b257-1234b65a9c65"). InnerVolumeSpecName "kube-api-access-n76sj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:44:06.707301 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.707282 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-util" (OuterVolumeSpecName: "util") pod "9daaef8c-f3e3-42e1-b257-1234b65a9c65" (UID: "9daaef8c-f3e3-42e1-b257-1234b65a9c65"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:44:06.803231 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.803137 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-util\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:06.803231 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.803171 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9daaef8c-f3e3-42e1-b257-1234b65a9c65-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:06.803231 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:06.803186 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n76sj\" (UniqueName: \"kubernetes.io/projected/9daaef8c-f3e3-42e1-b257-1234b65a9c65-kube-api-access-n76sj\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:07.383866 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:07.383826 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" event={"ID":"9daaef8c-f3e3-42e1-b257-1234b65a9c65","Type":"ContainerDied","Data":"86c850abc7c201e30cbc45e30b8af65b1ef1633816a37b0c29cdf9b1e29e1080"} Jun 01 20:44:07.383866 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:07.383870 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86c850abc7c201e30cbc45e30b8af65b1ef1633816a37b0c29cdf9b1e29e1080" Jun 01 20:44:07.384336 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:07.383838 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w" Jun 01 20:44:07.385491 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:07.385470 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" Jun 01 20:44:07.385578 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:07.385473 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b" event={"ID":"e14ac613-10f3-41ab-87dd-c1b06c377456","Type":"ContainerDied","Data":"ac6603caf8936d9d80f9149d14b8fe8f78d5c93398c3c8fae7bf1f445af59389"} Jun 01 20:44:07.385613 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:07.385577 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac6603caf8936d9d80f9149d14b8fe8f78d5c93398c3c8fae7bf1f445af59389" Jun 01 20:44:10.756186 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:10.756122 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-759cccfc49-q9xvg" podUID="02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" containerName="console" containerID="cri-o://4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb" gracePeriod=15 Jun 01 20:44:11.006923 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.006868 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-759cccfc49-q9xvg_02273e74-51f0-4ed8-ac1c-bfcf59ae63a9/console/0.log" Jun 01 20:44:11.007023 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.006925 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:44:11.145804 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.145773 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-trusted-ca-bundle\") pod \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " Jun 01 20:44:11.145977 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.145820 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-config\") pod \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " Jun 01 20:44:11.145977 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.145872 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-oauth-serving-cert\") pod \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " Jun 01 20:44:11.145977 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.145934 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-serving-cert\") pod \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " Jun 01 20:44:11.146140 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.145984 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-oauth-config\") pod \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " Jun 01 20:44:11.146140 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.146024 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dwsn\" (UniqueName: \"kubernetes.io/projected/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-kube-api-access-8dwsn\") pod \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " Jun 01 20:44:11.146140 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.146069 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-service-ca\") pod \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\" (UID: \"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9\") " Jun 01 20:44:11.146285 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.146256 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" (UID: "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:44:11.146341 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.146325 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-trusted-ca-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:11.146405 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.146332 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" (UID: "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:44:11.146405 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.146161 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-config" (OuterVolumeSpecName: "console-config") pod "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" (UID: "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:44:11.146548 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.146522 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" (UID: "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:44:11.148312 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.148290 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" (UID: "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 01 20:44:11.148414 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.148343 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-kube-api-access-8dwsn" (OuterVolumeSpecName: "kube-api-access-8dwsn") pod "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" (UID: "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9"). InnerVolumeSpecName "kube-api-access-8dwsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:44:11.148414 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.148347 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" (UID: "02273e74-51f0-4ed8-ac1c-bfcf59ae63a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 01 20:44:11.246902 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.246863 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-service-ca\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:11.246902 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.246897 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-config\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:11.246902 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.246910 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-oauth-serving-cert\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:11.247181 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.246922 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-serving-cert\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:11.247181 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.246935 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-console-oauth-config\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:11.247181 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.246949 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dwsn\" (UniqueName: \"kubernetes.io/projected/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9-kube-api-access-8dwsn\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:44:11.403138 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.403051 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-759cccfc49-q9xvg_02273e74-51f0-4ed8-ac1c-bfcf59ae63a9/console/0.log" Jun 01 20:44:11.403138 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.403092 2561 generic.go:358] "Generic (PLEG): container finished" podID="02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" containerID="4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb" exitCode=2 Jun 01 20:44:11.403138 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.403122 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759cccfc49-q9xvg" event={"ID":"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9","Type":"ContainerDied","Data":"4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb"} Jun 01 20:44:11.403406 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.403166 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759cccfc49-q9xvg" event={"ID":"02273e74-51f0-4ed8-ac1c-bfcf59ae63a9","Type":"ContainerDied","Data":"c8a193aec44a74ad0c765ddfc51b09f545d47c26498004e4c72d89592272364c"} Jun 01 20:44:11.403406 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.403171 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759cccfc49-q9xvg" Jun 01 20:44:11.403406 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.403182 2561 scope.go:117] "RemoveContainer" containerID="4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb" Jun 01 20:44:11.412932 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.412916 2561 scope.go:117] "RemoveContainer" containerID="4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb" Jun 01 20:44:11.413173 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:44:11.413154 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb\": container with ID starting with 4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb not found: ID does not exist" containerID="4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb" Jun 01 20:44:11.413236 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.413186 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb"} err="failed to get container status \"4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb\": rpc error: code = NotFound desc = could not find container \"4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb\": container with ID starting with 4e6978b97723d2c95b197f970fde14007995b220cbac50f765f95332f33abcdb not found: ID does not exist" Jun 01 20:44:11.452658 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.452612 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759cccfc49-q9xvg"] Jun 01 20:44:11.459468 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:11.459443 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-759cccfc49-q9xvg"] Jun 01 20:44:12.227748 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:12.227722 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:44:12.227748 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:12.227737 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:44:12.277110 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:12.276991 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" path="/var/lib/kubelet/pods/02273e74-51f0-4ed8-ac1c-bfcf59ae63a9/volumes" Jun 01 20:44:21.327921 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.327879 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-v852h"] Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328243 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" containerName="console" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328259 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" containerName="console" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328268 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" containerName="util" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328274 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" containerName="util" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328289 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14ac613-10f3-41ab-87dd-c1b06c377456" containerName="util" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328296 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14ac613-10f3-41ab-87dd-c1b06c377456" containerName="util" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328302 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9daaef8c-f3e3-42e1-b257-1234b65a9c65" containerName="pull" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328307 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9daaef8c-f3e3-42e1-b257-1234b65a9c65" containerName="pull" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328317 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" containerName="pull" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328322 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" containerName="pull" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328334 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="537b130a-96a8-453b-9684-1118a8e456c7" containerName="util" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328339 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="537b130a-96a8-453b-9684-1118a8e456c7" containerName="util" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328346 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9daaef8c-f3e3-42e1-b257-1234b65a9c65" containerName="util" Jun 01 20:44:21.328347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328351 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9daaef8c-f3e3-42e1-b257-1234b65a9c65" containerName="util" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328360 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" containerName="extract" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328367 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" containerName="extract" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328377 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9daaef8c-f3e3-42e1-b257-1234b65a9c65" containerName="extract" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328385 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9daaef8c-f3e3-42e1-b257-1234b65a9c65" containerName="extract" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328395 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14ac613-10f3-41ab-87dd-c1b06c377456" containerName="pull" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328400 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14ac613-10f3-41ab-87dd-c1b06c377456" containerName="pull" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328407 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14ac613-10f3-41ab-87dd-c1b06c377456" containerName="extract" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328414 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14ac613-10f3-41ab-87dd-c1b06c377456" containerName="extract" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328424 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="537b130a-96a8-453b-9684-1118a8e456c7" containerName="extract" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328430 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="537b130a-96a8-453b-9684-1118a8e456c7" containerName="extract" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328442 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="537b130a-96a8-453b-9684-1118a8e456c7" containerName="pull" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328450 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="537b130a-96a8-453b-9684-1118a8e456c7" containerName="pull" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328524 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="02273e74-51f0-4ed8-ac1c-bfcf59ae63a9" containerName="console" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328534 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="71421d81-f6b9-4a6a-9cd1-a0ff266aebb8" containerName="extract" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328543 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="9daaef8c-f3e3-42e1-b257-1234b65a9c65" containerName="extract" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328553 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="e14ac613-10f3-41ab-87dd-c1b06c377456" containerName="extract" Jun 01 20:44:21.328950 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.328563 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="537b130a-96a8-453b-9684-1118a8e456c7" containerName="extract" Jun 01 20:44:21.332870 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.332852 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-v852h" Jun 01 20:44:21.341814 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.341793 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 01 20:44:21.342369 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.342353 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 01 20:44:21.342429 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.342357 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-q8qqv\"" Jun 01 20:44:21.382247 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.382220 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-v852h"] Jun 01 20:44:21.431418 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.431383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvn48\" (UniqueName: \"kubernetes.io/projected/d7cc3b67-709a-4e2c-b81f-f3d650cd37b3-kube-api-access-lvn48\") pod \"authorino-operator-657f44b778-v852h\" (UID: \"d7cc3b67-709a-4e2c-b81f-f3d650cd37b3\") " pod="kuadrant-system/authorino-operator-657f44b778-v852h" Jun 01 20:44:21.532302 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.532256 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvn48\" (UniqueName: \"kubernetes.io/projected/d7cc3b67-709a-4e2c-b81f-f3d650cd37b3-kube-api-access-lvn48\") pod \"authorino-operator-657f44b778-v852h\" (UID: \"d7cc3b67-709a-4e2c-b81f-f3d650cd37b3\") " pod="kuadrant-system/authorino-operator-657f44b778-v852h" Jun 01 20:44:21.556403 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.556371 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvn48\" (UniqueName: \"kubernetes.io/projected/d7cc3b67-709a-4e2c-b81f-f3d650cd37b3-kube-api-access-lvn48\") pod \"authorino-operator-657f44b778-v852h\" (UID: \"d7cc3b67-709a-4e2c-b81f-f3d650cd37b3\") " pod="kuadrant-system/authorino-operator-657f44b778-v852h" Jun 01 20:44:21.642505 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.642410 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-v852h" Jun 01 20:44:21.820334 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:21.820302 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-v852h"] Jun 01 20:44:21.823541 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:44:21.823502 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7cc3b67_709a_4e2c_b81f_f3d650cd37b3.slice/crio-1ef67b58fa8cfc4ea6c9012050371ad4cab3f239740f7846760294220b1ea5a5 WatchSource:0}: Error finding container 1ef67b58fa8cfc4ea6c9012050371ad4cab3f239740f7846760294220b1ea5a5: Status 404 returned error can't find the container with id 1ef67b58fa8cfc4ea6c9012050371ad4cab3f239740f7846760294220b1ea5a5 Jun 01 20:44:22.449613 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:22.449569 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-v852h" event={"ID":"d7cc3b67-709a-4e2c-b81f-f3d650cd37b3","Type":"ContainerStarted","Data":"1ef67b58fa8cfc4ea6c9012050371ad4cab3f239740f7846760294220b1ea5a5"} Jun 01 20:44:24.458337 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:24.458303 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-v852h" event={"ID":"d7cc3b67-709a-4e2c-b81f-f3d650cd37b3","Type":"ContainerStarted","Data":"955b8741779bc7828cad66132124bf9acf3a0a19608071c06cd1f7bdb99494d3"} Jun 01 20:44:24.458751 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:24.458362 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-v852h" Jun 01 20:44:35.465122 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:35.465089 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-v852h" Jun 01 20:44:35.520152 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:44:35.520102 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-v852h" podStartSLOduration=12.333918038 podStartE2EDuration="14.520087605s" podCreationTimestamp="2026-06-01 20:44:21 +0000 UTC" firstStartedPulling="2026-06-01 20:44:21.825581391 +0000 UTC m=+610.073880655" lastFinishedPulling="2026-06-01 20:44:24.011750954 +0000 UTC m=+612.260050222" observedRunningTime="2026-06-01 20:44:24.498153774 +0000 UTC m=+612.746453060" watchObservedRunningTime="2026-06-01 20:44:35.520087605 +0000 UTC m=+623.768386891" Jun 01 20:45:21.775220 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.775180 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfmq5"] Jun 01 20:45:21.780761 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.780741 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:21.783126 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.783105 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 01 20:45:21.783235 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.783147 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9gh6b\"" Jun 01 20:45:21.793777 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.793754 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfmq5"] Jun 01 20:45:21.870236 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.870205 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfmq5"] Jun 01 20:45:21.873353 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.873323 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c651ad4-af8f-47aa-8845-78ba388e1d3e-config-file\") pod \"limitador-limitador-7d549b5b-sfmq5\" (UID: \"0c651ad4-af8f-47aa-8845-78ba388e1d3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:21.873500 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.873361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmb7x\" (UniqueName: \"kubernetes.io/projected/0c651ad4-af8f-47aa-8845-78ba388e1d3e-kube-api-access-cmb7x\") pod \"limitador-limitador-7d549b5b-sfmq5\" (UID: \"0c651ad4-af8f-47aa-8845-78ba388e1d3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:21.974737 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.974696 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c651ad4-af8f-47aa-8845-78ba388e1d3e-config-file\") pod \"limitador-limitador-7d549b5b-sfmq5\" (UID: \"0c651ad4-af8f-47aa-8845-78ba388e1d3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:21.974737 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.974751 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmb7x\" (UniqueName: \"kubernetes.io/projected/0c651ad4-af8f-47aa-8845-78ba388e1d3e-kube-api-access-cmb7x\") pod \"limitador-limitador-7d549b5b-sfmq5\" (UID: \"0c651ad4-af8f-47aa-8845-78ba388e1d3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:21.975477 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.975451 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c651ad4-af8f-47aa-8845-78ba388e1d3e-config-file\") pod \"limitador-limitador-7d549b5b-sfmq5\" (UID: \"0c651ad4-af8f-47aa-8845-78ba388e1d3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:21.982524 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:21.982486 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmb7x\" (UniqueName: \"kubernetes.io/projected/0c651ad4-af8f-47aa-8845-78ba388e1d3e-kube-api-access-cmb7x\") pod \"limitador-limitador-7d549b5b-sfmq5\" (UID: \"0c651ad4-af8f-47aa-8845-78ba388e1d3e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:22.091087 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:22.091007 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:22.223709 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:22.223688 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfmq5"] Jun 01 20:45:22.225853 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:45:22.225819 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c651ad4_af8f_47aa_8845_78ba388e1d3e.slice/crio-ca9f208b65315e33c7e861c0d79293b6ffb76295601dafcedc948753216af297 WatchSource:0}: Error finding container ca9f208b65315e33c7e861c0d79293b6ffb76295601dafcedc948753216af297: Status 404 returned error can't find the container with id ca9f208b65315e33c7e861c0d79293b6ffb76295601dafcedc948753216af297 Jun 01 20:45:22.685927 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:22.685893 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" event={"ID":"0c651ad4-af8f-47aa-8845-78ba388e1d3e","Type":"ContainerStarted","Data":"ca9f208b65315e33c7e861c0d79293b6ffb76295601dafcedc948753216af297"} Jun 01 20:45:25.699099 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:25.699061 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" event={"ID":"0c651ad4-af8f-47aa-8845-78ba388e1d3e","Type":"ContainerStarted","Data":"7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd"} Jun 01 20:45:25.699534 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:25.699118 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:25.730538 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:25.730485 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" podStartSLOduration=2.061694726 podStartE2EDuration="4.730469789s" podCreationTimestamp="2026-06-01 20:45:21 +0000 UTC" firstStartedPulling="2026-06-01 20:45:22.227833015 +0000 UTC m=+670.476132279" lastFinishedPulling="2026-06-01 20:45:24.896608066 +0000 UTC m=+673.144907342" observedRunningTime="2026-06-01 20:45:25.728372319 +0000 UTC m=+673.976671606" watchObservedRunningTime="2026-06-01 20:45:25.730469789 +0000 UTC m=+673.978769112" Jun 01 20:45:36.707611 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:36.707576 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:37.084817 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.084725 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfmq5"] Jun 01 20:45:37.085014 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.084988 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" podUID="0c651ad4-af8f-47aa-8845-78ba388e1d3e" containerName="limitador" containerID="cri-o://7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd" gracePeriod=30 Jun 01 20:45:37.626800 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.626780 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:37.713195 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.713169 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c651ad4-af8f-47aa-8845-78ba388e1d3e-config-file\") pod \"0c651ad4-af8f-47aa-8845-78ba388e1d3e\" (UID: \"0c651ad4-af8f-47aa-8845-78ba388e1d3e\") " Jun 01 20:45:37.713543 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.713279 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmb7x\" (UniqueName: \"kubernetes.io/projected/0c651ad4-af8f-47aa-8845-78ba388e1d3e-kube-api-access-cmb7x\") pod \"0c651ad4-af8f-47aa-8845-78ba388e1d3e\" (UID: \"0c651ad4-af8f-47aa-8845-78ba388e1d3e\") " Jun 01 20:45:37.713584 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.713567 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c651ad4-af8f-47aa-8845-78ba388e1d3e-config-file" (OuterVolumeSpecName: "config-file") pod "0c651ad4-af8f-47aa-8845-78ba388e1d3e" (UID: "0c651ad4-af8f-47aa-8845-78ba388e1d3e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 01 20:45:37.715258 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.715238 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c651ad4-af8f-47aa-8845-78ba388e1d3e-kube-api-access-cmb7x" (OuterVolumeSpecName: "kube-api-access-cmb7x") pod "0c651ad4-af8f-47aa-8845-78ba388e1d3e" (UID: "0c651ad4-af8f-47aa-8845-78ba388e1d3e"). InnerVolumeSpecName "kube-api-access-cmb7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:45:37.757074 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.757044 2561 generic.go:358] "Generic (PLEG): container finished" podID="0c651ad4-af8f-47aa-8845-78ba388e1d3e" containerID="7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd" exitCode=0 Jun 01 20:45:37.757196 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.757113 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" Jun 01 20:45:37.757196 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.757124 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" event={"ID":"0c651ad4-af8f-47aa-8845-78ba388e1d3e","Type":"ContainerDied","Data":"7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd"} Jun 01 20:45:37.757196 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.757165 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sfmq5" event={"ID":"0c651ad4-af8f-47aa-8845-78ba388e1d3e","Type":"ContainerDied","Data":"ca9f208b65315e33c7e861c0d79293b6ffb76295601dafcedc948753216af297"} Jun 01 20:45:37.757196 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.757180 2561 scope.go:117] "RemoveContainer" containerID="7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd" Jun 01 20:45:37.765800 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.765784 2561 scope.go:117] "RemoveContainer" containerID="7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd" Jun 01 20:45:37.766054 ip-10-0-134-139 kubenswrapper[2561]: E0601 20:45:37.766039 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd\": container with ID starting with 7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd not found: ID does not exist" containerID="7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd" Jun 01 20:45:37.766109 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.766059 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd"} err="failed to get container status \"7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd\": rpc error: code = NotFound desc = could not find container \"7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd\": container with ID starting with 7f5361a676bbd91a63cce0e780ea72d3d0ac086abdd3ceac2c0c2e2a033993fd not found: ID does not exist" Jun 01 20:45:37.780981 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.780955 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfmq5"] Jun 01 20:45:37.783065 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.783044 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sfmq5"] Jun 01 20:45:37.814642 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.814600 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmb7x\" (UniqueName: \"kubernetes.io/projected/0c651ad4-af8f-47aa-8845-78ba388e1d3e-kube-api-access-cmb7x\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:45:37.814723 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:37.814645 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0c651ad4-af8f-47aa-8845-78ba388e1d3e-config-file\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:45:38.277529 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:38.277497 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c651ad4-af8f-47aa-8845-78ba388e1d3e" path="/var/lib/kubelet/pods/0c651ad4-af8f-47aa-8845-78ba388e1d3e/volumes" Jun 01 20:45:43.018240 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.018209 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-nhvhm"] Jun 01 20:45:43.018729 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.018604 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c651ad4-af8f-47aa-8845-78ba388e1d3e" containerName="limitador" Jun 01 20:45:43.018729 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.018617 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c651ad4-af8f-47aa-8845-78ba388e1d3e" containerName="limitador" Jun 01 20:45:43.018729 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.018712 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c651ad4-af8f-47aa-8845-78ba388e1d3e" containerName="limitador" Jun 01 20:45:43.023085 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.023068 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-nhvhm" Jun 01 20:45:43.030904 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.030885 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 01 20:45:43.036166 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.036142 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-nhvhm"] Jun 01 20:45:43.160712 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.160671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tks6r\" (UniqueName: \"kubernetes.io/projected/0bc824e9-cca5-414e-91ad-0c24bbb56f5d-kube-api-access-tks6r\") pod \"postgres-68c4fbbd6f-nhvhm\" (UID: \"0bc824e9-cca5-414e-91ad-0c24bbb56f5d\") " pod="opendatahub/postgres-68c4fbbd6f-nhvhm" Jun 01 20:45:43.160882 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.160726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0bc824e9-cca5-414e-91ad-0c24bbb56f5d-data\") pod \"postgres-68c4fbbd6f-nhvhm\" (UID: \"0bc824e9-cca5-414e-91ad-0c24bbb56f5d\") " pod="opendatahub/postgres-68c4fbbd6f-nhvhm" Jun 01 20:45:43.261713 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.261673 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tks6r\" (UniqueName: \"kubernetes.io/projected/0bc824e9-cca5-414e-91ad-0c24bbb56f5d-kube-api-access-tks6r\") pod \"postgres-68c4fbbd6f-nhvhm\" (UID: \"0bc824e9-cca5-414e-91ad-0c24bbb56f5d\") " pod="opendatahub/postgres-68c4fbbd6f-nhvhm" Jun 01 20:45:43.261884 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.261737 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0bc824e9-cca5-414e-91ad-0c24bbb56f5d-data\") pod \"postgres-68c4fbbd6f-nhvhm\" (UID: \"0bc824e9-cca5-414e-91ad-0c24bbb56f5d\") " pod="opendatahub/postgres-68c4fbbd6f-nhvhm" Jun 01 20:45:43.262129 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.262110 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0bc824e9-cca5-414e-91ad-0c24bbb56f5d-data\") pod \"postgres-68c4fbbd6f-nhvhm\" (UID: \"0bc824e9-cca5-414e-91ad-0c24bbb56f5d\") " pod="opendatahub/postgres-68c4fbbd6f-nhvhm" Jun 01 20:45:43.270380 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.270319 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tks6r\" (UniqueName: \"kubernetes.io/projected/0bc824e9-cca5-414e-91ad-0c24bbb56f5d-kube-api-access-tks6r\") pod \"postgres-68c4fbbd6f-nhvhm\" (UID: \"0bc824e9-cca5-414e-91ad-0c24bbb56f5d\") " pod="opendatahub/postgres-68c4fbbd6f-nhvhm" Jun 01 20:45:43.333487 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.333455 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-nhvhm" Jun 01 20:45:43.462780 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.462749 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-nhvhm"] Jun 01 20:45:43.464104 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:45:43.464077 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc824e9_cca5_414e_91ad_0c24bbb56f5d.slice/crio-e47be238ccf322958acac6a8d9968531ff958f8aef6ee5670dcb860afc9ebd59 WatchSource:0}: Error finding container e47be238ccf322958acac6a8d9968531ff958f8aef6ee5670dcb860afc9ebd59: Status 404 returned error can't find the container with id e47be238ccf322958acac6a8d9968531ff958f8aef6ee5670dcb860afc9ebd59 Jun 01 20:45:43.782956 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:43.782922 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-nhvhm" event={"ID":"0bc824e9-cca5-414e-91ad-0c24bbb56f5d","Type":"ContainerStarted","Data":"e47be238ccf322958acac6a8d9968531ff958f8aef6ee5670dcb860afc9ebd59"} Jun 01 20:45:46.795315 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:46.795272 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-nhvhm" event={"ID":"0bc824e9-cca5-414e-91ad-0c24bbb56f5d","Type":"ContainerStarted","Data":"a9a6eed2c7dfc4c2f64348e361252e4696aa754a6f13e5b7da380754c1e72834"} Jun 01 20:45:46.795722 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:46.795391 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-nhvhm" Jun 01 20:45:46.811570 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:46.811258 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-nhvhm" podStartSLOduration=1.29613072 podStartE2EDuration="3.811242353s" podCreationTimestamp="2026-06-01 20:45:43 +0000 UTC" firstStartedPulling="2026-06-01 20:45:43.465228689 +0000 UTC m=+691.713527952" lastFinishedPulling="2026-06-01 20:45:45.980340314 +0000 UTC m=+694.228639585" observedRunningTime="2026-06-01 20:45:46.810292835 +0000 UTC m=+695.058592123" watchObservedRunningTime="2026-06-01 20:45:46.811242353 +0000 UTC m=+695.059541641" Jun 01 20:45:52.829805 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:52.829767 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-nhvhm" Jun 01 20:45:54.342173 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.342089 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz"] Jun 01 20:45:54.349063 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.349037 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:54.351162 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.351134 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 01 20:45:54.351162 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.351156 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 01 20:45:54.351750 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.351680 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8bssn\"" Jun 01 20:45:54.353435 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.353404 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz"] Jun 01 20:45:54.361212 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.361190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:54.361298 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.361239 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:54.361344 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.361322 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpf9x\" (UniqueName: \"kubernetes.io/projected/1fba5695-5381-48d6-a922-22016c89ce10-kube-api-access-hpf9x\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:54.462686 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.462646 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpf9x\" (UniqueName: \"kubernetes.io/projected/1fba5695-5381-48d6-a922-22016c89ce10-kube-api-access-hpf9x\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:54.462686 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.462691 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:54.462910 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.462737 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:54.463174 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.463150 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:54.463214 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.463151 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:54.470863 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.470842 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpf9x\" (UniqueName: \"kubernetes.io/projected/1fba5695-5381-48d6-a922-22016c89ce10-kube-api-access-hpf9x\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:54.659332 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.659252 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:54.788459 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.788434 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz"] Jun 01 20:45:54.790806 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:45:54.790780 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fba5695_5381_48d6_a922_22016c89ce10.slice/crio-96a0a953b8eb3a94a2c2f30eaa0fc67fa01b057e3d364326ab1ec8a7f5ddc9f9 WatchSource:0}: Error finding container 96a0a953b8eb3a94a2c2f30eaa0fc67fa01b057e3d364326ab1ec8a7f5ddc9f9: Status 404 returned error can't find the container with id 96a0a953b8eb3a94a2c2f30eaa0fc67fa01b057e3d364326ab1ec8a7f5ddc9f9 Jun 01 20:45:54.825230 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:54.825203 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" event={"ID":"1fba5695-5381-48d6-a922-22016c89ce10","Type":"ContainerStarted","Data":"96a0a953b8eb3a94a2c2f30eaa0fc67fa01b057e3d364326ab1ec8a7f5ddc9f9"} Jun 01 20:45:55.831407 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:55.831314 2561 generic.go:358] "Generic (PLEG): container finished" podID="1fba5695-5381-48d6-a922-22016c89ce10" containerID="4ab8d7be65cced06c6779b9ae5ee4047d0a486ee014e9150a9b506aad1f395be" exitCode=0 Jun 01 20:45:55.831805 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:55.831397 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" event={"ID":"1fba5695-5381-48d6-a922-22016c89ce10","Type":"ContainerDied","Data":"4ab8d7be65cced06c6779b9ae5ee4047d0a486ee014e9150a9b506aad1f395be"} Jun 01 20:45:56.838337 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:56.838300 2561 generic.go:358] "Generic (PLEG): container finished" podID="1fba5695-5381-48d6-a922-22016c89ce10" containerID="aae3ca5796a155b3fdf0f209406ff02b07058fa3768c425bb15d5e0729e2f024" exitCode=0 Jun 01 20:45:56.838764 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:56.838383 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" event={"ID":"1fba5695-5381-48d6-a922-22016c89ce10","Type":"ContainerDied","Data":"aae3ca5796a155b3fdf0f209406ff02b07058fa3768c425bb15d5e0729e2f024"} Jun 01 20:45:57.844415 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:57.844383 2561 generic.go:358] "Generic (PLEG): container finished" podID="1fba5695-5381-48d6-a922-22016c89ce10" containerID="cf5c84dc84f4eed126f689fd5f250766145da6c2069f6e899df94e20e0b8ade6" exitCode=0 Jun 01 20:45:57.844800 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:57.844432 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" event={"ID":"1fba5695-5381-48d6-a922-22016c89ce10","Type":"ContainerDied","Data":"cf5c84dc84f4eed126f689fd5f250766145da6c2069f6e899df94e20e0b8ade6"} Jun 01 20:45:58.984299 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:58.984267 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:58.998881 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:58.998859 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-util\") pod \"1fba5695-5381-48d6-a922-22016c89ce10\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " Jun 01 20:45:58.999009 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:58.998901 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpf9x\" (UniqueName: \"kubernetes.io/projected/1fba5695-5381-48d6-a922-22016c89ce10-kube-api-access-hpf9x\") pod \"1fba5695-5381-48d6-a922-22016c89ce10\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " Jun 01 20:45:58.999009 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:58.998955 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-bundle\") pod \"1fba5695-5381-48d6-a922-22016c89ce10\" (UID: \"1fba5695-5381-48d6-a922-22016c89ce10\") " Jun 01 20:45:58.999462 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:58.999432 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-bundle" (OuterVolumeSpecName: "bundle") pod "1fba5695-5381-48d6-a922-22016c89ce10" (UID: "1fba5695-5381-48d6-a922-22016c89ce10"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:45:59.001093 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:59.001063 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fba5695-5381-48d6-a922-22016c89ce10-kube-api-access-hpf9x" (OuterVolumeSpecName: "kube-api-access-hpf9x") pod "1fba5695-5381-48d6-a922-22016c89ce10" (UID: "1fba5695-5381-48d6-a922-22016c89ce10"). InnerVolumeSpecName "kube-api-access-hpf9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 01 20:45:59.005407 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:59.005382 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-util" (OuterVolumeSpecName: "util") pod "1fba5695-5381-48d6-a922-22016c89ce10" (UID: "1fba5695-5381-48d6-a922-22016c89ce10"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 01 20:45:59.100363 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:59.100287 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpf9x\" (UniqueName: \"kubernetes.io/projected/1fba5695-5381-48d6-a922-22016c89ce10-kube-api-access-hpf9x\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:45:59.100363 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:59.100314 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-bundle\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:45:59.100363 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:59.100324 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fba5695-5381-48d6-a922-22016c89ce10-util\") on node \"ip-10-0-134-139.ec2.internal\" DevicePath \"\"" Jun 01 20:45:59.855263 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:59.855233 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" Jun 01 20:45:59.855442 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:59.855242 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707s5pz" event={"ID":"1fba5695-5381-48d6-a922-22016c89ce10","Type":"ContainerDied","Data":"96a0a953b8eb3a94a2c2f30eaa0fc67fa01b057e3d364326ab1ec8a7f5ddc9f9"} Jun 01 20:45:59.855442 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:45:59.855338 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96a0a953b8eb3a94a2c2f30eaa0fc67fa01b057e3d364326ab1ec8a7f5ddc9f9" Jun 01 20:46:01.983961 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.983913 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cjgz8"] Jun 01 20:46:01.984352 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.984324 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fba5695-5381-48d6-a922-22016c89ce10" containerName="util" Jun 01 20:46:01.984352 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.984336 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fba5695-5381-48d6-a922-22016c89ce10" containerName="util" Jun 01 20:46:01.984352 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.984346 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fba5695-5381-48d6-a922-22016c89ce10" containerName="extract" Jun 01 20:46:01.984352 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.984352 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fba5695-5381-48d6-a922-22016c89ce10" containerName="extract" Jun 01 20:46:01.984488 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.984368 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fba5695-5381-48d6-a922-22016c89ce10" containerName="pull" Jun 01 20:46:01.984488 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.984373 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fba5695-5381-48d6-a922-22016c89ce10" containerName="pull" Jun 01 20:46:01.984488 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.984433 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fba5695-5381-48d6-a922-22016c89ce10" containerName="extract" Jun 01 20:46:01.990934 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.990912 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-cjgz8" Jun 01 20:46:01.994080 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.994050 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 01 20:46:01.994324 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.994098 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-wvfhb\"" Jun 01 20:46:01.994495 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.994469 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 01 20:46:01.996399 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:01.996377 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cjgz8"] Jun 01 20:46:02.028656 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:02.028604 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x9dn\" (UniqueName: \"kubernetes.io/projected/e3fef332-e0b1-4b26-94d5-97613a760149-kube-api-access-8x9dn\") pod \"keycloak-operator-7864d68cbd-cjgz8\" (UID: \"e3fef332-e0b1-4b26-94d5-97613a760149\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cjgz8" Jun 01 20:46:02.129142 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:02.129107 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9dn\" (UniqueName: \"kubernetes.io/projected/e3fef332-e0b1-4b26-94d5-97613a760149-kube-api-access-8x9dn\") pod \"keycloak-operator-7864d68cbd-cjgz8\" (UID: \"e3fef332-e0b1-4b26-94d5-97613a760149\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cjgz8" Jun 01 20:46:02.138664 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:02.138638 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x9dn\" (UniqueName: \"kubernetes.io/projected/e3fef332-e0b1-4b26-94d5-97613a760149-kube-api-access-8x9dn\") pod \"keycloak-operator-7864d68cbd-cjgz8\" (UID: \"e3fef332-e0b1-4b26-94d5-97613a760149\") " pod="keycloak-system/keycloak-operator-7864d68cbd-cjgz8" Jun 01 20:46:02.302450 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:02.302370 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-cjgz8" Jun 01 20:46:02.440064 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:02.440036 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-cjgz8"] Jun 01 20:46:02.441873 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:46:02.441837 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fef332_e0b1_4b26_94d5_97613a760149.slice/crio-7e19ba340f8065363323b68cf187583c216a3468a4a6b8949705261d75265b57 WatchSource:0}: Error finding container 7e19ba340f8065363323b68cf187583c216a3468a4a6b8949705261d75265b57: Status 404 returned error can't find the container with id 7e19ba340f8065363323b68cf187583c216a3468a4a6b8949705261d75265b57 Jun 01 20:46:02.868409 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:02.868371 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-cjgz8" event={"ID":"e3fef332-e0b1-4b26-94d5-97613a760149","Type":"ContainerStarted","Data":"7e19ba340f8065363323b68cf187583c216a3468a4a6b8949705261d75265b57"} Jun 01 20:46:08.896175 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:08.896082 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-cjgz8" event={"ID":"e3fef332-e0b1-4b26-94d5-97613a760149","Type":"ContainerStarted","Data":"1a34e0dc461bcc37cc6329541df8e1700782ef6a0d1e1330402774035b19866c"} Jun 01 20:46:08.912454 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:46:08.912405 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-cjgz8" podStartSLOduration=1.7709720020000002 podStartE2EDuration="7.912391573s" podCreationTimestamp="2026-06-01 20:46:01 +0000 UTC" firstStartedPulling="2026-06-01 20:46:02.443292214 +0000 UTC m=+710.691591478" lastFinishedPulling="2026-06-01 20:46:08.58471178 +0000 UTC m=+716.833011049" observedRunningTime="2026-06-01 20:46:08.910417425 +0000 UTC m=+717.158716710" watchObservedRunningTime="2026-06-01 20:46:08.912391573 +0000 UTC m=+717.160690859" Jun 01 20:48:31.687266 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.687226 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt"] Jun 01 20:48:31.691820 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.691800 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.694352 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.694217 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 01 20:48:31.694641 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.694607 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 01 20:48:31.694769 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.694747 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 01 20:48:31.694899 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.694882 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ncql6\"" Jun 01 20:48:31.697667 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.697643 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt"] Jun 01 20:48:31.727097 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.727065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.727223 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.727110 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.727223 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.727173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4231e62-b288-47b9-9881-8d204379d934-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.727322 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.727226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.727322 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.727251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6msg\" (UniqueName: \"kubernetes.io/projected/f4231e62-b288-47b9-9881-8d204379d934-kube-api-access-m6msg\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.727322 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.727279 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.827786 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.827747 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.827968 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.827804 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.827968 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.827850 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4231e62-b288-47b9-9881-8d204379d934-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.828097 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.827979 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.828097 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.828018 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6msg\" (UniqueName: \"kubernetes.io/projected/f4231e62-b288-47b9-9881-8d204379d934-kube-api-access-m6msg\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.828205 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.828124 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.828205 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.828152 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.828299 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.828201 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.828364 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.828298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.830225 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.830196 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4231e62-b288-47b9-9881-8d204379d934-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.830616 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.830600 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4231e62-b288-47b9-9881-8d204379d934-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:31.835010 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:31.834987 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6msg\" (UniqueName: \"kubernetes.io/projected/f4231e62-b288-47b9-9881-8d204379d934-kube-api-access-m6msg\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt\" (UID: \"f4231e62-b288-47b9-9881-8d204379d934\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:32.003360 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:32.003331 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:32.135081 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:32.135056 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt"] Jun 01 20:48:32.137355 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:48:32.137328 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4231e62_b288_47b9_9881_8d204379d934.slice/crio-eef8ba3fa8d1dfcbb6938067b4f7e98bef83cd9921b0e7160e6048ad0e5fc5d2 WatchSource:0}: Error finding container eef8ba3fa8d1dfcbb6938067b4f7e98bef83cd9921b0e7160e6048ad0e5fc5d2: Status 404 returned error can't find the container with id eef8ba3fa8d1dfcbb6938067b4f7e98bef83cd9921b0e7160e6048ad0e5fc5d2 Jun 01 20:48:32.139114 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:32.139089 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 01 20:48:32.456962 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:32.456924 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" event={"ID":"f4231e62-b288-47b9-9881-8d204379d934","Type":"ContainerStarted","Data":"eef8ba3fa8d1dfcbb6938067b4f7e98bef83cd9921b0e7160e6048ad0e5fc5d2"} Jun 01 20:48:37.480129 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:37.480050 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" event={"ID":"f4231e62-b288-47b9-9881-8d204379d934","Type":"ContainerStarted","Data":"f612e668f903944c6b0a816d8a11303ac7338589b92a2d7ee5fc98937dd92927"} Jun 01 20:48:39.488698 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:39.488653 2561 generic.go:358] "Generic (PLEG): container finished" podID="f4231e62-b288-47b9-9881-8d204379d934" containerID="f612e668f903944c6b0a816d8a11303ac7338589b92a2d7ee5fc98937dd92927" exitCode=0 Jun 01 20:48:39.489098 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:39.488726 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" event={"ID":"f4231e62-b288-47b9-9881-8d204379d934","Type":"ContainerDied","Data":"f612e668f903944c6b0a816d8a11303ac7338589b92a2d7ee5fc98937dd92927"} Jun 01 20:48:41.499301 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:41.499266 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" event={"ID":"f4231e62-b288-47b9-9881-8d204379d934","Type":"ContainerStarted","Data":"ef4f3881cc0646dce405a486de164c8de999781f839784a78445e6a62e4b37c7"} Jun 01 20:48:41.517280 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:41.517223 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" podStartSLOduration=2.095153266 podStartE2EDuration="10.517206166s" podCreationTimestamp="2026-06-01 20:48:31 +0000 UTC" firstStartedPulling="2026-06-01 20:48:32.139214404 +0000 UTC m=+860.387513667" lastFinishedPulling="2026-06-01 20:48:40.561267303 +0000 UTC m=+868.809566567" observedRunningTime="2026-06-01 20:48:41.515889987 +0000 UTC m=+869.764189273" watchObservedRunningTime="2026-06-01 20:48:41.517206166 +0000 UTC m=+869.765505451" Jun 01 20:48:42.004338 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:42.004303 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:42.004338 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:42.004347 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:42.017058 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:42.017034 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:48:42.514553 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:48:42.514526 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt" Jun 01 20:49:04.468981 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.468902 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg"] Jun 01 20:49:04.487831 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.487797 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg"] Jun 01 20:49:04.487986 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.487951 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.490116 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.490090 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 01 20:49:04.618231 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.618202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.618390 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.618241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvkn2\" (UniqueName: \"kubernetes.io/projected/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-kube-api-access-nvkn2\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.618390 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.618268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.618390 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.618354 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.618564 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.618436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.618564 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.618491 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.719606 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.719510 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.719606 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.719570 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.719606 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.719612 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.719877 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.719761 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvkn2\" (UniqueName: \"kubernetes.io/projected/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-kube-api-access-nvkn2\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.719877 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.719801 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.719877 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.719845 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.720016 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.719894 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.720016 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.719929 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.720165 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.720147 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.721972 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.721943 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.722200 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.722181 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.728135 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.728113 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvkn2\" (UniqueName: \"kubernetes.io/projected/b9cfdaa1-ecab-4362-9c86-5ee368ff12f4-kube-api-access-nvkn2\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg\" (UID: \"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:04.811446 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:04.811407 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" Jun 01 20:49:05.151016 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:05.150989 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg"] Jun 01 20:49:05.594865 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:05.594826 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" event={"ID":"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4","Type":"ContainerStarted","Data":"2d0b3b36dfdc71f15ba55cc88aa98c553f60252680f584fcfb9e36530d8b3030"} Jun 01 20:49:05.594865 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:05.594866 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg" event={"ID":"b9cfdaa1-ecab-4362-9c86-5ee368ff12f4","Type":"ContainerStarted","Data":"f85003e2006b93e83494da05fb504644051a43fee722c23c0087dee2c535ed41"} Jun 01 20:49:12.259549 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:12.259518 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:49:12.261213 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:49:12.261189 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:54:12.293377 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:12.293352 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:54:12.299316 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:12.299283 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:54:52.120321 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:52.120293 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-lj2bg_b9cfdaa1-ecab-4362-9c86-5ee368ff12f4/storage-initializer/0.log" Jun 01 20:54:57.641178 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:57.641056 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6968d4bd4-x6mt6_ce295468-bba7-4295-83c5-2e52086cb34a/nginx/0.log" Jun 01 20:54:57.748059 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:57.748025 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-s7ljm_91d7f537-b2be-4723-a56a-d72c9013d6ad/manager/0.log" Jun 01 20:54:57.870087 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:57.870040 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-x2wvz_e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c/manager/0.log" Jun 01 20:54:58.215246 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:58.215220 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-zpjj7_da06a516-5dff-4896-9fd3-a0533050736c/server/0.log" Jun 01 20:54:58.334121 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:58.334093 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-v8mfp_9f0eb3dd-0418-4f1f-b849-078cc25a26de/manager/0.log" Jun 01 20:54:58.695000 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:58.694918 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64857648b-zncx4_e899c007-d8af-4ba8-bcf4-badc727f3359/manager/0.log" Jun 01 20:54:58.701807 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:58.701784 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64857648b-zncx4_e899c007-d8af-4ba8-bcf4-badc727f3359/copy-manifests/0.log" Jun 01 20:54:58.816384 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:58.816353 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-nhvhm_0bc824e9-cca5-414e-91ad-0c24bbb56f5d/postgres/0.log" Jun 01 20:54:59.575657 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.575611 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w_9daaef8c-f3e3-42e1-b257-1234b65a9c65/util/0.log" Jun 01 20:54:59.581851 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.581829 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w_9daaef8c-f3e3-42e1-b257-1234b65a9c65/pull/0.log" Jun 01 20:54:59.587495 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.587478 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w_9daaef8c-f3e3-42e1-b257-1234b65a9c65/extract/0.log" Jun 01 20:54:59.699259 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.699230 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5_537b130a-96a8-453b-9684-1118a8e456c7/util/0.log" Jun 01 20:54:59.706045 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.706025 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5_537b130a-96a8-453b-9684-1118a8e456c7/pull/0.log" Jun 01 20:54:59.712201 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.712180 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5_537b130a-96a8-453b-9684-1118a8e456c7/extract/0.log" Jun 01 20:54:59.826734 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.826650 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b_e14ac613-10f3-41ab-87dd-c1b06c377456/util/0.log" Jun 01 20:54:59.833741 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.833713 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b_e14ac613-10f3-41ab-87dd-c1b06c377456/pull/0.log" Jun 01 20:54:59.843709 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.843685 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b_e14ac613-10f3-41ab-87dd-c1b06c377456/extract/0.log" Jun 01 20:54:59.953862 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.953833 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw_71421d81-f6b9-4a6a-9cd1-a0ff266aebb8/util/0.log" Jun 01 20:54:59.959501 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.959467 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw_71421d81-f6b9-4a6a-9cd1-a0ff266aebb8/pull/0.log" Jun 01 20:54:59.964347 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:54:59.964326 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw_71421d81-f6b9-4a6a-9cd1-a0ff266aebb8/extract/0.log" Jun 01 20:55:00.197345 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:00.197251 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-v852h_d7cc3b67-709a-4e2c-b81f-f3d650cd37b3/manager/0.log" Jun 01 20:55:01.362172 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:01.362141 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-cf7sw_da6eeae9-1f97-4402-a046-572f8ee30e2c/discovery/0.log" Jun 01 20:55:01.582507 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:01.582470 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6855b9fc46-sfbxk_4d93a883-3b82-4bc8-9a57-c0f4e610442c/kube-auth-proxy/0.log" Jun 01 20:55:02.364586 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:02.364556 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt_f4231e62-b288-47b9-9881-8d204379d934/storage-initializer/0.log" Jun 01 20:55:02.372315 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:02.372286 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-2h6kt_f4231e62-b288-47b9-9881-8d204379d934/main/0.log" Jun 01 20:55:09.962008 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:09.961975 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gxsq2_08b2ef89-0cc9-4dc6-af22-b19d4910c08d/global-pull-secret-syncer/0.log" Jun 01 20:55:10.068395 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:10.068367 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jskqr_46dd7c3b-3af0-4f11-9471-1490e0a7c0da/konnectivity-agent/0.log" Jun 01 20:55:10.119994 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:10.119962 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-139.ec2.internal_b796fdfcee5e37a7d2d9a6e13edd54f1/haproxy/0.log" Jun 01 20:55:14.524610 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.524576 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w_9daaef8c-f3e3-42e1-b257-1234b65a9c65/extract/0.log" Jun 01 20:55:14.544292 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.544265 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w_9daaef8c-f3e3-42e1-b257-1234b65a9c65/util/0.log" Jun 01 20:55:14.565170 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.565149 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592sh9w_9daaef8c-f3e3-42e1-b257-1234b65a9c65/pull/0.log" Jun 01 20:55:14.587100 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.587078 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5_537b130a-96a8-453b-9684-1118a8e456c7/extract/0.log" Jun 01 20:55:14.605222 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.605199 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5_537b130a-96a8-453b-9684-1118a8e456c7/util/0.log" Jun 01 20:55:14.622754 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.622732 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06m4m5_537b130a-96a8-453b-9684-1118a8e456c7/pull/0.log" Jun 01 20:55:14.650104 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.650082 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b_e14ac613-10f3-41ab-87dd-c1b06c377456/extract/0.log" Jun 01 20:55:14.669489 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.669470 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b_e14ac613-10f3-41ab-87dd-c1b06c377456/util/0.log" Jun 01 20:55:14.691866 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.691846 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j4n7b_e14ac613-10f3-41ab-87dd-c1b06c377456/pull/0.log" Jun 01 20:55:14.714667 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.714618 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw_71421d81-f6b9-4a6a-9cd1-a0ff266aebb8/extract/0.log" Jun 01 20:55:14.742764 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.742744 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw_71421d81-f6b9-4a6a-9cd1-a0ff266aebb8/util/0.log" Jun 01 20:55:14.765280 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.765250 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jxsdw_71421d81-f6b9-4a6a-9cd1-a0ff266aebb8/pull/0.log" Jun 01 20:55:14.820669 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:14.820571 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-v852h_d7cc3b67-709a-4e2c-b81f-f3d650cd37b3/manager/0.log" Jun 01 20:55:16.639012 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:16.638984 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-q2lxz_af9cbe11-2466-42c7-9fbd-f83c0ec673f5/cluster-monitoring-operator/0.log" Jun 01 20:55:16.776078 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:16.776044 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-8b2wq_a8ea95b8-4140-4d89-82ff-b985794cd773/monitoring-plugin/0.log" Jun 01 20:55:16.807335 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:16.807251 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cth5d_fd797ee9-bdfe-44b4-9c87-54dc23575e8e/node-exporter/0.log" Jun 01 20:55:16.828232 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:16.828209 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cth5d_fd797ee9-bdfe-44b4-9c87-54dc23575e8e/kube-rbac-proxy/0.log" Jun 01 20:55:16.846819 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:16.846787 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cth5d_fd797ee9-bdfe-44b4-9c87-54dc23575e8e/init-textfile/0.log" Jun 01 20:55:17.465963 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:17.465930 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8599ff694f-96zk8_48f0bd24-cdf3-4106-bb31-f3c2e2313fcf/thanos-query/0.log" Jun 01 20:55:17.532091 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:17.532062 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8599ff694f-96zk8_48f0bd24-cdf3-4106-bb31-f3c2e2313fcf/kube-rbac-proxy-web/0.log" Jun 01 20:55:17.561153 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:17.561131 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8599ff694f-96zk8_48f0bd24-cdf3-4106-bb31-f3c2e2313fcf/kube-rbac-proxy/0.log" Jun 01 20:55:17.582928 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:17.582900 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8599ff694f-96zk8_48f0bd24-cdf3-4106-bb31-f3c2e2313fcf/prom-label-proxy/0.log" Jun 01 20:55:17.600944 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:17.600906 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8599ff694f-96zk8_48f0bd24-cdf3-4106-bb31-f3c2e2313fcf/kube-rbac-proxy-rules/0.log" Jun 01 20:55:17.618247 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:17.618218 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8599ff694f-96zk8_48f0bd24-cdf3-4106-bb31-f3c2e2313fcf/kube-rbac-proxy-metrics/0.log" Jun 01 20:55:18.718013 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:18.717979 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-lxnc2_61936f31-2d91-4aae-af35-98648951f7df/networking-console-plugin/0.log" Jun 01 20:55:19.319823 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:19.319797 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/1.log" Jun 01 20:55:19.327913 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:19.327883 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-sxx5t_2560e6e6-843a-4326-b1a1-72eb4cbd5e76/console-operator/2.log" Jun 01 20:55:19.807480 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:19.807440 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-62qdf_767443fd-16fc-4ca9-8d7f-987c1da9217a/download-server/0.log" Jun 01 20:55:20.021555 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.021515 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk"] Jun 01 20:55:20.023971 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.023955 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.025745 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.025725 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gxqp2\"/\"default-dockercfg-77s6m\"" Jun 01 20:55:20.025834 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.025755 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gxqp2\"/\"kube-root-ca.crt\"" Jun 01 20:55:20.025834 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.025815 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gxqp2\"/\"openshift-service-ca.crt\"" Jun 01 20:55:20.028568 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.028547 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-podres\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.028694 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.028591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-sys\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.028769 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.028728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-proc\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.028769 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.028764 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-lib-modules\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.028886 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.028784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4zc8\" (UniqueName: \"kubernetes.io/projected/70445752-7a26-48cf-9dbe-7da2e30c25f3-kube-api-access-q4zc8\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.033872 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.033847 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk"] Jun 01 20:55:20.130039 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.129952 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-podres\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.130039 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.129992 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-sys\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.130279 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.130039 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-proc\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.130279 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.130064 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-lib-modules\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.130279 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.130087 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4zc8\" (UniqueName: \"kubernetes.io/projected/70445752-7a26-48cf-9dbe-7da2e30c25f3-kube-api-access-q4zc8\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.130279 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.130110 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-podres\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.130279 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.130150 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-proc\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.130279 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.130188 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-sys\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.130279 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.130214 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70445752-7a26-48cf-9dbe-7da2e30c25f3-lib-modules\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.138035 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.138008 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4zc8\" (UniqueName: \"kubernetes.io/projected/70445752-7a26-48cf-9dbe-7da2e30c25f3-kube-api-access-q4zc8\") pod \"perf-node-gather-daemonset-kg2kk\" (UID: \"70445752-7a26-48cf-9dbe-7da2e30c25f3\") " pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.335267 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.335236 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:20.349450 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.349424 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-jvpcq_876ed95c-1771-4ce7-8259-f0dbb6082549/volume-data-source-validator/0.log" Jun 01 20:55:20.673694 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.673665 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk"] Jun 01 20:55:20.675636 ip-10-0-134-139 kubenswrapper[2561]: W0601 20:55:20.675594 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod70445752_7a26_48cf_9dbe_7da2e30c25f3.slice/crio-c2b46b88357d4522317a49d44ab613ac4cf74511183bb4374b2195059f43abd2 WatchSource:0}: Error finding container c2b46b88357d4522317a49d44ab613ac4cf74511183bb4374b2195059f43abd2: Status 404 returned error can't find the container with id c2b46b88357d4522317a49d44ab613ac4cf74511183bb4374b2195059f43abd2 Jun 01 20:55:20.677351 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:20.677334 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 01 20:55:21.108546 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:21.108501 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" event={"ID":"70445752-7a26-48cf-9dbe-7da2e30c25f3","Type":"ContainerStarted","Data":"bc89d2b838dfb8db69ae9a796be4ebaf48e6d3b1f1ef21cd2aa2c9ac1451b395"} Jun 01 20:55:21.108546 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:21.108543 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" event={"ID":"70445752-7a26-48cf-9dbe-7da2e30c25f3","Type":"ContainerStarted","Data":"c2b46b88357d4522317a49d44ab613ac4cf74511183bb4374b2195059f43abd2"} Jun 01 20:55:21.108984 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:21.108693 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:21.125602 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:21.125560 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" podStartSLOduration=1.125548824 podStartE2EDuration="1.125548824s" podCreationTimestamp="2026-06-01 20:55:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 20:55:21.122524229 +0000 UTC m=+1269.370823520" watchObservedRunningTime="2026-06-01 20:55:21.125548824 +0000 UTC m=+1269.373848110" Jun 01 20:55:21.168578 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:21.168557 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vjnlg_62c63df5-42a6-417b-a170-cab4a4e85c2a/dns/0.log" Jun 01 20:55:21.187037 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:21.187012 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vjnlg_62c63df5-42a6-417b-a170-cab4a4e85c2a/kube-rbac-proxy/0.log" Jun 01 20:55:21.271166 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:21.271143 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mgc8h_d09ae907-2157-41c9-83fb-d0f2c6193eb2/dns-node-resolver/0.log" Jun 01 20:55:21.749239 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:21.749209 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c66656f99-87l5s_ac79082b-22a1-452d-aa81-9fa3a2e9a525/registry/0.log" Jun 01 20:55:21.871473 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:21.871444 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hr6hz_14095d77-149b-4d73-9273-672aeb86dbd8/node-ca/0.log" Jun 01 20:55:22.739914 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:22.739882 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-cf7sw_da6eeae9-1f97-4402-a046-572f8ee30e2c/discovery/0.log" Jun 01 20:55:22.778293 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:22.778262 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6855b9fc46-sfbxk_4d93a883-3b82-4bc8-9a57-c0f4e610442c/kube-auth-proxy/0.log" Jun 01 20:55:23.409989 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:23.409953 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xk4vw_e2c491b3-caaf-4355-abbb-f8767dc02bbc/serve-healthcheck-canary/0.log" Jun 01 20:55:23.886211 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:23.886182 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h457v_4f42dc9a-7154-4a30-90a4-64328ad9c784/kube-rbac-proxy/0.log" Jun 01 20:55:23.903121 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:23.903094 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h457v_4f42dc9a-7154-4a30-90a4-64328ad9c784/exporter/0.log" Jun 01 20:55:23.921295 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:23.921271 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h457v_4f42dc9a-7154-4a30-90a4-64328ad9c784/extractor/0.log" Jun 01 20:55:26.013269 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:26.013229 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6968d4bd4-x6mt6_ce295468-bba7-4295-83c5-2e52086cb34a/nginx/0.log" Jun 01 20:55:26.034382 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:26.034357 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-s7ljm_91d7f537-b2be-4723-a56a-d72c9013d6ad/manager/0.log" Jun 01 20:55:26.072304 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:26.072278 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-x2wvz_e5f3a6c3-00ce-4ce5-86f0-4c34f9eb568c/manager/0.log" Jun 01 20:55:26.135889 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:26.135867 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-zpjj7_da06a516-5dff-4896-9fd3-a0533050736c/server/0.log" Jun 01 20:55:26.198526 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:26.198498 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-v8mfp_9f0eb3dd-0418-4f1f-b849-078cc25a26de/manager/0.log" Jun 01 20:55:26.396793 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:26.396704 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64857648b-zncx4_e899c007-d8af-4ba8-bcf4-badc727f3359/manager/0.log" Jun 01 20:55:26.413319 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:26.413300 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64857648b-zncx4_e899c007-d8af-4ba8-bcf4-badc727f3359/copy-manifests/0.log" Jun 01 20:55:26.434867 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:26.434844 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-nhvhm_0bc824e9-cca5-414e-91ad-0c24bbb56f5d/postgres/0.log" Jun 01 20:55:27.122569 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:27.122537 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gxqp2/perf-node-gather-daemonset-kg2kk" Jun 01 20:55:32.539039 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:32.539008 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-cxk4x_376fcf9e-e1cf-4657-830d-3a70318a8919/migrator/0.log" Jun 01 20:55:32.557957 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:32.557929 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-cxk4x_376fcf9e-e1cf-4657-830d-3a70318a8919/graceful-termination/0.log" Jun 01 20:55:32.907314 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:32.907231 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-8nwjp_6710a661-ae89-40c4-b4c5-5ab71d659495/kube-storage-version-migrator-operator/1.log" Jun 01 20:55:32.908956 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:32.908925 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-8nwjp_6710a661-ae89-40c4-b4c5-5ab71d659495/kube-storage-version-migrator-operator/0.log" Jun 01 20:55:34.079880 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:34.079853 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lcxjj_f8d3811c-ea66-48f0-8b87-a427561261d5/kube-multus-additional-cni-plugins/0.log" Jun 01 20:55:34.111436 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:34.111407 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lcxjj_f8d3811c-ea66-48f0-8b87-a427561261d5/egress-router-binary-copy/0.log" Jun 01 20:55:34.129234 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:34.129205 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lcxjj_f8d3811c-ea66-48f0-8b87-a427561261d5/cni-plugins/0.log" Jun 01 20:55:34.147831 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:34.147801 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lcxjj_f8d3811c-ea66-48f0-8b87-a427561261d5/bond-cni-plugin/0.log" Jun 01 20:55:34.167514 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:34.167481 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lcxjj_f8d3811c-ea66-48f0-8b87-a427561261d5/routeoverride-cni/0.log" Jun 01 20:55:34.184514 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:34.184490 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lcxjj_f8d3811c-ea66-48f0-8b87-a427561261d5/whereabouts-cni-bincopy/0.log" Jun 01 20:55:34.202101 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:34.202077 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lcxjj_f8d3811c-ea66-48f0-8b87-a427561261d5/whereabouts-cni/0.log" Jun 01 20:55:34.378750 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:34.378669 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f2zl5_5ec81339-bebd-4521-bea1-f04abfbde340/kube-multus/0.log" Jun 01 20:55:34.424006 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:34.423970 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2kqdx_81a6c9fa-0e20-455d-b262-0711156022fe/network-metrics-daemon/0.log" Jun 01 20:55:34.439656 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:34.439607 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2kqdx_81a6c9fa-0e20-455d-b262-0711156022fe/kube-rbac-proxy/0.log" Jun 01 20:55:35.366722 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:35.366684 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgnz_f4f44b26-668e-4e5f-bfd7-2c395bb88778/ovn-controller/0.log" Jun 01 20:55:35.393805 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:35.393769 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgnz_f4f44b26-668e-4e5f-bfd7-2c395bb88778/ovn-acl-logging/0.log" Jun 01 20:55:35.412804 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:35.412757 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgnz_f4f44b26-668e-4e5f-bfd7-2c395bb88778/kube-rbac-proxy-node/0.log" Jun 01 20:55:35.434212 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:35.434176 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgnz_f4f44b26-668e-4e5f-bfd7-2c395bb88778/kube-rbac-proxy-ovn-metrics/0.log" Jun 01 20:55:35.452404 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:35.452347 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgnz_f4f44b26-668e-4e5f-bfd7-2c395bb88778/northd/0.log" Jun 01 20:55:35.469495 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:35.469459 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgnz_f4f44b26-668e-4e5f-bfd7-2c395bb88778/nbdb/0.log" Jun 01 20:55:35.487076 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:35.487054 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgnz_f4f44b26-668e-4e5f-bfd7-2c395bb88778/sbdb/0.log" Jun 01 20:55:35.648764 ip-10-0-134-139 kubenswrapper[2561]: I0601 20:55:35.648680 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5zgnz_f4f44b26-668e-4e5f-bfd7-2c395bb88778/ovnkube-controller/0.log"