Jun 09 06:55:48.681211 ip-10-0-139-166 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 06:55:48.681223 ip-10-0-139-166 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 06:55:48.681232 ip-10-0-139-166 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 06:55:48.681433 ip-10-0-139-166 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 06:55:58.893581 ip-10-0-139-166 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 06:55:58.893606 ip-10-0-139-166 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1b00160f6d27452bacf6ec014871a1b3 -- Jun 09 06:58:32.912132 ip-10-0-139-166 systemd[1]: Starting Kubernetes Kubelet... Jun 09 06:58:33.314658 ip-10-0-139-166 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 06:58:33.314658 ip-10-0-139-166 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 06:58:33.314658 ip-10-0-139-166 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 06:58:33.314658 ip-10-0-139-166 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 06:58:33.314658 ip-10-0-139-166 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 06:58:33.315705 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.315475 2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 06:58:33.320020 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320000 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:33.320020 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320018 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320023 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320027 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320031 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320034 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320037 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320040 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320043 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320046 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320049 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320052 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320055 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320058 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320061 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320065 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320075 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320078 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320081 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320083 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320086 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:33.320103 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320089 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320092 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320094 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320097 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320100 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320103 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320105 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320108 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320112 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320115 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320118 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320120 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320123 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320126 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320128 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320131 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320134 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320137 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320139 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:33.320578 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320142 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320144 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320147 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320149 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320151 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320154 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320156 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320159 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320163 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320167 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320169 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320171 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320174 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320176 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320179 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320183 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320186 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320188 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320191 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320194 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:33.321082 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320196 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320199 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320201 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320204 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320207 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320209 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320212 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320214 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320217 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320222 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320225 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320228 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320232 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320235 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320239 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320242 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320245 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320248 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320252 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:33.321561 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320255 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320258 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320260 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320263 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320266 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320269 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320271 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320274 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320278 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320281 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320283 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320286 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320288 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320291 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320294 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320296 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320299 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320302 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320304 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:33.322038 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.320307 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321078 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321086 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321090 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321093 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321096 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321099 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321102 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321105 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321108 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321111 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321114 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321117 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321120 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321122 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321125 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321128 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321131 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321134 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:33.322494 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321137 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321140 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321143 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321146 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321149 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321151 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321154 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321157 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321159 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321162 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321165 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321167 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321170 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321173 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321175 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321178 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321180 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321183 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321186 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321188 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:33.322974 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321191 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321194 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321196 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321199 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321202 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321204 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321207 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321210 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321212 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321214 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321218 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321221 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321224 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321227 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321231 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321234 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321236 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321240 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321243 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321246 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:33.323460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321248 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321251 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321253 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321257 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321261 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321265 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321268 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321270 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321274 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321277 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321280 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321283 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321286 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321289 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321291 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321294 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321296 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321299 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321302 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:33.323968 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321304 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321307 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321309 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321313 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321316 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321319 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321322 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321325 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321327 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321331 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321335 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321338 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321341 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321343 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321346 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321352 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321355 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321358 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321361 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321365 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:33.324445 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321368 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321370 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321751 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321756 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321760 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321763 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321765 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321768 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321771 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321773 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321776 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321779 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321782 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321800 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321803 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321807 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321809 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321813 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321816 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321821 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:33.324972 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321825 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321828 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321830 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321834 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321837 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321839 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321842 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321845 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321848 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321850 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321853 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321856 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321858 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321861 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321863 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321866 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321868 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321871 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321876 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:33.325461 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321879 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321881 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321884 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321886 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321889 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321891 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321894 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321897 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321900 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321902 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321905 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321909 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321912 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321914 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321917 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321921 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321924 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321926 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321929 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321931 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:33.325967 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321934 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321936 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321939 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321942 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321944 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321947 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321949 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321952 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321954 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321957 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321960 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321964 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321968 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321971 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321974 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321977 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321980 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321982 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321985 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:33.326459 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321987 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321990 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321993 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321996 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.321999 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322002 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322004 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322007 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322010 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322012 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322015 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322017 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322020 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322022 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322025 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322027 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322030 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322033 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322036 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322039 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:33.326955 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322042 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322045 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322048 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322141 2549 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322152 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322159 2549 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322164 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322168 2549 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322172 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322176 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322181 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322184 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322187 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322191 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322195 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322198 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322201 2549 flags.go:64] FLAG: --cgroup-root="" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322204 2549 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322209 2549 flags.go:64] FLAG: --client-ca-file="" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322212 2549 flags.go:64] FLAG: --cloud-provider="external" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322215 2549 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322222 2549 flags.go:64] FLAG: --cluster-domain="" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322225 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322228 2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 06:58:33.327440 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322231 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322235 2549 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322239 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322242 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322245 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322249 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322252 2549 flags.go:64] FLAG: --contention-profiling="false" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322258 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322261 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322265 2549 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322267 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322272 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322275 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322278 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322281 2549 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322284 2549 flags.go:64] FLAG: --enable-server="true" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322287 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322291 2549 flags.go:64] FLAG: --event-burst="100" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322294 2549 flags.go:64] FLAG: --event-qps="50" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322301 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322304 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322307 2549 flags.go:64] FLAG: --eviction-hard="" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322311 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322314 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322318 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 06:58:33.328033 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322321 2549 flags.go:64] FLAG: --eviction-soft="" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322324 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322327 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322330 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322333 2549 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322336 2549 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322339 2549 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322342 2549 flags.go:64] FLAG: --feature-gates="" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322346 2549 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322349 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322352 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322355 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322358 2549 flags.go:64] FLAG: --healthz-port="10248" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322361 2549 flags.go:64] FLAG: --help="false" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322366 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322369 2549 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322372 2549 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322375 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322379 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322382 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322385 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322388 2549 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322391 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 06:58:33.328653 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322394 2549 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322397 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322400 2549 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322405 2549 flags.go:64] FLAG: --kube-reserved="" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322408 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322411 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322414 2549 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322417 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322420 2549 flags.go:64] FLAG: --lock-file="" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322423 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322426 2549 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322429 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322435 2549 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322438 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322441 2549 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322443 2549 flags.go:64] FLAG: --logging-format="text" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322447 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322450 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322453 2549 flags.go:64] FLAG: --manifest-url="" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322456 2549 flags.go:64] FLAG: --manifest-url-header="" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322460 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322464 2549 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322468 2549 flags.go:64] FLAG: --max-pods="110" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322472 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322475 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 06:58:33.329332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322478 2549 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322481 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322484 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322487 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322490 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322498 2549 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322501 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322505 2549 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322508 2549 flags.go:64] FLAG: --pod-cidr="" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322511 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322517 2549 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322522 2549 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322525 2549 flags.go:64] FLAG: --pods-per-core="0" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322528 2549 flags.go:64] FLAG: --port="10250" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322531 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322534 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a0a2e3e32a368ec8" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322537 2549 flags.go:64] FLAG: --qos-reserved="" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322540 2549 flags.go:64] FLAG: --read-only-port="10255" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322543 2549 flags.go:64] FLAG: --register-node="true" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322546 2549 flags.go:64] FLAG: --register-with-taints="" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322550 2549 flags.go:64] FLAG: --registry-burst="10" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322553 2549 flags.go:64] FLAG: --registry-qps="5" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322556 2549 flags.go:64] FLAG: --reserved-cpus="" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322559 2549 flags.go:64] FLAG: --reserved-memory="" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322563 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 06:58:33.330313 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322566 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322568 2549 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322571 2549 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322574 2549 flags.go:64] FLAG: --runonce="false" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322577 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322581 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322584 2549 flags.go:64] FLAG: --seccomp-default="false" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322587 2549 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322590 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322593 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322596 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322599 2549 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322602 2549 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322605 2549 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322608 2549 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322611 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322614 2549 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322617 2549 flags.go:64] FLAG: --system-cgroups="" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322621 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322627 2549 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322630 2549 flags.go:64] FLAG: --tls-cert-file="" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322632 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322637 2549 flags.go:64] FLAG: --tls-min-version="" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322640 2549 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322643 2549 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 06:58:33.331042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322646 2549 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322649 2549 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322652 2549 flags.go:64] FLAG: --v="2" Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322657 2549 flags.go:64] FLAG: --version="false" Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322661 2549 flags.go:64] FLAG: --vmodule="" Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322665 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.322668 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322799 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322803 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322807 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322810 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322812 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322817 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322820 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322823 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322826 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322829 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322832 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322835 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322837 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322840 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:33.331692 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322843 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322846 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322848 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322851 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322855 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322858 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322861 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322863 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322866 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322869 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322872 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322877 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322880 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322883 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322885 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322888 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322891 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322894 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322897 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:33.332241 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322899 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322902 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322905 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322908 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322911 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322914 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322917 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322920 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322922 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322925 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322928 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322930 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322933 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322935 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322938 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322941 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322943 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322947 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322949 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322952 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:33.332726 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322955 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322958 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322961 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322963 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322966 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322969 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322971 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322974 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322977 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322982 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322986 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322989 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322992 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322995 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.322998 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323001 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323005 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323007 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323010 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:33.333237 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323013 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323017 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323020 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323023 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323026 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323029 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323031 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323034 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323037 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323039 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323043 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323046 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323049 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323051 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323054 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323056 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323059 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323062 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323064 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:33.333696 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323067 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323070 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323072 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323075 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323078 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323081 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323084 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.323086 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.323799 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.331557 2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.331577 2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.332099 2549 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.332108 2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332170 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:33.334184 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332177 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332181 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332185 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332188 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332191 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332194 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332197 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332199 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332204 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332208 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332211 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332214 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332217 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332219 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332222 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332225 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332228 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332237 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332241 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:33.334531 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332245 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332248 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332251 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332254 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332257 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332260 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332263 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332266 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332268 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332272 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332274 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332277 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332280 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332283 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332285 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332288 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332291 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332294 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332296 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:33.335059 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332299 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332301 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332304 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332307 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332309 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332312 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332314 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332318 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332320 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332323 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332326 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332329 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332331 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332335 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332338 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332341 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332343 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332346 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332349 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332352 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:33.335598 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332354 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332357 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332360 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332363 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332366 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332368 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332371 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332374 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332377 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332380 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332382 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332385 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332388 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332390 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332393 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332395 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332399 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332402 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332404 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332407 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:33.336104 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332410 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332413 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332415 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332418 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332421 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332424 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332426 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332429 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332432 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332434 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332437 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332440 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332442 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332445 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332448 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332451 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332453 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332456 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332459 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:33.336634 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332462 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.332467 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332588 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332635 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332639 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332643 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332646 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332649 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332652 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332654 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332658 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332660 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332663 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332666 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332670 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:33.337206 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332672 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332675 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332678 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332680 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332683 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332686 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332689 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332691 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332694 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332696 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332700 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332704 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332707 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332710 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332712 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332715 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332717 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332720 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332722 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:33.337728 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332725 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332728 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332731 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332733 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332736 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332739 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332742 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332746 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332750 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332753 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332756 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332758 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332761 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332765 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332768 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332771 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332773 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332776 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332779 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332781 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:33.338220 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332798 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332802 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332807 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332810 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332813 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332815 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332818 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332821 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332823 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332826 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332829 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332832 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332834 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332837 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332841 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332843 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332846 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332848 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332851 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332854 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:33.338824 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332857 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332859 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332862 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332865 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332868 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332871 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332874 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332877 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332879 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332882 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332885 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332888 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332890 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332893 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332895 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332898 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332900 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332904 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332907 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332909 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:33.339460 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332912 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332914 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332918 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332921 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332924 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332927 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:33.332930 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.332935 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.333065 2549 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.335899 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.337194 2549 server.go:1019] "Starting client certificate rotation" Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.337315 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.337369 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 06:58:33.340284 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.339606 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 06:58:33.342317 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.342292 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 06:58:33.351365 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.351345 2549 log.go:25] "Validated CRI v1 runtime API" Jun 09 06:58:33.353878 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.353851 2549 log.go:25] "Validated CRI v1 image API" Jun 09 06:58:33.354712 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.354696 2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 06:58:33.357827 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.357807 2549 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 87daea2f-b026-4d1d-8004-088fea36da06:/dev/nvme0n1p4 f36be6a6-a01e-4fd0-a852-45569bd45a0b:/dev/nvme0n1p3] Jun 09 06:58:33.357897 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.357827 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 06:58:33.363268 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.363143 2549 manager.go:216] Machine: {Timestamp:2026-06-09 06:58:33.362214698 +0000 UTC m=+0.336870235 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099758 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23cbe2f9102a72f180b6dbaa8f2caf SystemUUID:ec23cbe2-f910-2a72-f180-b6dbaa8f2caf BootID:1b00160f-6d27-452b-acf6-ec014871a1b3 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b5:d4:67:91:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b5:d4:67:91:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:9b:ad:a4:51:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 06:58:33.363268 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.363255 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 06:58:33.363435 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.363393 2549 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 06:58:33.365329 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.365291 2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 06:58:33.365503 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.365333 2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 06:58:33.366131 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.366118 2549 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 06:58:33.366185 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.366137 2549 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 06:58:33.366185 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.366148 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 06:58:33.366768 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.366756 2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 06:58:33.367600 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.367587 2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 06:58:33.368584 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.368565 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 06:58:33.370488 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.370474 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 09 06:58:33.370638 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.370627 2549 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 06:58:33.370694 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.370666 2549 kubelet.go:486] "Attempting to sync node with API server" Jun 09 06:58:33.370694 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.370681 2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 06:58:33.370779 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.370702 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 06:58:33.370779 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.370715 2549 kubelet.go:398] "Adding apiserver pod source" Jun 09 06:58:33.370779 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.370729 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 06:58:33.371871 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.371857 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 06:58:33.371938 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.371880 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 06:58:33.374201 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.374185 2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 06:58:33.375637 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.375623 2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 06:58:33.375693 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.375654 2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 06:58:33.376961 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.376948 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 06:58:33.377016 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.376966 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 06:58:33.377016 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.376973 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 06:58:33.377016 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.376980 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 06:58:33.377016 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.376995 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 06:58:33.377016 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.377001 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 06:58:33.377016 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.377010 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 06:58:33.377016 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.377015 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 06:58:33.377202 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.377022 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 06:58:33.377202 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.377029 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 06:58:33.377202 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.377051 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 06:58:33.377202 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.377056 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 06:58:33.378418 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.378408 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 06:58:33.378418 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.378418 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 06:58:33.381598 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.381581 2549 server.go:1268] "Started kubelet" Jun 09 06:58:33.381864 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.381686 2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 06:58:33.381864 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.381741 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 06:58:33.381864 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.381688 2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 06:58:33.381864 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.381815 2549 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 06:58:33.381864 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.381816 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 06:58:33.382118 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.381888 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 06:58:33.383060 ip-10-0-139-166 systemd[1]: Started Kubernetes Kubelet. Jun 09 06:58:33.383878 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.383859 2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 06:58:33.384085 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.384071 2549 server.go:310] "Adding debug handlers to kubelet server" Jun 09 06:58:33.388132 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.388110 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gbrz5" Jun 09 06:58:33.388529 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.388515 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 06:58:33.388582 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.388527 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 06:58:33.388948 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.388725 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:33.389283 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.389194 2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 06:58:33.389283 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.389197 2549 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 06:58:33.389283 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.389215 2549 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 06:58:33.389424 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.389311 2549 reconstruct.go:97] "Volume reconstruction finished" Jun 09 06:58:33.389424 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.389323 2549 reconciler.go:29] "Reconciler: start to sync state" Jun 09 06:58:33.389510 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.387685 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-166.ec2.internal.18b7576f583ad8fb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-166.ec2.internal,UID:ip-10-0-139-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-166.ec2.internal,},FirstTimestamp:2026-06-09 06:58:33.381558523 +0000 UTC m=+0.356214059,LastTimestamp:2026-06-09 06:58:33.381558523 +0000 UTC m=+0.356214059,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-166.ec2.internal,}" Jun 09 06:58:33.390180 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.390162 2549 factory.go:55] Registering systemd factory Jun 09 06:58:33.390261 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.390202 2549 factory.go:223] Registration of the systemd container factory successfully Jun 09 06:58:33.390500 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.390480 2549 factory.go:153] Registering CRI-O factory Jun 09 06:58:33.390500 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.390502 2549 factory.go:223] Registration of the crio container factory successfully Jun 09 06:58:33.390620 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.390578 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 06:58:33.390620 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.390616 2549 factory.go:103] Registering Raw factory Jun 09 06:58:33.390712 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.390644 2549 manager.go:1196] Started watching for new ooms in manager Jun 09 06:58:33.393762 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.393739 2549 manager.go:349] Starting recovery of all containers Jun 09 06:58:33.394633 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.394596 2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 06:58:33.396778 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.396753 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gbrz5" Jun 09 06:58:33.398039 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.398010 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 06:58:33.398123 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.398047 2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 06:58:33.399728 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.399698 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 06:58:33.405855 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.405837 2549 manager.go:354] Recovery completed Jun 09 06:58:33.410032 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.410019 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:33.412165 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.412146 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:33.412244 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.412183 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:33.412244 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.412198 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:33.412874 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.412855 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 06:58:33.412874 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.412871 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 06:58:33.412992 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.412884 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:33.412992 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.412888 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 09 06:58:33.413538 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.413522 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:33.413603 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.413550 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:33.413603 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.413560 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:33.414017 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.414005 2549 policy_none.go:49] "None policy: Start" Jun 09 06:58:33.414053 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.414022 2549 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 06:58:33.414053 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.414033 2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 06:58:33.414988 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.414978 2549 policy_none.go:47] "Start" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.448357 2549 manager.go:337] "Starting Device Plugin manager" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.448419 2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.448435 2549 server.go:87] "Starting device plugin registration server" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.448734 2549 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.448745 2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.448892 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.448978 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.448987 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.449936 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.449989 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.461461 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.461518 2549 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.461547 2549 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.461635 2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 06:58:33.463949 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.463655 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 06:58:33.549585 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.549559 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:33.551466 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.551448 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:33.551563 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.551487 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:33.551563 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.551501 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:33.551563 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.551525 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.559182 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.559164 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.559230 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.559191 2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-166.ec2.internal\": node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:33.561706 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.561688 2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-166.ec2.internal"] Jun 09 06:58:33.561764 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.561754 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:33.562619 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.562599 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:33.562727 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.562634 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:33.562727 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.562666 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:33.564085 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.564067 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:33.564207 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.564192 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.564258 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.564232 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:33.564880 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.564828 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:33.564880 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.564845 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:33.564880 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.564860 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:33.564880 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.564866 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:33.564880 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.564874 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:33.565132 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.564876 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:33.566207 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.566190 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.566253 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.566224 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:33.567104 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.567084 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:33.567201 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.567112 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:33.567201 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.567122 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:33.572903 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.572884 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:33.581410 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.581388 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-166.ec2.internal\" not found" node="ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.585734 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.585717 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-166.ec2.internal\" not found" node="ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.673837 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.673801 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:33.689791 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.689763 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a38314d8b55b654b06aedba48003627-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal\" (UID: \"7a38314d8b55b654b06aedba48003627\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.689914 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.689815 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a38314d8b55b654b06aedba48003627-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal\" (UID: \"7a38314d8b55b654b06aedba48003627\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.689914 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.689837 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d847be753db4224a797cf6deaab03dc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-166.ec2.internal\" (UID: \"8d847be753db4224a797cf6deaab03dc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.774508 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.774460 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:33.790874 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.790826 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a38314d8b55b654b06aedba48003627-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal\" (UID: \"7a38314d8b55b654b06aedba48003627\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.790874 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.790863 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a38314d8b55b654b06aedba48003627-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal\" (UID: \"7a38314d8b55b654b06aedba48003627\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.791050 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.790891 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a38314d8b55b654b06aedba48003627-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal\" (UID: \"7a38314d8b55b654b06aedba48003627\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.791050 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.790919 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a38314d8b55b654b06aedba48003627-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal\" (UID: \"7a38314d8b55b654b06aedba48003627\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.791050 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.790929 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d847be753db4224a797cf6deaab03dc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-166.ec2.internal\" (UID: \"8d847be753db4224a797cf6deaab03dc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.791050 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.790951 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d847be753db4224a797cf6deaab03dc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-166.ec2.internal\" (UID: \"8d847be753db4224a797cf6deaab03dc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.875335 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.875231 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:33.885404 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.885379 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.890239 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:33.890224 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-166.ec2.internal" Jun 09 06:58:33.976240 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:33.976198 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:34.076764 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:34.076734 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:34.177318 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:34.177278 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:34.278777 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:34.278744 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:34.337270 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.337232 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 06:58:34.337960 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.337425 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 06:58:34.359987 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:34.359952 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d847be753db4224a797cf6deaab03dc.slice/crio-9abca288af85f52adf86c541ac35f58b14630db8e155f155074dee39e0eee930 WatchSource:0}: Error finding container 9abca288af85f52adf86c541ac35f58b14630db8e155f155074dee39e0eee930: Status 404 returned error can't find the container with id 9abca288af85f52adf86c541ac35f58b14630db8e155f155074dee39e0eee930 Jun 09 06:58:34.360617 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:34.360583 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a38314d8b55b654b06aedba48003627.slice/crio-eb2901bd2ef7b59e8f95e5fe444d5cc78d107323d9044940d15269fdc8c16b39 WatchSource:0}: Error finding container eb2901bd2ef7b59e8f95e5fe444d5cc78d107323d9044940d15269fdc8c16b39: Status 404 returned error can't find the container with id eb2901bd2ef7b59e8f95e5fe444d5cc78d107323d9044940d15269fdc8c16b39 Jun 09 06:58:34.366387 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.366372 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 06:58:34.379598 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:34.379568 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-166.ec2.internal\" not found" Jun 09 06:58:34.401215 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.401167 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 06:53:33 +0000 UTC" deadline="2028-02-09 11:17:51.724420226 +0000 UTC" Jun 09 06:58:34.401215 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.401207 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14644h19m17.323216214s" Jun 09 06:58:34.419825 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.419805 2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 06:58:34.465216 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.464950 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" event={"ID":"7a38314d8b55b654b06aedba48003627","Type":"ContainerStarted","Data":"eb2901bd2ef7b59e8f95e5fe444d5cc78d107323d9044940d15269fdc8c16b39"} Jun 09 06:58:34.467867 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.467840 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-166.ec2.internal" event={"ID":"8d847be753db4224a797cf6deaab03dc","Type":"ContainerStarted","Data":"9abca288af85f52adf86c541ac35f58b14630db8e155f155074dee39e0eee930"} Jun 09 06:58:34.482080 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.482059 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 06:58:34.489109 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.489090 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" Jun 09 06:58:34.499940 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.499914 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 06:58:34.500855 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.500840 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-166.ec2.internal" Jun 09 06:58:34.509188 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.509167 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 06:58:34.838972 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:34.838872 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 06:58:35.371097 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.371064 2549 apiserver.go:52] "Watching apiserver" Jun 09 06:58:35.377775 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.377745 2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 06:58:35.378173 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.378140 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal","openshift-multus/network-metrics-daemon-5gj2q","openshift-network-operator/iptables-alerter-dnd4g","openshift-ovn-kubernetes/ovnkube-node-jgkwk","kube-system/konnectivity-agent-wmjqv","openshift-cluster-node-tuning-operator/tuned-qmjfs","openshift-dns/node-resolver-qrvxd","openshift-multus/multus-additional-cni-plugins-ktxwt","openshift-multus/multus-t4ll6","openshift-network-diagnostics/network-check-target-jrjc4","kube-system/global-pull-secret-syncer-6plnd","kube-system/kube-apiserver-proxy-ip-10-0-139-166.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p","openshift-image-registry/node-ca-ck9kl"] Jun 09 06:58:35.379726 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.379707 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qrvxd" Jun 09 06:58:35.381170 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.381147 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.382252 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.382217 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nkt77\"" Jun 09 06:58:35.382347 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.382273 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 06:58:35.382347 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.382294 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 06:58:35.383038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.382998 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dnd4g" Jun 09 06:58:35.383703 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.383681 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 06:58:35.383813 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.383735 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pm765\"" Jun 09 06:58:35.383877 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.383685 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 06:58:35.383877 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.383737 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 06:58:35.384624 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.384605 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.385451 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.385286 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 06:58:35.385451 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.385380 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nzcxb\"" Jun 09 06:58:35.385451 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.385396 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 06:58:35.385451 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.385405 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 06:58:35.385878 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.385860 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:58:35.386758 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.386733 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 06:58:35.386876 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.386780 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 06:58:35.387265 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.387139 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.387265 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.387205 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 06:58:35.387265 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.387249 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 06:58:35.387457 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.387386 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 06:58:35.388042 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.388022 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-997dr\"" Jun 09 06:58:35.388600 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.388522 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 06:58:35.389859 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.388826 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 06:58:35.389859 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.389338 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 06:58:35.389859 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.389651 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-75dmz\"" Jun 09 06:58:35.390660 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.389346 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 06:58:35.390660 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.390175 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 06:58:35.390824 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.390696 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7mcs2\"" Jun 09 06:58:35.390824 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.390758 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 06:58:35.391386 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.391146 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.391750 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.391726 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ck9kl" Jun 09 06:58:35.393487 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.393461 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:35.393592 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:35.393563 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:35.393666 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.393592 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 06:58:35.393722 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.393696 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zxgzj\"" Jun 09 06:58:35.394351 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.393991 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 06:58:35.394351 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.394010 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 06:58:35.394351 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.394077 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 06:58:35.394351 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.394207 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 06:58:35.394351 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.394341 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2x7k\"" Jun 09 06:58:35.394627 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.394426 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 06:58:35.394627 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.394430 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 06:58:35.395002 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.394981 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:35.395095 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:35.395051 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:35.396377 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.396348 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:35.396496 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:35.396408 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:35.397950 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.397931 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.398044 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.397959 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-device-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.398044 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.397991 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-sysctl-d\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.398044 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398019 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtftv\" (UniqueName: \"kubernetes.io/projected/9980c63f-e2a5-40ff-a193-80276600e53e-kube-api-access-rtftv\") pod \"node-resolver-qrvxd\" (UID: \"9980c63f-e2a5-40ff-a193-80276600e53e\") " pod="openshift-dns/node-resolver-qrvxd" Jun 09 06:58:35.398299 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398044 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-cnibin\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.398299 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398066 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-os-release\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.398299 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398093 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.398299 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398116 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.398299 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398139 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-log-socket\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.398299 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398163 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-sys\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.398299 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398187 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlblc\" (UniqueName: \"kubernetes.io/projected/ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57-kube-api-access-dlblc\") pod \"node-ca-ck9kl\" (UID: \"ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57\") " pod="openshift-image-registry/node-ca-ck9kl" Jun 09 06:58:35.398299 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398209 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49f24\" (UniqueName: \"kubernetes.io/projected/b145e2e5-2e33-405e-a849-a636dd61fcc4-kube-api-access-49f24\") pod \"iptables-alerter-dnd4g\" (UID: \"b145e2e5-2e33-405e-a849-a636dd61fcc4\") " pod="openshift-network-operator/iptables-alerter-dnd4g" Jun 09 06:58:35.398299 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398232 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-run-multus-certs\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.398299 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398255 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-run-netns\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.398299 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398277 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-run-ovn\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398316 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398349 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57-serviceca\") pod \"node-ca-ck9kl\" (UID: \"ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57\") " pod="openshift-image-registry/node-ca-ck9kl" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398380 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gds2b\" (UniqueName: \"kubernetes.io/projected/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-kube-api-access-gds2b\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398403 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-var-lib-openvswitch\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398426 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/558993a8-854f-4a9b-9fad-1c7abc8101d9-ovnkube-config\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398451 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/551d572c-896f-4dd2-a0ac-b23ae45b5e9f-konnectivity-ca\") pod \"konnectivity-agent-wmjqv\" (UID: \"551d572c-896f-4dd2-a0ac-b23ae45b5e9f\") " pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398477 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-multus-socket-dir-parent\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398506 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-run-netns\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398529 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-hostroot\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398553 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-sys-fs\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398575 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-slash\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398596 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-modprobe-d\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398617 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-kubernetes\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398667 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-system-cni-dir\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398692 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf3a564d-0449-43b8-a226-b2430d255604-cni-binary-copy\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.398814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398753 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/551d572c-896f-4dd2-a0ac-b23ae45b5e9f-agent-certs\") pod \"konnectivity-agent-wmjqv\" (UID: \"551d572c-896f-4dd2-a0ac-b23ae45b5e9f\") " pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398855 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-systemd\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398887 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/558993a8-854f-4a9b-9fad-1c7abc8101d9-ovn-node-metrics-cert\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398911 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx4vb\" (UniqueName: \"kubernetes.io/projected/558993a8-854f-4a9b-9fad-1c7abc8101d9-kube-api-access-gx4vb\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398936 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-var-lib-kubelet\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398960 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-var-lib-cni-bin\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.398981 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-etc-openvswitch\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399003 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-lib-modules\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399021 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-var-lib-cni-multus\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399043 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf3a564d-0449-43b8-a226-b2430d255604-multus-daemon-config\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399065 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-run-systemd\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399086 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x2f9\" (UniqueName: \"kubernetes.io/projected/038c9f73-b499-4acb-8be4-9666a532ee46-kube-api-access-9x2f9\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399110 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-run-k8s-cni-cncf-io\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399132 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-etc-kubernetes\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399168 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-kubelet\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399196 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-node-log\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.399597 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399228 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399262 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/558993a8-854f-4a9b-9fad-1c7abc8101d9-ovnkube-script-lib\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399289 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-host\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399314 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-registration-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399352 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-systemd-units\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399389 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-var-lib-kubelet\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399412 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/038c9f73-b499-4acb-8be4-9666a532ee46-etc-tuned\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399434 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/038c9f73-b499-4acb-8be4-9666a532ee46-tmp\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399453 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-run-openvswitch\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399474 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-cni-bin\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399501 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-sysctl-conf\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399526 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-run\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399549 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9980c63f-e2a5-40ff-a193-80276600e53e-hosts-file\") pod \"node-resolver-qrvxd\" (UID: \"9980c63f-e2a5-40ff-a193-80276600e53e\") " pod="openshift-dns/node-resolver-qrvxd" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399570 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b145e2e5-2e33-405e-a849-a636dd61fcc4-iptables-alerter-script\") pod \"iptables-alerter-dnd4g\" (UID: \"b145e2e5-2e33-405e-a849-a636dd61fcc4\") " pod="openshift-network-operator/iptables-alerter-dnd4g" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399588 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzcd4\" (UniqueName: \"kubernetes.io/projected/bf3a564d-0449-43b8-a226-b2430d255604-kube-api-access-fzcd4\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399603 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-cni-netd\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399624 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-sysconfig\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.400352 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399656 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57-host\") pod \"node-ca-ck9kl\" (UID: \"ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57\") " pod="openshift-image-registry/node-ca-ck9kl" Jun 09 06:58:35.401215 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399682 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9980c63f-e2a5-40ff-a193-80276600e53e-tmp-dir\") pod \"node-resolver-qrvxd\" (UID: \"9980c63f-e2a5-40ff-a193-80276600e53e\") " pod="openshift-dns/node-resolver-qrvxd" Jun 09 06:58:35.401215 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399699 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-multus-cni-dir\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.401215 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399724 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-socket-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.401215 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399748 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/558993a8-854f-4a9b-9fad-1c7abc8101d9-env-overrides\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.401215 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399765 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b145e2e5-2e33-405e-a849-a636dd61fcc4-host-slash\") pod \"iptables-alerter-dnd4g\" (UID: \"b145e2e5-2e33-405e-a849-a636dd61fcc4\") " pod="openshift-network-operator/iptables-alerter-dnd4g" Jun 09 06:58:35.401215 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.399800 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-multus-conf-dir\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.401215 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.400314 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 06:58:35.401215 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.400399 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 06:58:35.401215 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.400314 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wx6gg\"" Jun 09 06:58:35.406948 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.406926 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 06:58:35.421981 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.421957 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pq9dd" Jun 09 06:58:35.429382 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.429357 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pq9dd" Jun 09 06:58:35.490889 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.490860 2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 06:58:35.500147 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500118 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-kubelet\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.500147 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500151 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-node-log\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.500376 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500171 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.500376 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500194 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/558993a8-854f-4a9b-9fad-1c7abc8101d9-ovnkube-script-lib\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.500376 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500227 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-kubelet\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.500376 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500249 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-node-log\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.500376 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500278 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.500376 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500294 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-host\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.500376 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500324 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-registration-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.500376 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500348 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-systemd-units\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500404 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-systemd-units\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500416 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-host\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500436 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-registration-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500459 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-var-lib-kubelet\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500491 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500518 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-var-lib-kubelet\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500523 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8257064f-cf68-45e7-b2b9-840f81301f5f-cni-binary-copy\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500555 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/038c9f73-b499-4acb-8be4-9666a532ee46-etc-tuned\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500581 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/038c9f73-b499-4acb-8be4-9666a532ee46-tmp\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500616 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-cnibin\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500644 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500671 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-run-openvswitch\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500695 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-cni-bin\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.500759 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500720 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-sysctl-conf\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.501260 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500765 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-run-openvswitch\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.501260 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500824 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-cni-bin\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.501260 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500876 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-sysctl-conf\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.501260 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500875 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-run\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.501260 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500892 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/558993a8-854f-4a9b-9fad-1c7abc8101d9-ovnkube-script-lib\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.501260 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500930 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-run\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.501260 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.500933 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 06:58:35.501534 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501506 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9980c63f-e2a5-40ff-a193-80276600e53e-hosts-file\") pod \"node-resolver-qrvxd\" (UID: \"9980c63f-e2a5-40ff-a193-80276600e53e\") " pod="openshift-dns/node-resolver-qrvxd" Jun 09 06:58:35.501609 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501531 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9980c63f-e2a5-40ff-a193-80276600e53e-hosts-file\") pod \"node-resolver-qrvxd\" (UID: \"9980c63f-e2a5-40ff-a193-80276600e53e\") " pod="openshift-dns/node-resolver-qrvxd" Jun 09 06:58:35.501609 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501558 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b145e2e5-2e33-405e-a849-a636dd61fcc4-iptables-alerter-script\") pod \"iptables-alerter-dnd4g\" (UID: \"b145e2e5-2e33-405e-a849-a636dd61fcc4\") " pod="openshift-network-operator/iptables-alerter-dnd4g" Jun 09 06:58:35.501609 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501589 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzcd4\" (UniqueName: \"kubernetes.io/projected/bf3a564d-0449-43b8-a226-b2430d255604-kube-api-access-fzcd4\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.501749 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501632 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhk4p\" (UniqueName: \"kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p\") pod \"network-check-target-jrjc4\" (UID: \"c4e47478-19f8-49ee-9f8c-8e4aabb26dab\") " pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:35.501749 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501662 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-cni-netd\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.501749 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501693 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-sysconfig\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.501749 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501725 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57-host\") pod \"node-ca-ck9kl\" (UID: \"ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57\") " pod="openshift-image-registry/node-ca-ck9kl" Jun 09 06:58:35.501972 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501753 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9980c63f-e2a5-40ff-a193-80276600e53e-tmp-dir\") pod \"node-resolver-qrvxd\" (UID: \"9980c63f-e2a5-40ff-a193-80276600e53e\") " pod="openshift-dns/node-resolver-qrvxd" Jun 09 06:58:35.501972 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501774 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-multus-cni-dir\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.501972 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501811 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-socket-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.501972 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501834 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/558993a8-854f-4a9b-9fad-1c7abc8101d9-env-overrides\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.501972 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501857 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b145e2e5-2e33-405e-a849-a636dd61fcc4-host-slash\") pod \"iptables-alerter-dnd4g\" (UID: \"b145e2e5-2e33-405e-a849-a636dd61fcc4\") " pod="openshift-network-operator/iptables-alerter-dnd4g" Jun 09 06:58:35.501972 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501879 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-multus-conf-dir\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.501972 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501889 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-cni-netd\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.501972 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501902 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea3e7624-ebcf-4493-9398-81c50f78c960-kubelet-config\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:35.501972 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501929 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea3e7624-ebcf-4493-9398-81c50f78c960-dbus\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:35.501972 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501941 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-sysconfig\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.501995 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-multus-cni-dir\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502005 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b145e2e5-2e33-405e-a849-a636dd61fcc4-host-slash\") pod \"iptables-alerter-dnd4g\" (UID: \"b145e2e5-2e33-405e-a849-a636dd61fcc4\") " pod="openshift-network-operator/iptables-alerter-dnd4g" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502024 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-device-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502045 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-multus-conf-dir\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502049 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-sysctl-d\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502074 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtftv\" (UniqueName: \"kubernetes.io/projected/9980c63f-e2a5-40ff-a193-80276600e53e-kube-api-access-rtftv\") pod \"node-resolver-qrvxd\" (UID: \"9980c63f-e2a5-40ff-a193-80276600e53e\") " pod="openshift-dns/node-resolver-qrvxd" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502098 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-cnibin\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502119 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-os-release\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502142 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502164 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-socket-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502167 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502197 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-log-socket\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502206 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502224 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-sys\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502248 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlblc\" (UniqueName: \"kubernetes.io/projected/ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57-kube-api-access-dlblc\") pod \"node-ca-ck9kl\" (UID: \"ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57\") " pod="openshift-image-registry/node-ca-ck9kl" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502269 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-device-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.502312 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502273 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49f24\" (UniqueName: \"kubernetes.io/projected/b145e2e5-2e33-405e-a849-a636dd61fcc4-kube-api-access-49f24\") pod \"iptables-alerter-dnd4g\" (UID: \"b145e2e5-2e33-405e-a849-a636dd61fcc4\") " pod="openshift-network-operator/iptables-alerter-dnd4g" Jun 09 06:58:35.502929 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502303 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-run-multus-certs\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.502929 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502314 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/558993a8-854f-4a9b-9fad-1c7abc8101d9-env-overrides\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.502929 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502326 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-run-netns\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.502929 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502373 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57-host\") pod \"node-ca-ck9kl\" (UID: \"ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57\") " pod="openshift-image-registry/node-ca-ck9kl" Jun 09 06:58:35.503317 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.502346 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-run-ovn\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.503317 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503123 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-sysctl-d\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.503317 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503165 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.503317 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503201 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-cnibin\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.503317 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503224 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57-serviceca\") pod \"node-ca-ck9kl\" (UID: \"ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57\") " pod="openshift-image-registry/node-ca-ck9kl" Jun 09 06:58:35.503317 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503244 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-run-multus-certs\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.503317 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503262 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-os-release\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.503317 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503289 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-run-netns\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.503317 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503298 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8257064f-cf68-45e7-b2b9-840f81301f5f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503336 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gds2b\" (UniqueName: \"kubernetes.io/projected/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-kube-api-access-gds2b\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503368 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-var-lib-openvswitch\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503416 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-os-release\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503419 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-run-ovn\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503472 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/558993a8-854f-4a9b-9fad-1c7abc8101d9-ovnkube-config\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503510 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/551d572c-896f-4dd2-a0ac-b23ae45b5e9f-konnectivity-ca\") pod \"konnectivity-agent-wmjqv\" (UID: \"551d572c-896f-4dd2-a0ac-b23ae45b5e9f\") " pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503527 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-var-lib-openvswitch\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503534 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-multus-socket-dir-parent\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503565 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-run-netns\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503592 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-hostroot\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503622 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-sys-fs\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503648 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-slash\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503675 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-modprobe-d\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.503765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503696 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9980c63f-e2a5-40ff-a193-80276600e53e-tmp-dir\") pod \"node-resolver-qrvxd\" (UID: \"9980c63f-e2a5-40ff-a193-80276600e53e\") " pod="openshift-dns/node-resolver-qrvxd" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503841 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-kubernetes\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503904 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-sys\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503700 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-kubernetes\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504193 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/558993a8-854f-4a9b-9fad-1c7abc8101d9-ovnkube-config\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504229 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57-serviceca\") pod \"node-ca-ck9kl\" (UID: \"ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57\") " pod="openshift-image-registry/node-ca-ck9kl" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503265 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504241 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-system-cni-dir\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.503334 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b145e2e5-2e33-405e-a849-a636dd61fcc4-iptables-alerter-script\") pod \"iptables-alerter-dnd4g\" (UID: \"b145e2e5-2e33-405e-a849-a636dd61fcc4\") " pod="openshift-network-operator/iptables-alerter-dnd4g" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504287 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf3a564d-0449-43b8-a226-b2430d255604-cni-binary-copy\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504330 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-system-cni-dir\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504358 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-sys-fs\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504363 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/551d572c-896f-4dd2-a0ac-b23ae45b5e9f-agent-certs\") pod \"konnectivity-agent-wmjqv\" (UID: \"551d572c-896f-4dd2-a0ac-b23ae45b5e9f\") " pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:58:35.504420 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504407 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-systemd\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504446 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8257064f-cf68-45e7-b2b9-840f81301f5f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504671 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-multus-socket-dir-parent\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504734 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-run-netns\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504753 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/038c9f73-b499-4acb-8be4-9666a532ee46-etc-tuned\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504773 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/551d572c-896f-4dd2-a0ac-b23ae45b5e9f-konnectivity-ca\") pod \"konnectivity-agent-wmjqv\" (UID: \"551d572c-896f-4dd2-a0ac-b23ae45b5e9f\") " pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504802 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-hostroot\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504867 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-host-slash\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504880 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-system-cni-dir\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504911 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-systemd\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504984 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-etc-modprobe-d\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.504993 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505061 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-log-socket\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.505127 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505105 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/558993a8-854f-4a9b-9fad-1c7abc8101d9-ovn-node-metrics-cert\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505157 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx4vb\" (UniqueName: \"kubernetes.io/projected/558993a8-854f-4a9b-9fad-1c7abc8101d9-kube-api-access-gx4vb\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505191 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-var-lib-kubelet\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505222 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-var-lib-cni-bin\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505258 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsgcd\" (UniqueName: \"kubernetes.io/projected/6ff5d471-42f5-46ff-84d5-e276685218dc-kube-api-access-gsgcd\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505292 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-etc-openvswitch\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505357 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-var-lib-kubelet\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505400 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-lib-modules\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505419 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf3a564d-0449-43b8-a226-b2430d255604-cni-binary-copy\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505434 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-var-lib-cni-multus\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505444 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/038c9f73-b499-4acb-8be4-9666a532ee46-tmp\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505463 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf3a564d-0449-43b8-a226-b2430d255604-multus-daemon-config\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505499 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm8bd\" (UniqueName: \"kubernetes.io/projected/8257064f-cf68-45e7-b2b9-840f81301f5f-kube-api-access-tm8bd\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505542 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-run-systemd\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505576 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x2f9\" (UniqueName: \"kubernetes.io/projected/038c9f73-b499-4acb-8be4-9666a532ee46-kube-api-access-9x2f9\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505603 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-run-k8s-cni-cncf-io\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505615 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-var-lib-cni-multus\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.506038 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505722 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-run-systemd\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.506975 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505741 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/558993a8-854f-4a9b-9fad-1c7abc8101d9-etc-openvswitch\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.506975 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505632 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-etc-kubernetes\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.506975 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505835 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:35.506975 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505949 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-run-k8s-cni-cncf-io\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.506975 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.505997 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-etc-kubernetes\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.506975 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.506128 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf3a564d-0449-43b8-a226-b2430d255604-host-var-lib-cni-bin\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.506975 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.506192 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf3a564d-0449-43b8-a226-b2430d255604-multus-daemon-config\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.506975 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.506236 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/038c9f73-b499-4acb-8be4-9666a532ee46-lib-modules\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.509458 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.509431 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/551d572c-896f-4dd2-a0ac-b23ae45b5e9f-agent-certs\") pod \"konnectivity-agent-wmjqv\" (UID: \"551d572c-896f-4dd2-a0ac-b23ae45b5e9f\") " pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:58:35.510626 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.510444 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/558993a8-854f-4a9b-9fad-1c7abc8101d9-ovn-node-metrics-cert\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.516983 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.516955 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzcd4\" (UniqueName: \"kubernetes.io/projected/bf3a564d-0449-43b8-a226-b2430d255604-kube-api-access-fzcd4\") pod \"multus-t4ll6\" (UID: \"bf3a564d-0449-43b8-a226-b2430d255604\") " pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.517087 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.517012 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlblc\" (UniqueName: \"kubernetes.io/projected/ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57-kube-api-access-dlblc\") pod \"node-ca-ck9kl\" (UID: \"ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57\") " pod="openshift-image-registry/node-ca-ck9kl" Jun 09 06:58:35.517087 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.517016 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x2f9\" (UniqueName: \"kubernetes.io/projected/038c9f73-b499-4acb-8be4-9666a532ee46-kube-api-access-9x2f9\") pod \"tuned-qmjfs\" (UID: \"038c9f73-b499-4acb-8be4-9666a532ee46\") " pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.517416 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.517370 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtftv\" (UniqueName: \"kubernetes.io/projected/9980c63f-e2a5-40ff-a193-80276600e53e-kube-api-access-rtftv\") pod \"node-resolver-qrvxd\" (UID: \"9980c63f-e2a5-40ff-a193-80276600e53e\") " pod="openshift-dns/node-resolver-qrvxd" Jun 09 06:58:35.517547 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.517501 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx4vb\" (UniqueName: \"kubernetes.io/projected/558993a8-854f-4a9b-9fad-1c7abc8101d9-kube-api-access-gx4vb\") pod \"ovnkube-node-jgkwk\" (UID: \"558993a8-854f-4a9b-9fad-1c7abc8101d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.518564 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.518543 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49f24\" (UniqueName: \"kubernetes.io/projected/b145e2e5-2e33-405e-a849-a636dd61fcc4-kube-api-access-49f24\") pod \"iptables-alerter-dnd4g\" (UID: \"b145e2e5-2e33-405e-a849-a636dd61fcc4\") " pod="openshift-network-operator/iptables-alerter-dnd4g" Jun 09 06:58:35.518664 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.518647 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gds2b\" (UniqueName: \"kubernetes.io/projected/05157b6a-42ec-49ec-9a84-068ffa3d1e5b-kube-api-access-gds2b\") pod \"aws-ebs-csi-driver-node-jrz2p\" (UID: \"05157b6a-42ec-49ec-9a84-068ffa3d1e5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.606377 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606343 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-system-cni-dir\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.606377 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606379 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8257064f-cf68-45e7-b2b9-840f81301f5f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.606628 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606405 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsgcd\" (UniqueName: \"kubernetes.io/projected/6ff5d471-42f5-46ff-84d5-e276685218dc-kube-api-access-gsgcd\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:35.606628 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606424 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8bd\" (UniqueName: \"kubernetes.io/projected/8257064f-cf68-45e7-b2b9-840f81301f5f-kube-api-access-tm8bd\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.606628 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606472 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-system-cni-dir\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.606628 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606447 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:35.606628 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606556 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:35.606628 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:35.606580 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:35.606934 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:35.606657 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:35.606934 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:35.606661 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs podName:6ff5d471-42f5-46ff-84d5-e276685218dc nodeName:}" failed. No retries permitted until 2026-06-09 06:58:36.106638195 +0000 UTC m=+3.081293725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs") pod "network-metrics-daemon-5gj2q" (UID: "6ff5d471-42f5-46ff-84d5-e276685218dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:35.606934 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606584 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8257064f-cf68-45e7-b2b9-840f81301f5f-cni-binary-copy\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.606934 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:35.606729 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret podName:ea3e7624-ebcf-4493-9398-81c50f78c960 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:36.106710858 +0000 UTC m=+3.081366386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret") pod "global-pull-secret-syncer-6plnd" (UID: "ea3e7624-ebcf-4493-9398-81c50f78c960") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:35.606934 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606759 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-cnibin\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.606934 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606805 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.606934 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606840 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhk4p\" (UniqueName: \"kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p\") pod \"network-check-target-jrjc4\" (UID: \"c4e47478-19f8-49ee-9f8c-8e4aabb26dab\") " pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:35.606934 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606872 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-cnibin\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.606934 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606873 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea3e7624-ebcf-4493-9398-81c50f78c960-kubelet-config\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:35.606934 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606917 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea3e7624-ebcf-4493-9398-81c50f78c960-dbus\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:35.606934 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606920 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ea3e7624-ebcf-4493-9398-81c50f78c960-kubelet-config\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:35.607401 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606968 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-os-release\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.607401 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606983 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ea3e7624-ebcf-4493-9398-81c50f78c960-dbus\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:35.607401 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.606994 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8257064f-cf68-45e7-b2b9-840f81301f5f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.607401 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.607063 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8257064f-cf68-45e7-b2b9-840f81301f5f-cni-binary-copy\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.607401 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.607108 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.607401 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.607137 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8257064f-cf68-45e7-b2b9-840f81301f5f-os-release\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.607401 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.607401 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8257064f-cf68-45e7-b2b9-840f81301f5f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.607688 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.607535 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8257064f-cf68-45e7-b2b9-840f81301f5f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.618635 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:35.618608 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:35.618635 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:35.618638 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:35.618852 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:35.618652 2549 projected.go:196] Error preparing data for projected volume kube-api-access-jhk4p for pod openshift-network-diagnostics/network-check-target-jrjc4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:35.618852 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:35.618725 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p podName:c4e47478-19f8-49ee-9f8c-8e4aabb26dab nodeName:}" failed. No retries permitted until 2026-06-09 06:58:36.118705645 +0000 UTC m=+3.093361168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jhk4p" (UniqueName: "kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p") pod "network-check-target-jrjc4" (UID: "c4e47478-19f8-49ee-9f8c-8e4aabb26dab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:35.621998 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.621907 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm8bd\" (UniqueName: \"kubernetes.io/projected/8257064f-cf68-45e7-b2b9-840f81301f5f-kube-api-access-tm8bd\") pod \"multus-additional-cni-plugins-ktxwt\" (UID: \"8257064f-cf68-45e7-b2b9-840f81301f5f\") " pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:35.621998 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.621929 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsgcd\" (UniqueName: \"kubernetes.io/projected/6ff5d471-42f5-46ff-84d5-e276685218dc-kube-api-access-gsgcd\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:35.682449 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.682419 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 06:58:35.694603 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.694569 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qrvxd" Jun 09 06:58:35.702761 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.702736 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" Jun 09 06:58:35.710246 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.710209 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dnd4g" Jun 09 06:58:35.715265 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.715240 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:58:35.722133 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.722109 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:58:35.729271 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.729243 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" Jun 09 06:58:35.735916 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.735892 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t4ll6" Jun 09 06:58:35.742735 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.742714 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ck9kl" Jun 09 06:58:35.748385 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:35.748359 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ktxwt" Jun 09 06:58:36.111487 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.111453 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:36.111681 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.111499 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:36.111681 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:36.111611 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:36.111681 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:36.111614 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:36.111681 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:36.111679 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret podName:ea3e7624-ebcf-4493-9398-81c50f78c960 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:37.111661571 +0000 UTC m=+4.086317100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret") pod "global-pull-secret-syncer-6plnd" (UID: "ea3e7624-ebcf-4493-9398-81c50f78c960") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:36.111910 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:36.111707 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs podName:6ff5d471-42f5-46ff-84d5-e276685218dc nodeName:}" failed. No retries permitted until 2026-06-09 06:58:37.111696381 +0000 UTC m=+4.086351908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs") pod "network-metrics-daemon-5gj2q" (UID: "6ff5d471-42f5-46ff-84d5-e276685218dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:36.167060 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:36.167035 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb145e2e5_2e33_405e_a849_a636dd61fcc4.slice/crio-a8d39981b5ffa7e93681f32ae955c7d0233869a4e4f952f0540a47d9e5f1be20 WatchSource:0}: Error finding container a8d39981b5ffa7e93681f32ae955c7d0233869a4e4f952f0540a47d9e5f1be20: Status 404 returned error can't find the container with id a8d39981b5ffa7e93681f32ae955c7d0233869a4e4f952f0540a47d9e5f1be20 Jun 09 06:58:36.168167 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:36.168141 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3a564d_0449_43b8_a226_b2430d255604.slice/crio-da0b5c6670bb299f4733289138e5af66e66038445d83b40bff1f53dcf0563c9d WatchSource:0}: Error finding container da0b5c6670bb299f4733289138e5af66e66038445d83b40bff1f53dcf0563c9d: Status 404 returned error can't find the container with id da0b5c6670bb299f4733289138e5af66e66038445d83b40bff1f53dcf0563c9d Jun 09 06:58:36.172054 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:36.172028 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9980c63f_e2a5_40ff_a193_80276600e53e.slice/crio-005afb975795324d75ecebe47dfaeb03500b8da4455e5f6c16a43f6872922612 WatchSource:0}: Error finding container 005afb975795324d75ecebe47dfaeb03500b8da4455e5f6c16a43f6872922612: Status 404 returned error can't find the container with id 005afb975795324d75ecebe47dfaeb03500b8da4455e5f6c16a43f6872922612 Jun 09 06:58:36.173089 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:36.173026 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038c9f73_b499_4acb_8be4_9666a532ee46.slice/crio-0e0c080f484fb984031c800bb03dc37fe19c8c9a70a8d6670b4ee45b8751936c WatchSource:0}: Error finding container 0e0c080f484fb984031c800bb03dc37fe19c8c9a70a8d6670b4ee45b8751936c: Status 404 returned error can't find the container with id 0e0c080f484fb984031c800bb03dc37fe19c8c9a70a8d6670b4ee45b8751936c Jun 09 06:58:36.173606 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:36.173559 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551d572c_896f_4dd2_a0ac_b23ae45b5e9f.slice/crio-d5153862fc486efd329385889c64f8f03d3e79336eabfbde8ed4325ace1ef37f WatchSource:0}: Error finding container d5153862fc486efd329385889c64f8f03d3e79336eabfbde8ed4325ace1ef37f: Status 404 returned error can't find the container with id d5153862fc486efd329385889c64f8f03d3e79336eabfbde8ed4325ace1ef37f Jun 09 06:58:36.175297 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:36.175273 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8257064f_cf68_45e7_b2b9_840f81301f5f.slice/crio-20453054560dfb9ecbb3d92c4d5605c491bc8a1f4c8e34d30d593be0dc7c313f WatchSource:0}: Error finding container 20453054560dfb9ecbb3d92c4d5605c491bc8a1f4c8e34d30d593be0dc7c313f: Status 404 returned error can't find the container with id 20453054560dfb9ecbb3d92c4d5605c491bc8a1f4c8e34d30d593be0dc7c313f Jun 09 06:58:36.176643 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:36.176624 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05157b6a_42ec_49ec_9a84_068ffa3d1e5b.slice/crio-b6856abf8fb22efb5ffe74a673882957f2675c18de5b442d3519e9e31be460db WatchSource:0}: Error finding container b6856abf8fb22efb5ffe74a673882957f2675c18de5b442d3519e9e31be460db: Status 404 returned error can't find the container with id b6856abf8fb22efb5ffe74a673882957f2675c18de5b442d3519e9e31be460db Jun 09 06:58:36.177942 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:36.177111 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4336dd_2dbb_4c2d_bd1c_ae95ca47aa57.slice/crio-6b28920328c0cbff586d8ca371b2c317bd3d058e50d7796b6f5d408730bbd427 WatchSource:0}: Error finding container 6b28920328c0cbff586d8ca371b2c317bd3d058e50d7796b6f5d408730bbd427: Status 404 returned error can't find the container with id 6b28920328c0cbff586d8ca371b2c317bd3d058e50d7796b6f5d408730bbd427 Jun 09 06:58:36.179194 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:58:36.178672 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558993a8_854f_4a9b_9fad_1c7abc8101d9.slice/crio-c1ab677220b130bea3390e4fd16b2e88ab71a3e36212753f2b3e9b143410b5e5 WatchSource:0}: Error finding container c1ab677220b130bea3390e4fd16b2e88ab71a3e36212753f2b3e9b143410b5e5: Status 404 returned error can't find the container with id c1ab677220b130bea3390e4fd16b2e88ab71a3e36212753f2b3e9b143410b5e5 Jun 09 06:58:36.212066 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.212010 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhk4p\" (UniqueName: \"kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p\") pod \"network-check-target-jrjc4\" (UID: \"c4e47478-19f8-49ee-9f8c-8e4aabb26dab\") " pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:36.212205 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:36.212189 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:36.212268 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:36.212215 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:36.212268 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:36.212229 2549 projected.go:196] Error preparing data for projected volume kube-api-access-jhk4p for pod openshift-network-diagnostics/network-check-target-jrjc4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:36.212357 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:36.212283 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p podName:c4e47478-19f8-49ee-9f8c-8e4aabb26dab nodeName:}" failed. No retries permitted until 2026-06-09 06:58:37.212265227 +0000 UTC m=+4.186920772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhk4p" (UniqueName: "kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p") pod "network-check-target-jrjc4" (UID: "c4e47478-19f8-49ee-9f8c-8e4aabb26dab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:36.431584 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.431502 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 06:53:35 +0000 UTC" deadline="2028-01-17 04:26:42.175715098 +0000 UTC" Jun 09 06:58:36.431584 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.431583 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14085h28m5.744136757s" Jun 09 06:58:36.462122 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.462089 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:36.462241 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:36.462222 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:36.474211 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.474171 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wmjqv" event={"ID":"551d572c-896f-4dd2-a0ac-b23ae45b5e9f","Type":"ContainerStarted","Data":"d5153862fc486efd329385889c64f8f03d3e79336eabfbde8ed4325ace1ef37f"} Jun 09 06:58:36.475917 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.475885 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qrvxd" event={"ID":"9980c63f-e2a5-40ff-a193-80276600e53e","Type":"ContainerStarted","Data":"005afb975795324d75ecebe47dfaeb03500b8da4455e5f6c16a43f6872922612"} Jun 09 06:58:36.477332 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.477302 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t4ll6" event={"ID":"bf3a564d-0449-43b8-a226-b2430d255604","Type":"ContainerStarted","Data":"da0b5c6670bb299f4733289138e5af66e66038445d83b40bff1f53dcf0563c9d"} Jun 09 06:58:36.478693 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.478646 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ck9kl" event={"ID":"ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57","Type":"ContainerStarted","Data":"6b28920328c0cbff586d8ca371b2c317bd3d058e50d7796b6f5d408730bbd427"} Jun 09 06:58:36.481308 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.481273 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ktxwt" event={"ID":"8257064f-cf68-45e7-b2b9-840f81301f5f","Type":"ContainerStarted","Data":"20453054560dfb9ecbb3d92c4d5605c491bc8a1f4c8e34d30d593be0dc7c313f"} Jun 09 06:58:36.483855 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.483828 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" event={"ID":"558993a8-854f-4a9b-9fad-1c7abc8101d9","Type":"ContainerStarted","Data":"c1ab677220b130bea3390e4fd16b2e88ab71a3e36212753f2b3e9b143410b5e5"} Jun 09 06:58:36.486413 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.486388 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dnd4g" event={"ID":"b145e2e5-2e33-405e-a849-a636dd61fcc4","Type":"ContainerStarted","Data":"a8d39981b5ffa7e93681f32ae955c7d0233869a4e4f952f0540a47d9e5f1be20"} Jun 09 06:58:36.488997 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.488969 2549 generic.go:356] "Generic (PLEG): container finished" podID="7a38314d8b55b654b06aedba48003627" containerID="f065fd51c1264603cf7f09842967fa1bd564a1791643cb32bf49db28d2ac481c" exitCode=0 Jun 09 06:58:36.489644 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.489614 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" event={"ID":"7a38314d8b55b654b06aedba48003627","Type":"ContainerDied","Data":"f065fd51c1264603cf7f09842967fa1bd564a1791643cb32bf49db28d2ac481c"} Jun 09 06:58:36.493256 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.493231 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-166.ec2.internal" event={"ID":"8d847be753db4224a797cf6deaab03dc","Type":"ContainerStarted","Data":"47dc5d90a60144915545ae9a77f32217cf7d44700e19bb1dc158ab08f04cb118"} Jun 09 06:58:36.497025 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.496947 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" event={"ID":"038c9f73-b499-4acb-8be4-9666a532ee46","Type":"ContainerStarted","Data":"0e0c080f484fb984031c800bb03dc37fe19c8c9a70a8d6670b4ee45b8751936c"} Jun 09 06:58:36.499474 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.499403 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" event={"ID":"05157b6a-42ec-49ec-9a84-068ffa3d1e5b","Type":"ContainerStarted","Data":"b6856abf8fb22efb5ffe74a673882957f2675c18de5b442d3519e9e31be460db"} Jun 09 06:58:36.520359 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:36.520000 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-166.ec2.internal" podStartSLOduration=2.51998034 podStartE2EDuration="2.51998034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:36.519891557 +0000 UTC m=+3.494547103" watchObservedRunningTime="2026-06-09 06:58:36.51998034 +0000 UTC m=+3.494635884" Jun 09 06:58:37.121343 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:37.120586 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:37.121343 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:37.120656 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:37.121343 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:37.120855 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:37.121343 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:37.120917 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret podName:ea3e7624-ebcf-4493-9398-81c50f78c960 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:39.120899369 +0000 UTC m=+6.095554892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret") pod "global-pull-secret-syncer-6plnd" (UID: "ea3e7624-ebcf-4493-9398-81c50f78c960") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:37.121343 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:37.120984 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:37.121343 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:37.121017 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs podName:6ff5d471-42f5-46ff-84d5-e276685218dc nodeName:}" failed. No retries permitted until 2026-06-09 06:58:39.121004796 +0000 UTC m=+6.095660323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs") pod "network-metrics-daemon-5gj2q" (UID: "6ff5d471-42f5-46ff-84d5-e276685218dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:37.222397 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:37.221731 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhk4p\" (UniqueName: \"kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p\") pod \"network-check-target-jrjc4\" (UID: \"c4e47478-19f8-49ee-9f8c-8e4aabb26dab\") " pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:37.222397 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:37.221933 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:37.222397 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:37.221954 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:37.222397 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:37.221968 2549 projected.go:196] Error preparing data for projected volume kube-api-access-jhk4p for pod openshift-network-diagnostics/network-check-target-jrjc4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:37.222397 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:37.222035 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p podName:c4e47478-19f8-49ee-9f8c-8e4aabb26dab nodeName:}" failed. No retries permitted until 2026-06-09 06:58:39.222016119 +0000 UTC m=+6.196671675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhk4p" (UniqueName: "kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p") pod "network-check-target-jrjc4" (UID: "c4e47478-19f8-49ee-9f8c-8e4aabb26dab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:37.432715 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:37.432666 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 06:53:35 +0000 UTC" deadline="2027-11-26 13:16:11.449200341 +0000 UTC" Jun 09 06:58:37.432715 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:37.432711 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12846h17m34.016493263s" Jun 09 06:58:37.473262 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:37.473232 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:37.473443 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:37.473359 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:37.473765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:37.473739 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:37.473889 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:37.473867 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:37.524353 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:37.523547 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" event={"ID":"7a38314d8b55b654b06aedba48003627","Type":"ContainerStarted","Data":"5e3a6686315d96f051303514bf9a4a48009b4322fab7b074bc2142d5b264c33d"} Jun 09 06:58:37.540492 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:37.540427 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-166.ec2.internal" podStartSLOduration=3.540403764 podStartE2EDuration="3.540403764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:37.539956725 +0000 UTC m=+4.514612271" watchObservedRunningTime="2026-06-09 06:58:37.540403764 +0000 UTC m=+4.515059311" Jun 09 06:58:38.463206 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:38.462669 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:38.463206 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:38.462850 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:39.138851 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:39.138806 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:39.139073 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:39.138877 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:39.139135 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:39.139072 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:39.139200 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:39.139140 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret podName:ea3e7624-ebcf-4493-9398-81c50f78c960 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:43.139119425 +0000 UTC m=+10.113774962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret") pod "global-pull-secret-syncer-6plnd" (UID: "ea3e7624-ebcf-4493-9398-81c50f78c960") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:39.139272 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:39.139215 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:39.139272 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:39.139249 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs podName:6ff5d471-42f5-46ff-84d5-e276685218dc nodeName:}" failed. No retries permitted until 2026-06-09 06:58:43.139237413 +0000 UTC m=+10.113892949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs") pod "network-metrics-daemon-5gj2q" (UID: "6ff5d471-42f5-46ff-84d5-e276685218dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:39.240345 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:39.240084 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhk4p\" (UniqueName: \"kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p\") pod \"network-check-target-jrjc4\" (UID: \"c4e47478-19f8-49ee-9f8c-8e4aabb26dab\") " pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:39.240345 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:39.240317 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:39.240345 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:39.240338 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:39.240345 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:39.240351 2549 projected.go:196] Error preparing data for projected volume kube-api-access-jhk4p for pod openshift-network-diagnostics/network-check-target-jrjc4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:39.240683 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:39.240415 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p podName:c4e47478-19f8-49ee-9f8c-8e4aabb26dab nodeName:}" failed. No retries permitted until 2026-06-09 06:58:43.240397268 +0000 UTC m=+10.215052811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhk4p" (UniqueName: "kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p") pod "network-check-target-jrjc4" (UID: "c4e47478-19f8-49ee-9f8c-8e4aabb26dab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:39.462664 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:39.462167 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:39.462664 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:39.462317 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:39.463151 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:39.463010 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:39.463151 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:39.463114 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:40.462198 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:40.462163 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:40.462380 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:40.462300 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:41.462243 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:41.462182 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:41.462714 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:41.462330 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:41.462775 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:41.462741 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:41.462887 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:41.462863 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:42.462464 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:42.462434 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:42.462961 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:42.462567 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:43.175917 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:43.175762 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:43.175917 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:43.175878 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:43.175917 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:43.175904 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:43.176308 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:43.175964 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret podName:ea3e7624-ebcf-4493-9398-81c50f78c960 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:51.175948875 +0000 UTC m=+18.150604409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret") pod "global-pull-secret-syncer-6plnd" (UID: "ea3e7624-ebcf-4493-9398-81c50f78c960") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:43.176308 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:43.176001 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:43.176308 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:43.176067 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs podName:6ff5d471-42f5-46ff-84d5-e276685218dc nodeName:}" failed. No retries permitted until 2026-06-09 06:58:51.176049432 +0000 UTC m=+18.150704975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs") pod "network-metrics-daemon-5gj2q" (UID: "6ff5d471-42f5-46ff-84d5-e276685218dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:43.276917 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:43.276872 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhk4p\" (UniqueName: \"kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p\") pod \"network-check-target-jrjc4\" (UID: \"c4e47478-19f8-49ee-9f8c-8e4aabb26dab\") " pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:43.277117 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:43.277072 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:43.277117 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:43.277101 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:43.277117 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:43.277115 2549 projected.go:196] Error preparing data for projected volume kube-api-access-jhk4p for pod openshift-network-diagnostics/network-check-target-jrjc4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:43.277292 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:43.277183 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p podName:c4e47478-19f8-49ee-9f8c-8e4aabb26dab nodeName:}" failed. No retries permitted until 2026-06-09 06:58:51.277163773 +0000 UTC m=+18.251819299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhk4p" (UniqueName: "kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p") pod "network-check-target-jrjc4" (UID: "c4e47478-19f8-49ee-9f8c-8e4aabb26dab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:43.463924 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:43.463273 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:43.463924 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:43.463447 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:43.463924 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:43.463613 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:43.463924 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:43.463781 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:44.462749 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:44.462713 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:44.462922 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:44.462869 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:45.462701 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:45.462664 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:45.463130 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:45.462684 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:45.463130 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:45.462847 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:45.463130 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:45.462918 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:46.462552 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:46.462512 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:46.462738 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:46.462646 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:47.465924 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:47.465890 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:47.466373 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:47.465933 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:47.466373 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:47.466022 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:47.466373 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:47.466181 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:48.462900 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:48.462629 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:48.463065 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:48.463003 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:49.462165 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:49.462124 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:49.462632 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:49.462268 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:49.462632 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:49.462328 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:49.462632 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:49.462447 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:50.461932 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:50.461898 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:50.462114 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:50.462044 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:51.245778 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:51.245736 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:51.245778 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:51.245798 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:51.246275 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:51.245913 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:51.246275 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:51.245993 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs podName:6ff5d471-42f5-46ff-84d5-e276685218dc nodeName:}" failed. No retries permitted until 2026-06-09 06:59:07.245972678 +0000 UTC m=+34.220628223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs") pod "network-metrics-daemon-5gj2q" (UID: "6ff5d471-42f5-46ff-84d5-e276685218dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:51.246275 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:51.245917 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:51.246275 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:51.246095 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret podName:ea3e7624-ebcf-4493-9398-81c50f78c960 nodeName:}" failed. No retries permitted until 2026-06-09 06:59:07.246072822 +0000 UTC m=+34.220728349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret") pod "global-pull-secret-syncer-6plnd" (UID: "ea3e7624-ebcf-4493-9398-81c50f78c960") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:51.346554 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:51.346510 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhk4p\" (UniqueName: \"kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p\") pod \"network-check-target-jrjc4\" (UID: \"c4e47478-19f8-49ee-9f8c-8e4aabb26dab\") " pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:51.346732 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:51.346700 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:51.346732 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:51.346727 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:51.346853 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:51.346741 2549 projected.go:196] Error preparing data for projected volume kube-api-access-jhk4p for pod openshift-network-diagnostics/network-check-target-jrjc4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:51.346853 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:51.346825 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p podName:c4e47478-19f8-49ee-9f8c-8e4aabb26dab nodeName:}" failed. No retries permitted until 2026-06-09 06:59:07.346804533 +0000 UTC m=+34.321460072 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhk4p" (UniqueName: "kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p") pod "network-check-target-jrjc4" (UID: "c4e47478-19f8-49ee-9f8c-8e4aabb26dab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:51.462177 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:51.462140 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:51.462177 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:51.462165 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:51.462414 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:51.462281 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:51.462414 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:51.462397 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:52.462537 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:52.462501 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:52.463010 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:52.462628 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:53.463381 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:53.463346 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:53.463872 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:53.463467 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:53.463872 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:53.463516 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:53.463872 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:53.463643 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:54.461861 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:54.461811 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:54.462037 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:54.461919 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:55.462025 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.461997 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:55.462735 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:55.462103 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:55.462735 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.462157 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:55.462735 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:55.462264 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:55.566276 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.566210 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" event={"ID":"038c9f73-b499-4acb-8be4-9666a532ee46","Type":"ContainerStarted","Data":"4eb5f5c595218c7b2a29b5663c1b48d817c88e906df898646303443f35f33c07"} Jun 09 06:58:55.568022 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.567988 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" event={"ID":"05157b6a-42ec-49ec-9a84-068ffa3d1e5b","Type":"ContainerStarted","Data":"519426e9dbb1193efe1e561fba88bf95037edcd9c3129b24bea16fe46d6d0002"} Jun 09 06:58:55.570152 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.570119 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wmjqv" event={"ID":"551d572c-896f-4dd2-a0ac-b23ae45b5e9f","Type":"ContainerStarted","Data":"b42096a793ce14f82fd05766ced849a48ea5548466eb376e4c854e7c48e8d95d"} Jun 09 06:58:55.571836 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.571765 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qrvxd" event={"ID":"9980c63f-e2a5-40ff-a193-80276600e53e","Type":"ContainerStarted","Data":"ca95526849de54b2f171efe8776b781af0dc6990f9aee0ef132767f512dfb831"} Jun 09 06:58:55.573414 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.573389 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t4ll6" event={"ID":"bf3a564d-0449-43b8-a226-b2430d255604","Type":"ContainerStarted","Data":"bf8dc86fc1ee4bfb5b66ae931e3d4ed1008c837ea7a3decc9508aaede4ba04b8"} Jun 09 06:58:55.575075 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.575051 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ck9kl" event={"ID":"ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57","Type":"ContainerStarted","Data":"9e23f4fe079ce4195e48c9e0e700a35b0a71b3595003bf9ca633a56c3e7a0af2"} Jun 09 06:58:55.579836 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.579804 2549 generic.go:356] "Generic (PLEG): container finished" podID="8257064f-cf68-45e7-b2b9-840f81301f5f" containerID="d22e4f80097efcbb93c6efed5c1de929e913627686a88a84bd9b0ae108215a7a" exitCode=0 Jun 09 06:58:55.579959 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.579831 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ktxwt" event={"ID":"8257064f-cf68-45e7-b2b9-840f81301f5f","Type":"ContainerDied","Data":"d22e4f80097efcbb93c6efed5c1de929e913627686a88a84bd9b0ae108215a7a"} Jun 09 06:58:55.583930 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.583898 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" event={"ID":"558993a8-854f-4a9b-9fad-1c7abc8101d9","Type":"ContainerStarted","Data":"0f8e088da2b46629899aab183df9e92a9f4e65e7099e507eb3455ae2e7f02f25"} Jun 09 06:58:55.584032 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.583984 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" event={"ID":"558993a8-854f-4a9b-9fad-1c7abc8101d9","Type":"ContainerStarted","Data":"7311c8843b0fa5cd29bfbd5afb5c91e39a3256b66dcc599b72e30e730bba67f6"} Jun 09 06:58:55.584096 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.584035 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" event={"ID":"558993a8-854f-4a9b-9fad-1c7abc8101d9","Type":"ContainerStarted","Data":"49220db881a0d2c59fd6d62636f270804c92df75905b030700ee2e1be57a3d80"} Jun 09 06:58:55.584096 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.584085 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" event={"ID":"558993a8-854f-4a9b-9fad-1c7abc8101d9","Type":"ContainerStarted","Data":"ac38113b0558c2ffa769409729ecea7208490270819d650e0d47c2f6b0415570"} Jun 09 06:58:55.584193 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.584130 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" event={"ID":"558993a8-854f-4a9b-9fad-1c7abc8101d9","Type":"ContainerStarted","Data":"2d05cfc38543e63c4b259adc7a83d239418c3089ec04250e7ab72a81e371f1e0"} Jun 09 06:58:55.584193 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.584172 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" event={"ID":"558993a8-854f-4a9b-9fad-1c7abc8101d9","Type":"ContainerStarted","Data":"e3a37a33f50cda4df68a015e8c44776ac9f2c143d604162122fbdcbc8fe33795"} Jun 09 06:58:55.601036 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.600976 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qmjfs" podStartSLOduration=3.791067492 podStartE2EDuration="22.600955873s" totalImagesPullingTime="18.809888381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:55.584406648 +0000 UTC m=+22.559062194" watchObservedRunningTime="2026-06-09 06:58:55.600955873 +0000 UTC m=+22.575611419" Jun 09 06:58:55.601210 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.601096 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qrvxd" podStartSLOduration=3.792544054 podStartE2EDuration="22.601089199s" totalImagesPullingTime="18.808545145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:55.600618476 +0000 UTC m=+22.575274022" watchObservedRunningTime="2026-06-09 06:58:55.601089199 +0000 UTC m=+22.575744802" Jun 09 06:58:55.622119 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.622004 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t4ll6" podStartSLOduration=3.7667581009999997 podStartE2EDuration="22.62198199s" totalImagesPullingTime="18.855223889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:55.621046478 +0000 UTC m=+22.595702046" watchObservedRunningTime="2026-06-09 06:58:55.62198199 +0000 UTC m=+22.596637536" Jun 09 06:58:55.660217 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.660146 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wmjqv" podStartSLOduration=8.592120463 podStartE2EDuration="22.660123255s" totalImagesPullingTime="14.068002792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:55.659357618 +0000 UTC m=+22.634013165" watchObservedRunningTime="2026-06-09 06:58:55.660123255 +0000 UTC m=+22.634778801" Jun 09 06:58:55.676885 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:55.676824 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ck9kl" podStartSLOduration=3.87278069 podStartE2EDuration="22.676781044s" totalImagesPullingTime="18.804000354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:55.676665747 +0000 UTC m=+22.651321306" watchObservedRunningTime="2026-06-09 06:58:55.676781044 +0000 UTC m=+22.651436591" Jun 09 06:58:56.056504 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:56.056336 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 06:58:56.462408 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:56.462372 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:56.462912 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:56.462370 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T06:58:56.056500683Z","UUID":"89b07efa-6285-4239-bd24-4d833a6ca3ac","Handler":null,"Name":"","Endpoint":""} Jun 09 06:58:56.462912 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:56.462499 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:56.464262 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:56.464241 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 06:58:56.464379 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:56.464285 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 06:58:56.587941 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:56.587903 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dnd4g" event={"ID":"b145e2e5-2e33-405e-a849-a636dd61fcc4","Type":"ContainerStarted","Data":"7c085da7755f0112083c2fa9a051bbc7b010ed76fea74bf9f0ad6cd055bbe8a3"} Jun 09 06:58:56.590564 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:56.590476 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" event={"ID":"05157b6a-42ec-49ec-9a84-068ffa3d1e5b","Type":"ContainerStarted","Data":"2b2287c5293cee8688be5aabbea36acb7f27f5a4539f13b3a911f1e66d7a9f7e"} Jun 09 06:58:56.602551 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:56.602489 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dnd4g" podStartSLOduration=4.7887233049999995 podStartE2EDuration="23.602466672s" totalImagesPullingTime="18.813743367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:56.602283387 +0000 UTC m=+23.576938934" watchObservedRunningTime="2026-06-09 06:58:56.602466672 +0000 UTC m=+23.577122220" Jun 09 06:58:56.677728 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:56.677696 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:58:57.462578 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:57.462539 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:57.463137 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:57.462539 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:57.463137 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:57.462697 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:57.463137 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:57.462745 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:57.597102 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:57.597069 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" event={"ID":"05157b6a-42ec-49ec-9a84-068ffa3d1e5b","Type":"ContainerStarted","Data":"202692a4ce498e379c8ef89bcb57c6564167db073652645bed4d64ad95a50336"} Jun 09 06:58:58.462804 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:58.462757 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:58:58.463238 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:58.462911 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:58:58.603143 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:58.603101 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" event={"ID":"558993a8-854f-4a9b-9fad-1c7abc8101d9","Type":"ContainerStarted","Data":"03a509c20d0471c7ab58b696b043e8f873ff8dc50d879686886c2d856d695e05"} Jun 09 06:58:59.243602 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:59.243564 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:58:59.244507 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:59.244483 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:58:59.258498 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:59.258442 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrz2p" podStartSLOduration=6.039748655 podStartE2EDuration="26.258426626s" totalImagesPullingTime="20.218677971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:57.613251409 +0000 UTC m=+24.587906977" watchObservedRunningTime="2026-06-09 06:58:59.258426626 +0000 UTC m=+26.233082174" Jun 09 06:58:59.462883 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:59.462850 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:58:59.463447 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:59.462850 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:58:59.463447 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:59.462978 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:58:59.463447 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:58:59.463077 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:58:59.606651 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:58:59.606565 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wmjqv" Jun 09 06:59:00.462281 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:00.462029 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:59:00.462435 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:00.462307 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:59:00.610377 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:00.610341 2549 generic.go:356] "Generic (PLEG): container finished" podID="8257064f-cf68-45e7-b2b9-840f81301f5f" containerID="451bedea8bc0584e1b414e48567304cbadae5b9a037248758945cc563b6a8fce" exitCode=0 Jun 09 06:59:00.610879 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:00.610429 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ktxwt" event={"ID":"8257064f-cf68-45e7-b2b9-840f81301f5f","Type":"ContainerDied","Data":"451bedea8bc0584e1b414e48567304cbadae5b9a037248758945cc563b6a8fce"} Jun 09 06:59:00.614328 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:00.614296 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" event={"ID":"558993a8-854f-4a9b-9fad-1c7abc8101d9","Type":"ContainerStarted","Data":"7ea23289425d9c6933c1edef50f638cae7db4cd9076faa6a952f89a2b4344185"} Jun 09 06:59:00.661456 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:00.661398 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" podStartSLOduration=8.779370418 podStartE2EDuration="27.661379299s" totalImagesPullingTime="18.882008881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:59:00.660844524 +0000 UTC m=+27.635500069" watchObservedRunningTime="2026-06-09 06:59:00.661379299 +0000 UTC m=+27.636034869" Jun 09 06:59:01.461973 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.461941 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:59:01.461973 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.461962 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:59:01.462175 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:01.462119 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:59:01.462275 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:01.462250 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:59:01.617822 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.617771 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:59:01.618243 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.617857 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:59:01.618243 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.617899 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:59:01.634396 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.634368 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:59:01.634636 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.634620 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:59:01.935089 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.934914 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5gj2q"] Jun 09 06:59:01.935267 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.935181 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:59:01.935314 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:01.935285 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:59:01.938699 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.938670 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6plnd"] Jun 09 06:59:01.938858 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.938827 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:59:01.938940 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:01.938918 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:59:01.939303 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.939278 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrjc4"] Jun 09 06:59:01.939403 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:01.939390 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:59:01.939494 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:01.939473 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:59:02.621462 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:02.621427 2549 generic.go:356] "Generic (PLEG): container finished" podID="8257064f-cf68-45e7-b2b9-840f81301f5f" containerID="a495a9a0c22c491adcf135adf3bfaf00c18a7a63719c002887503d9d9af06f6a" exitCode=0 Jun 09 06:59:02.622028 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:02.621508 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ktxwt" event={"ID":"8257064f-cf68-45e7-b2b9-840f81301f5f","Type":"ContainerDied","Data":"a495a9a0c22c491adcf135adf3bfaf00c18a7a63719c002887503d9d9af06f6a"} Jun 09 06:59:03.464031 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:03.464001 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:59:03.464187 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:03.464108 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:59:03.464187 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:03.464149 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:59:03.464187 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:03.464148 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:59:03.464319 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:03.464224 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:59:03.464353 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:03.464315 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:59:04.628756 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:04.628722 2549 generic.go:356] "Generic (PLEG): container finished" podID="8257064f-cf68-45e7-b2b9-840f81301f5f" containerID="ee3b0479e8bdd29c2440b3a839ad337086d431339c1f88f6d2dca69616d6bef5" exitCode=0 Jun 09 06:59:04.629295 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:04.628764 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ktxwt" event={"ID":"8257064f-cf68-45e7-b2b9-840f81301f5f","Type":"ContainerDied","Data":"ee3b0479e8bdd29c2440b3a839ad337086d431339c1f88f6d2dca69616d6bef5"} Jun 09 06:59:05.462301 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:05.462265 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:59:05.462486 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:05.462265 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:59:05.462486 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:05.462268 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:59:05.462486 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:05.462412 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:59:05.462486 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:05.462461 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:59:05.462677 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:05.462537 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:59:07.265919 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.265874 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:59:07.266484 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:07.266018 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:59:07.266484 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.266081 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:59:07.266484 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:07.266095 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret podName:ea3e7624-ebcf-4493-9398-81c50f78c960 nodeName:}" failed. No retries permitted until 2026-06-09 06:59:39.266075834 +0000 UTC m=+66.240731374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret") pod "global-pull-secret-syncer-6plnd" (UID: "ea3e7624-ebcf-4493-9398-81c50f78c960") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:59:07.266484 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:07.266174 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:59:07.266484 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:07.266219 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs podName:6ff5d471-42f5-46ff-84d5-e276685218dc nodeName:}" failed. No retries permitted until 2026-06-09 06:59:39.266206381 +0000 UTC m=+66.240861920 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs") pod "network-metrics-daemon-5gj2q" (UID: "6ff5d471-42f5-46ff-84d5-e276685218dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:59:07.367109 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.367069 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhk4p\" (UniqueName: \"kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p\") pod \"network-check-target-jrjc4\" (UID: \"c4e47478-19f8-49ee-9f8c-8e4aabb26dab\") " pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:59:07.367279 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:07.367227 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:59:07.367279 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:07.367248 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:59:07.367279 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:07.367261 2549 projected.go:196] Error preparing data for projected volume kube-api-access-jhk4p for pod openshift-network-diagnostics/network-check-target-jrjc4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:59:07.367425 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:07.367316 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p podName:c4e47478-19f8-49ee-9f8c-8e4aabb26dab nodeName:}" failed. No retries permitted until 2026-06-09 06:59:39.367301023 +0000 UTC m=+66.341956559 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhk4p" (UniqueName: "kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p") pod "network-check-target-jrjc4" (UID: "c4e47478-19f8-49ee-9f8c-8e4aabb26dab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:59:07.462074 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.462036 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:59:07.462256 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.462036 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:59:07.462256 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.462159 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:59:07.462256 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:07.462156 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrjc4" podUID="c4e47478-19f8-49ee-9f8c-8e4aabb26dab" Jun 09 06:59:07.462417 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:07.462312 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 06:59:07.462417 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:07.462379 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6plnd" podUID="ea3e7624-ebcf-4493-9398-81c50f78c960" Jun 09 06:59:07.895581 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.895342 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-166.ec2.internal" event="NodeReady" Jun 09 06:59:07.895733 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.895672 2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 06:59:07.941528 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.941492 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mzkvs"] Jun 09 06:59:07.971544 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.971509 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b7kqp"] Jun 09 06:59:07.971726 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.971650 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:07.974378 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.974351 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4jm8\"" Jun 09 06:59:07.974515 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.974431 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 06:59:07.974515 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.974359 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 06:59:07.987532 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.987509 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b7kqp"] Jun 09 06:59:07.987668 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.987542 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b7kqp" Jun 09 06:59:07.987668 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.987561 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mzkvs"] Jun 09 06:59:07.990569 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.990541 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-895r4\"" Jun 09 06:59:07.990852 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.990818 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 06:59:07.990945 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.990870 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 06:59:07.990945 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:07.990874 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 06:59:08.074006 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.073973 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwc6p\" (UniqueName: \"kubernetes.io/projected/ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa-kube-api-access-wwc6p\") pod \"ingress-canary-b7kqp\" (UID: \"ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa\") " pod="openshift-ingress-canary/ingress-canary-b7kqp" Jun 09 06:59:08.074202 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.074034 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvcnf\" (UniqueName: \"kubernetes.io/projected/27d1e129-2183-4926-8818-8e57fb66b135-kube-api-access-dvcnf\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.074202 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.074078 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27d1e129-2183-4926-8818-8e57fb66b135-config-volume\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.074202 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.074105 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.074202 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.074134 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa-cert\") pod \"ingress-canary-b7kqp\" (UID: \"ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa\") " pod="openshift-ingress-canary/ingress-canary-b7kqp" Jun 09 06:59:08.074360 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.074225 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27d1e129-2183-4926-8818-8e57fb66b135-tmp-dir\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.175050 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.174952 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27d1e129-2183-4926-8818-8e57fb66b135-tmp-dir\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.175050 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.175010 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwc6p\" (UniqueName: \"kubernetes.io/projected/ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa-kube-api-access-wwc6p\") pod \"ingress-canary-b7kqp\" (UID: \"ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa\") " pod="openshift-ingress-canary/ingress-canary-b7kqp" Jun 09 06:59:08.175269 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.175053 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvcnf\" (UniqueName: \"kubernetes.io/projected/27d1e129-2183-4926-8818-8e57fb66b135-kube-api-access-dvcnf\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.175269 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.175087 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27d1e129-2183-4926-8818-8e57fb66b135-config-volume\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.175269 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.175111 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.175269 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.175154 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa-cert\") pod \"ingress-canary-b7kqp\" (UID: \"ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa\") " pod="openshift-ingress-canary/ingress-canary-b7kqp" Jun 09 06:59:08.175269 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:08.175230 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:59:08.175495 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:08.175309 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls podName:27d1e129-2183-4926-8818-8e57fb66b135 nodeName:}" failed. No retries permitted until 2026-06-09 06:59:08.675288707 +0000 UTC m=+35.649944245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls") pod "dns-default-mzkvs" (UID: "27d1e129-2183-4926-8818-8e57fb66b135") : secret "dns-default-metrics-tls" not found Jun 09 06:59:08.175495 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.175353 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27d1e129-2183-4926-8818-8e57fb66b135-tmp-dir\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.175828 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.175805 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27d1e129-2183-4926-8818-8e57fb66b135-config-volume\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.180197 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.180174 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa-cert\") pod \"ingress-canary-b7kqp\" (UID: \"ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa\") " pod="openshift-ingress-canary/ingress-canary-b7kqp" Jun 09 06:59:08.187674 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.187650 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvcnf\" (UniqueName: \"kubernetes.io/projected/27d1e129-2183-4926-8818-8e57fb66b135-kube-api-access-dvcnf\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.187806 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.187755 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwc6p\" (UniqueName: \"kubernetes.io/projected/ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa-kube-api-access-wwc6p\") pod \"ingress-canary-b7kqp\" (UID: \"ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa\") " pod="openshift-ingress-canary/ingress-canary-b7kqp" Jun 09 06:59:08.297865 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.297817 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b7kqp" Jun 09 06:59:08.679369 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.679338 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:08.679532 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:08.679513 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:59:08.679591 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:08.679581 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls podName:27d1e129-2183-4926-8818-8e57fb66b135 nodeName:}" failed. No retries permitted until 2026-06-09 06:59:09.679565525 +0000 UTC m=+36.654221052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls") pod "dns-default-mzkvs" (UID: "27d1e129-2183-4926-8818-8e57fb66b135") : secret "dns-default-metrics-tls" not found Jun 09 06:59:08.709050 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:08.708119 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b7kqp"] Jun 09 06:59:08.711573 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:59:08.711547 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab32aba1_b670_4d72_9bc1_ba4ad66f9bfa.slice/crio-84ab9286a105c231e242907cfb7c53a03745a3d2b436ef09ad045587523e5618 WatchSource:0}: Error finding container 84ab9286a105c231e242907cfb7c53a03745a3d2b436ef09ad045587523e5618: Status 404 returned error can't find the container with id 84ab9286a105c231e242907cfb7c53a03745a3d2b436ef09ad045587523e5618 Jun 09 06:59:09.462885 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.462844 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:59:09.463360 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.462853 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:59:09.463360 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.462852 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:59:09.465936 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.465909 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 06:59:09.466067 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.465957 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 06:59:09.466067 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.466057 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 06:59:09.466981 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.466961 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-775hf\"" Jun 09 06:59:09.467118 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.467006 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 06:59:09.467327 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.467305 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mcng\"" Jun 09 06:59:09.645904 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.645862 2549 generic.go:356] "Generic (PLEG): container finished" podID="8257064f-cf68-45e7-b2b9-840f81301f5f" containerID="78fe7c690f6a4484f94b9631e537a8d404d2ca167eb872a81ab895d8818153f8" exitCode=0 Jun 09 06:59:09.646069 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.645908 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ktxwt" event={"ID":"8257064f-cf68-45e7-b2b9-840f81301f5f","Type":"ContainerDied","Data":"78fe7c690f6a4484f94b9631e537a8d404d2ca167eb872a81ab895d8818153f8"} Jun 09 06:59:09.647286 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.647262 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b7kqp" event={"ID":"ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa","Type":"ContainerStarted","Data":"84ab9286a105c231e242907cfb7c53a03745a3d2b436ef09ad045587523e5618"} Jun 09 06:59:09.687589 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:09.687349 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:09.687737 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:09.687549 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:59:09.687737 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:09.687716 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls podName:27d1e129-2183-4926-8818-8e57fb66b135 nodeName:}" failed. No retries permitted until 2026-06-09 06:59:11.687681952 +0000 UTC m=+38.662337478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls") pod "dns-default-mzkvs" (UID: "27d1e129-2183-4926-8818-8e57fb66b135") : secret "dns-default-metrics-tls" not found Jun 09 06:59:10.653234 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:10.653201 2549 generic.go:356] "Generic (PLEG): container finished" podID="8257064f-cf68-45e7-b2b9-840f81301f5f" containerID="dc048c0424284a399e5e8caad603698da3b22f3f2f809b248172a8ecc8e1ad4b" exitCode=0 Jun 09 06:59:10.653907 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:10.653291 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ktxwt" event={"ID":"8257064f-cf68-45e7-b2b9-840f81301f5f","Type":"ContainerDied","Data":"dc048c0424284a399e5e8caad603698da3b22f3f2f809b248172a8ecc8e1ad4b"} Jun 09 06:59:10.655051 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:10.654993 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b7kqp" event={"ID":"ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa","Type":"ContainerStarted","Data":"a780699c8407ded44d85ade3af00946e1a2efccc3b3010541285ca518895e042"} Jun 09 06:59:10.701525 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:10.701342 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b7kqp" podStartSLOduration=2.014295904 podStartE2EDuration="3.701317947s" totalImagesPullingTime="1.687022043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 06:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:59:10.700320541 +0000 UTC m=+37.674976085" watchObservedRunningTime="2026-06-09 06:59:10.701317947 +0000 UTC m=+37.675973489" Jun 09 06:59:11.661036 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:11.660986 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ktxwt" event={"ID":"8257064f-cf68-45e7-b2b9-840f81301f5f","Type":"ContainerStarted","Data":"d33a3b9813a74d40eae937498338f702a944888ccbba6f055411ed37bf290018"} Jun 09 06:59:11.683765 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:11.683707 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ktxwt" podStartSLOduration=9.246227049 podStartE2EDuration="38.683686217s" totalImagesPullingTime="29.437459168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:59:11.68206239 +0000 UTC m=+38.656717935" watchObservedRunningTime="2026-06-09 06:59:11.683686217 +0000 UTC m=+38.658341765" Jun 09 06:59:11.705381 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:11.705343 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:11.705663 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:11.705499 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:59:11.705663 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:11.705563 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls podName:27d1e129-2183-4926-8818-8e57fb66b135 nodeName:}" failed. No retries permitted until 2026-06-09 06:59:15.705547955 +0000 UTC m=+42.680203481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls") pod "dns-default-mzkvs" (UID: "27d1e129-2183-4926-8818-8e57fb66b135") : secret "dns-default-metrics-tls" not found Jun 09 06:59:15.734814 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:15.734755 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:15.735262 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:15.734886 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:59:15.735262 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:15.734943 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls podName:27d1e129-2183-4926-8818-8e57fb66b135 nodeName:}" failed. No retries permitted until 2026-06-09 06:59:23.734929553 +0000 UTC m=+50.709585075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls") pod "dns-default-mzkvs" (UID: "27d1e129-2183-4926-8818-8e57fb66b135") : secret "dns-default-metrics-tls" not found Jun 09 06:59:23.787008 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:23.786961 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:23.787501 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:23.787116 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:59:23.787501 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:23.787182 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls podName:27d1e129-2183-4926-8818-8e57fb66b135 nodeName:}" failed. No retries permitted until 2026-06-09 06:59:39.78716637 +0000 UTC m=+66.761821896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls") pod "dns-default-mzkvs" (UID: "27d1e129-2183-4926-8818-8e57fb66b135") : secret "dns-default-metrics-tls" not found Jun 09 06:59:33.639008 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:33.638971 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgkwk" Jun 09 06:59:39.285016 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.284971 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 06:59:39.285016 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.285022 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:59:39.287799 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.287764 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 06:59:39.287887 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.287764 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 06:59:39.296149 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:39.296123 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 06:59:39.296283 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:39.296223 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs podName:6ff5d471-42f5-46ff-84d5-e276685218dc nodeName:}" failed. No retries permitted until 2026-06-09 07:00:43.296199022 +0000 UTC m=+130.270854564 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs") pod "network-metrics-daemon-5gj2q" (UID: "6ff5d471-42f5-46ff-84d5-e276685218dc") : secret "metrics-daemon-secret" not found Jun 09 06:59:39.299400 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.299380 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ea3e7624-ebcf-4493-9398-81c50f78c960-original-pull-secret\") pod \"global-pull-secret-syncer-6plnd\" (UID: \"ea3e7624-ebcf-4493-9398-81c50f78c960\") " pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:59:39.386122 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.386084 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhk4p\" (UniqueName: \"kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p\") pod \"network-check-target-jrjc4\" (UID: \"c4e47478-19f8-49ee-9f8c-8e4aabb26dab\") " pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:59:39.388937 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.388916 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 06:59:39.399495 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.399465 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 06:59:39.409758 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.409729 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhk4p\" (UniqueName: \"kubernetes.io/projected/c4e47478-19f8-49ee-9f8c-8e4aabb26dab-kube-api-access-jhk4p\") pod \"network-check-target-jrjc4\" (UID: \"c4e47478-19f8-49ee-9f8c-8e4aabb26dab\") " pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:59:39.475643 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.475611 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6plnd" Jun 09 06:59:39.485049 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.485018 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mcng\"" Jun 09 06:59:39.493260 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.493234 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:59:39.611573 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.611497 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6plnd"] Jun 09 06:59:39.615907 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:59:39.615875 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3e7624_ebcf_4493_9398_81c50f78c960.slice/crio-964f5f37f3be1df6b7c2eded593ccb31b522971155cd453353e74c53f7db40a3 WatchSource:0}: Error finding container 964f5f37f3be1df6b7c2eded593ccb31b522971155cd453353e74c53f7db40a3: Status 404 returned error can't find the container with id 964f5f37f3be1df6b7c2eded593ccb31b522971155cd453353e74c53f7db40a3 Jun 09 06:59:39.631061 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.631033 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrjc4"] Jun 09 06:59:39.635129 ip-10-0-139-166 kubenswrapper[2549]: W0609 06:59:39.635106 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e47478_19f8_49ee_9f8c_8e4aabb26dab.slice/crio-1be9c1f52b1d20ac6177f58f5fe13d92e1aaf5ef2d25d3064ee892b1ac9e4860 WatchSource:0}: Error finding container 1be9c1f52b1d20ac6177f58f5fe13d92e1aaf5ef2d25d3064ee892b1ac9e4860: Status 404 returned error can't find the container with id 1be9c1f52b1d20ac6177f58f5fe13d92e1aaf5ef2d25d3064ee892b1ac9e4860 Jun 09 06:59:39.724757 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.724711 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrjc4" event={"ID":"c4e47478-19f8-49ee-9f8c-8e4aabb26dab","Type":"ContainerStarted","Data":"1be9c1f52b1d20ac6177f58f5fe13d92e1aaf5ef2d25d3064ee892b1ac9e4860"} Jun 09 06:59:39.725775 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.725752 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6plnd" event={"ID":"ea3e7624-ebcf-4493-9398-81c50f78c960","Type":"ContainerStarted","Data":"964f5f37f3be1df6b7c2eded593ccb31b522971155cd453353e74c53f7db40a3"} Jun 09 06:59:39.789551 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:39.789508 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 06:59:39.789718 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:39.789623 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:59:39.789718 ip-10-0-139-166 kubenswrapper[2549]: E0609 06:59:39.789689 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls podName:27d1e129-2183-4926-8818-8e57fb66b135 nodeName:}" failed. No retries permitted until 2026-06-09 07:00:11.789674825 +0000 UTC m=+98.764330347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls") pod "dns-default-mzkvs" (UID: "27d1e129-2183-4926-8818-8e57fb66b135") : secret "dns-default-metrics-tls" not found Jun 09 06:59:44.740092 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:44.740055 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrjc4" event={"ID":"c4e47478-19f8-49ee-9f8c-8e4aabb26dab","Type":"ContainerStarted","Data":"fbaa7815809206df62af93f91da9c0f253cc38aa89e8dc1f9f028a48d83c7945"} Jun 09 06:59:44.740541 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:44.740233 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 06:59:44.741522 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:44.741498 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6plnd" event={"ID":"ea3e7624-ebcf-4493-9398-81c50f78c960","Type":"ContainerStarted","Data":"c660346f18c70c9e42893bfb7898dad03727c4d7a177d5c498eae032afd2be36"} Jun 09 06:59:44.756290 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:44.756239 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jrjc4" podStartSLOduration=67.596037788 podStartE2EDuration="1m11.756224718s" totalImagesPullingTime="4.16018693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:59:44.755244058 +0000 UTC m=+71.729899604" watchObservedRunningTime="2026-06-09 06:59:44.756224718 +0000 UTC m=+71.730880262" Jun 09 06:59:44.768710 ip-10-0-139-166 kubenswrapper[2549]: I0609 06:59:44.768655 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6plnd" podStartSLOduration=67.586189699 podStartE2EDuration="1m11.768639952s" totalImagesPullingTime="4.182450253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:59:44.768143226 +0000 UTC m=+71.742798774" watchObservedRunningTime="2026-06-09 06:59:44.768639952 +0000 UTC m=+71.743295496" Jun 09 07:00:11.811173 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:00:11.811082 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 07:00:11.811587 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:00:11.811202 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:00:11.811587 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:00:11.811261 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls podName:27d1e129-2183-4926-8818-8e57fb66b135 nodeName:}" failed. No retries permitted until 2026-06-09 07:01:15.811249046 +0000 UTC m=+162.785904569 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls") pod "dns-default-mzkvs" (UID: "27d1e129-2183-4926-8818-8e57fb66b135") : secret "dns-default-metrics-tls" not found Jun 09 07:00:15.746562 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:00:15.746529 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jrjc4" Jun 09 07:00:43.320857 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:00:43.320814 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 07:00:43.321355 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:00:43.320960 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 07:00:43.321355 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:00:43.321026 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs podName:6ff5d471-42f5-46ff-84d5-e276685218dc nodeName:}" failed. No retries permitted until 2026-06-09 07:02:45.321009399 +0000 UTC m=+252.295664930 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs") pod "network-metrics-daemon-5gj2q" (UID: "6ff5d471-42f5-46ff-84d5-e276685218dc") : secret "metrics-daemon-secret" not found Jun 09 07:01:10.983389 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:10.983337 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mzkvs" podUID="27d1e129-2183-4926-8818-8e57fb66b135" Jun 09 07:01:11.943628 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:11.943597 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mzkvs" Jun 09 07:01:12.487668 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:12.487620 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5gj2q" podUID="6ff5d471-42f5-46ff-84d5-e276685218dc" Jun 09 07:01:15.838258 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:15.838216 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 07:01:15.838653 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:15.838341 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:01:15.838653 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:15.838420 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls podName:27d1e129-2183-4926-8818-8e57fb66b135 nodeName:}" failed. No retries permitted until 2026-06-09 07:03:17.838396548 +0000 UTC m=+284.813052072 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls") pod "dns-default-mzkvs" (UID: "27d1e129-2183-4926-8818-8e57fb66b135") : secret "dns-default-metrics-tls" not found Jun 09 07:01:26.462061 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:26.462021 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 07:01:49.393974 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.393941 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6"] Jun 09 07:01:49.397696 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.397575 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" Jun 09 07:01:49.400369 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.400344 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 07:01:49.401292 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.401256 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 07:01:49.401419 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.401304 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6fjjm\"" Jun 09 07:01:49.401419 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.401314 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 07:01:49.401962 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.401941 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 07:01:49.409981 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.409957 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-88b5485f-jhcx6"] Jun 09 07:01:49.412017 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.412002 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.424167 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.424141 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 07:01:49.424277 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.424263 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zjr8h\"" Jun 09 07:01:49.425637 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.425621 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 07:01:49.425741 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.425725 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 07:01:49.431189 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.431148 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 07:01:49.432202 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.432180 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6"] Jun 09 07:01:49.445539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.445508 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88b5485f-jhcx6"] Jun 09 07:01:49.472918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.472889 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-bound-sa-token\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.472918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.472921 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.473142 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.472946 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s84bm\" (UniqueName: \"kubernetes.io/projected/c338b8e4-252b-4e2d-914a-1914664f7a3b-kube-api-access-s84bm\") pod \"service-ca-operator-6bc5ff68f5-pjrd6\" (UID: \"c338b8e4-252b-4e2d-914a-1914664f7a3b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" Jun 09 07:01:49.473142 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.472962 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-certificates\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.473142 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.472984 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e55dde-097a-4c1d-b351-6c4cb30e27ac-ca-trust-extracted\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.473142 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.472998 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-trusted-ca\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.473142 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.473013 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-installation-pull-secrets\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.473142 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.473048 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c338b8e4-252b-4e2d-914a-1914664f7a3b-config\") pod \"service-ca-operator-6bc5ff68f5-pjrd6\" (UID: \"c338b8e4-252b-4e2d-914a-1914664f7a3b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" Jun 09 07:01:49.473142 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.473063 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-image-registry-private-configuration\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.473142 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.473090 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c338b8e4-252b-4e2d-914a-1914664f7a3b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-pjrd6\" (UID: \"c338b8e4-252b-4e2d-914a-1914664f7a3b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" Jun 09 07:01:49.473142 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.473115 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtpdw\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-kube-api-access-wtpdw\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.508289 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.508257 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bn5rv"] Jun 09 07:01:49.510404 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.510376 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-6z6kw"] Jun 09 07:01:49.510568 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.510556 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bn5rv" Jun 09 07:01:49.512345 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.512326 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm"] Jun 09 07:01:49.512474 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.512457 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.513408 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.513390 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hmwhb\"" Jun 09 07:01:49.514220 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.514206 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:49.517565 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.517543 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 07:01:49.517674 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.517644 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 07:01:49.518090 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.518068 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-llrpt\"" Jun 09 07:01:49.518319 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.518302 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 07:01:49.518319 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.518316 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 07:01:49.519322 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.519303 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 07:01:49.519410 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.519329 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 07:01:49.519410 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.519344 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 07:01:49.519410 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.519351 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 07:01:49.519410 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.519371 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dpqdr\"" Jun 09 07:01:49.524297 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.524224 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 07:01:49.525128 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.525109 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bn5rv"] Jun 09 07:01:49.532459 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.532438 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-6z6kw"] Jun 09 07:01:49.533206 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.533185 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm"] Jun 09 07:01:49.574209 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574170 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv9c4\" (UniqueName: \"kubernetes.io/projected/8fa1142e-e2be-4c80-a52e-9a0dcbdf39a5-kube-api-access-dv9c4\") pod \"network-check-source-dbd9cf844-bn5rv\" (UID: \"8fa1142e-e2be-4c80-a52e-9a0dcbdf39a5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bn5rv" Jun 09 07:01:49.574209 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574206 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-bound-sa-token\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.574447 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574228 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.574447 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574283 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e55dde-097a-4c1d-b351-6c4cb30e27ac-ca-trust-extracted\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.574447 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:49.574315 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:01:49.574447 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:49.574326 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b5485f-jhcx6: secret "image-registry-tls" not found Jun 09 07:01:49.574447 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574324 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-installation-pull-secrets\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.574447 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574355 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093db7d2-34f9-4e0f-8654-9b89613f0777-trusted-ca-bundle\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.574447 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:49.574375 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls podName:74e55dde-097a-4c1d-b351-6c4cb30e27ac nodeName:}" failed. No retries permitted until 2026-06-09 07:01:50.074359102 +0000 UTC m=+197.049014625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls") pod "image-registry-88b5485f-jhcx6" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac") : secret "image-registry-tls" not found Jun 09 07:01:49.574809 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574478 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-image-registry-private-configuration\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.574809 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574526 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c338b8e4-252b-4e2d-914a-1914664f7a3b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-pjrd6\" (UID: \"c338b8e4-252b-4e2d-914a-1914664f7a3b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" Jun 09 07:01:49.574809 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574584 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:49.574809 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574625 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s84bm\" (UniqueName: \"kubernetes.io/projected/c338b8e4-252b-4e2d-914a-1914664f7a3b-kube-api-access-s84bm\") pod \"service-ca-operator-6bc5ff68f5-pjrd6\" (UID: \"c338b8e4-252b-4e2d-914a-1914664f7a3b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" Jun 09 07:01:49.574809 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574655 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-certificates\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.574809 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574681 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/093db7d2-34f9-4e0f-8654-9b89613f0777-tmp\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.574809 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574705 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093db7d2-34f9-4e0f-8654-9b89613f0777-service-ca-bundle\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.574809 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574730 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrp2p\" (UniqueName: \"kubernetes.io/projected/093db7d2-34f9-4e0f-8654-9b89613f0777-kube-api-access-xrp2p\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.574809 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574732 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e55dde-097a-4c1d-b351-6c4cb30e27ac-ca-trust-extracted\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.574809 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574759 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74f83c3b-7e60-4a98-99c5-2566ad7e8134-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:49.575287 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574824 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-trusted-ca\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.575287 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574855 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/093db7d2-34f9-4e0f-8654-9b89613f0777-serving-cert\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.575287 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574878 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cfmk\" (UniqueName: \"kubernetes.io/projected/74f83c3b-7e60-4a98-99c5-2566ad7e8134-kube-api-access-2cfmk\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:49.575287 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.574989 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c338b8e4-252b-4e2d-914a-1914664f7a3b-config\") pod \"service-ca-operator-6bc5ff68f5-pjrd6\" (UID: \"c338b8e4-252b-4e2d-914a-1914664f7a3b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" Jun 09 07:01:49.575287 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.575027 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtpdw\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-kube-api-access-wtpdw\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.575287 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.575054 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/093db7d2-34f9-4e0f-8654-9b89613f0777-snapshots\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.575287 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.575246 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-certificates\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.575646 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.575618 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c338b8e4-252b-4e2d-914a-1914664f7a3b-config\") pod \"service-ca-operator-6bc5ff68f5-pjrd6\" (UID: \"c338b8e4-252b-4e2d-914a-1914664f7a3b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" Jun 09 07:01:49.575817 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.575780 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-trusted-ca\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.576907 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.576884 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c338b8e4-252b-4e2d-914a-1914664f7a3b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-pjrd6\" (UID: \"c338b8e4-252b-4e2d-914a-1914664f7a3b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" Jun 09 07:01:49.577037 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.577022 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-installation-pull-secrets\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.577130 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.577108 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-image-registry-private-configuration\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.591938 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.587894 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-bound-sa-token\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.591938 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.590550 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtpdw\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-kube-api-access-wtpdw\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:49.593502 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.593461 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s84bm\" (UniqueName: \"kubernetes.io/projected/c338b8e4-252b-4e2d-914a-1914664f7a3b-kube-api-access-s84bm\") pod \"service-ca-operator-6bc5ff68f5-pjrd6\" (UID: \"c338b8e4-252b-4e2d-914a-1914664f7a3b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" Jun 09 07:01:49.594354 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.594327 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvq5s"] Jun 09 07:01:49.597514 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.597494 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvq5s" Jun 09 07:01:49.600131 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.600111 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qrf5b\"" Jun 09 07:01:49.600250 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.600155 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 07:01:49.600250 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.600241 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 07:01:49.606801 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.606763 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvq5s"] Jun 09 07:01:49.675893 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.675854 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:49.676082 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.675903 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/093db7d2-34f9-4e0f-8654-9b89613f0777-tmp\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.676082 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.675923 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093db7d2-34f9-4e0f-8654-9b89613f0777-service-ca-bundle\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.676082 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.675939 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrp2p\" (UniqueName: \"kubernetes.io/projected/093db7d2-34f9-4e0f-8654-9b89613f0777-kube-api-access-xrp2p\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.676082 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:49.676019 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 07:01:49.676082 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.676059 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74f83c3b-7e60-4a98-99c5-2566ad7e8134-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:49.676350 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:49.676091 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls podName:74f83c3b-7e60-4a98-99c5-2566ad7e8134 nodeName:}" failed. No retries permitted until 2026-06-09 07:01:50.176069899 +0000 UTC m=+197.150725423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-nb6tm" (UID: "74f83c3b-7e60-4a98-99c5-2566ad7e8134") : secret "cluster-monitoring-operator-tls" not found Jun 09 07:01:49.676350 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.676132 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/093db7d2-34f9-4e0f-8654-9b89613f0777-serving-cert\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.676350 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.676163 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cfmk\" (UniqueName: \"kubernetes.io/projected/74f83c3b-7e60-4a98-99c5-2566ad7e8134-kube-api-access-2cfmk\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:49.676350 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.676197 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/093db7d2-34f9-4e0f-8654-9b89613f0777-snapshots\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.676350 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.676229 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv9c4\" (UniqueName: \"kubernetes.io/projected/8fa1142e-e2be-4c80-a52e-9a0dcbdf39a5-kube-api-access-dv9c4\") pod \"network-check-source-dbd9cf844-bn5rv\" (UID: \"8fa1142e-e2be-4c80-a52e-9a0dcbdf39a5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bn5rv" Jun 09 07:01:49.676350 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.676284 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kmsq\" (UniqueName: \"kubernetes.io/projected/06451910-e51a-4b1e-a22c-21f8ba4c1997-kube-api-access-8kmsq\") pod \"volume-data-source-validator-78dd696465-wvq5s\" (UID: \"06451910-e51a-4b1e-a22c-21f8ba4c1997\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvq5s" Jun 09 07:01:49.676350 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.676320 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093db7d2-34f9-4e0f-8654-9b89613f0777-trusted-ca-bundle\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.676668 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.676639 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/093db7d2-34f9-4e0f-8654-9b89613f0777-tmp\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.676856 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.676830 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74f83c3b-7e60-4a98-99c5-2566ad7e8134-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:49.676950 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.676901 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/093db7d2-34f9-4e0f-8654-9b89613f0777-snapshots\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.677021 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.677001 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093db7d2-34f9-4e0f-8654-9b89613f0777-service-ca-bundle\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.677180 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.677162 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/093db7d2-34f9-4e0f-8654-9b89613f0777-trusted-ca-bundle\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.678450 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.678433 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/093db7d2-34f9-4e0f-8654-9b89613f0777-serving-cert\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.691178 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.691145 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrp2p\" (UniqueName: \"kubernetes.io/projected/093db7d2-34f9-4e0f-8654-9b89613f0777-kube-api-access-xrp2p\") pod \"insights-operator-896549976-6z6kw\" (UID: \"093db7d2-34f9-4e0f-8654-9b89613f0777\") " pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.691301 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.691147 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cfmk\" (UniqueName: \"kubernetes.io/projected/74f83c3b-7e60-4a98-99c5-2566ad7e8134-kube-api-access-2cfmk\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:49.692326 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.692306 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv9c4\" (UniqueName: \"kubernetes.io/projected/8fa1142e-e2be-4c80-a52e-9a0dcbdf39a5-kube-api-access-dv9c4\") pod \"network-check-source-dbd9cf844-bn5rv\" (UID: \"8fa1142e-e2be-4c80-a52e-9a0dcbdf39a5\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bn5rv" Jun 09 07:01:49.707180 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.707140 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" Jun 09 07:01:49.777427 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.777398 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kmsq\" (UniqueName: \"kubernetes.io/projected/06451910-e51a-4b1e-a22c-21f8ba4c1997-kube-api-access-8kmsq\") pod \"volume-data-source-validator-78dd696465-wvq5s\" (UID: \"06451910-e51a-4b1e-a22c-21f8ba4c1997\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvq5s" Jun 09 07:01:49.788948 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.788921 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kmsq\" (UniqueName: \"kubernetes.io/projected/06451910-e51a-4b1e-a22c-21f8ba4c1997-kube-api-access-8kmsq\") pod \"volume-data-source-validator-78dd696465-wvq5s\" (UID: \"06451910-e51a-4b1e-a22c-21f8ba4c1997\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvq5s" Jun 09 07:01:49.820668 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.820625 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bn5rv" Jun 09 07:01:49.827379 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.827354 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-6z6kw" Jun 09 07:01:49.832584 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.832560 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6"] Jun 09 07:01:49.836045 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:01:49.836017 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc338b8e4_252b_4e2d_914a_1914664f7a3b.slice/crio-a143e573dff339b672dd7857d5f8ace0ca55843a4557e1920213004b6ff34a55 WatchSource:0}: Error finding container a143e573dff339b672dd7857d5f8ace0ca55843a4557e1920213004b6ff34a55: Status 404 returned error can't find the container with id a143e573dff339b672dd7857d5f8ace0ca55843a4557e1920213004b6ff34a55 Jun 09 07:01:49.907022 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.906981 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvq5s" Jun 09 07:01:49.964106 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.963948 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bn5rv"] Jun 09 07:01:49.976555 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:49.976441 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-6z6kw"] Jun 09 07:01:49.981152 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:01:49.981127 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093db7d2_34f9_4e0f_8654_9b89613f0777.slice/crio-2a233abaa2b594574fd55ab2e589480faccb8845b25d89484b100660376cca01 WatchSource:0}: Error finding container 2a233abaa2b594574fd55ab2e589480faccb8845b25d89484b100660376cca01: Status 404 returned error can't find the container with id 2a233abaa2b594574fd55ab2e589480faccb8845b25d89484b100660376cca01 Jun 09 07:01:50.034874 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:50.034829 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" event={"ID":"c338b8e4-252b-4e2d-914a-1914664f7a3b","Type":"ContainerStarted","Data":"a143e573dff339b672dd7857d5f8ace0ca55843a4557e1920213004b6ff34a55"} Jun 09 07:01:50.036302 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:50.036271 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6z6kw" event={"ID":"093db7d2-34f9-4e0f-8654-9b89613f0777","Type":"ContainerStarted","Data":"2a233abaa2b594574fd55ab2e589480faccb8845b25d89484b100660376cca01"} Jun 09 07:01:50.037852 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:50.037825 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bn5rv" event={"ID":"8fa1142e-e2be-4c80-a52e-9a0dcbdf39a5","Type":"ContainerStarted","Data":"c2668151dfd8f3c27208b18349abe6059ca992e6c71e9d119d95067a6d33bc62"} Jun 09 07:01:50.037945 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:50.037872 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bn5rv" event={"ID":"8fa1142e-e2be-4c80-a52e-9a0dcbdf39a5","Type":"ContainerStarted","Data":"5252427b6bf14ca0331c50ec2f2215695742a6a68a7019e411c47cfa59333892"} Jun 09 07:01:50.051027 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:50.050980 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvq5s"] Jun 09 07:01:50.053807 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:01:50.053737 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06451910_e51a_4b1e_a22c_21f8ba4c1997.slice/crio-7393dc5ece80dfbfd649c989d4ae63814d3929d932867d009d9eaf9bea93811b WatchSource:0}: Error finding container 7393dc5ece80dfbfd649c989d4ae63814d3929d932867d009d9eaf9bea93811b: Status 404 returned error can't find the container with id 7393dc5ece80dfbfd649c989d4ae63814d3929d932867d009d9eaf9bea93811b Jun 09 07:01:50.079587 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:50.079542 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:50.079741 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:50.079718 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:01:50.079741 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:50.079736 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b5485f-jhcx6: secret "image-registry-tls" not found Jun 09 07:01:50.079871 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:50.079809 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls podName:74e55dde-097a-4c1d-b351-6c4cb30e27ac nodeName:}" failed. No retries permitted until 2026-06-09 07:01:51.079772912 +0000 UTC m=+198.054428440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls") pod "image-registry-88b5485f-jhcx6" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac") : secret "image-registry-tls" not found Jun 09 07:01:50.180354 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:50.180317 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:50.180521 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:50.180418 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 07:01:50.180521 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:50.180472 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls podName:74f83c3b-7e60-4a98-99c5-2566ad7e8134 nodeName:}" failed. No retries permitted until 2026-06-09 07:01:51.180458903 +0000 UTC m=+198.155114428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-nb6tm" (UID: "74f83c3b-7e60-4a98-99c5-2566ad7e8134") : secret "cluster-monitoring-operator-tls" not found Jun 09 07:01:51.042860 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:51.042818 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvq5s" event={"ID":"06451910-e51a-4b1e-a22c-21f8ba4c1997","Type":"ContainerStarted","Data":"7393dc5ece80dfbfd649c989d4ae63814d3929d932867d009d9eaf9bea93811b"} Jun 09 07:01:51.087928 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:51.087840 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:51.088112 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:51.088051 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:01:51.088112 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:51.088068 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b5485f-jhcx6: secret "image-registry-tls" not found Jun 09 07:01:51.088221 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:51.088122 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls podName:74e55dde-097a-4c1d-b351-6c4cb30e27ac nodeName:}" failed. No retries permitted until 2026-06-09 07:01:53.088105774 +0000 UTC m=+200.062761302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls") pod "image-registry-88b5485f-jhcx6" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac") : secret "image-registry-tls" not found Jun 09 07:01:51.189011 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:51.188968 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:51.189213 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:51.189122 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 07:01:51.189213 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:51.189208 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls podName:74f83c3b-7e60-4a98-99c5-2566ad7e8134 nodeName:}" failed. No retries permitted until 2026-06-09 07:01:53.189185776 +0000 UTC m=+200.163841317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-nb6tm" (UID: "74f83c3b-7e60-4a98-99c5-2566ad7e8134") : secret "cluster-monitoring-operator-tls" not found Jun 09 07:01:52.046952 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:52.046915 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvq5s" event={"ID":"06451910-e51a-4b1e-a22c-21f8ba4c1997","Type":"ContainerStarted","Data":"4ac5880337e673281f116b629a241afa69aaf1aa7789ba55cf48d3af270508e4"} Jun 09 07:01:52.062477 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:52.062425 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bn5rv" podStartSLOduration=3.062406904 podStartE2EDuration="3.062406904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:01:50.057978126 +0000 UTC m=+197.032633673" watchObservedRunningTime="2026-06-09 07:01:52.062406904 +0000 UTC m=+199.037062427" Jun 09 07:01:52.062670 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:52.062505 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-wvq5s" podStartSLOduration=1.770044647 podStartE2EDuration="3.062499252s" totalImagesPullingTime="1.292454605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:01:52.061717012 +0000 UTC m=+199.036372563" watchObservedRunningTime="2026-06-09 07:01:52.062499252 +0000 UTC m=+199.037154811" Jun 09 07:01:53.056232 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:53.056190 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" event={"ID":"c338b8e4-252b-4e2d-914a-1914664f7a3b","Type":"ContainerStarted","Data":"9a64bfacf091f85277742a9933ceb0c17c9a4eab0794847f89e828cfce07c21d"} Jun 09 07:01:53.057810 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:53.057775 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6z6kw" event={"ID":"093db7d2-34f9-4e0f-8654-9b89613f0777","Type":"ContainerStarted","Data":"8e51daefaacc4361da8f5644785dfb0d8f9c7e878425701ff96ef80a866bfd05"} Jun 09 07:01:53.072365 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:53.072316 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" podStartSLOduration=1.429757814 podStartE2EDuration="4.072300249s" totalImagesPullingTime="2.642542435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:01:53.070976552 +0000 UTC m=+200.045632097" watchObservedRunningTime="2026-06-09 07:01:53.072300249 +0000 UTC m=+200.046955793" Jun 09 07:01:53.089072 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:53.089011 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-6z6kw" podStartSLOduration=1.591396947 podStartE2EDuration="4.088995929s" totalImagesPullingTime="2.497598982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:01:53.088414066 +0000 UTC m=+200.063069612" watchObservedRunningTime="2026-06-09 07:01:53.088995929 +0000 UTC m=+200.063651475" Jun 09 07:01:53.108519 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:53.108465 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:53.108721 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:53.108652 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:01:53.108721 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:53.108686 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b5485f-jhcx6: secret "image-registry-tls" not found Jun 09 07:01:53.108848 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:53.108761 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls podName:74e55dde-097a-4c1d-b351-6c4cb30e27ac nodeName:}" failed. No retries permitted until 2026-06-09 07:01:57.108739817 +0000 UTC m=+204.083395340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls") pod "image-registry-88b5485f-jhcx6" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac") : secret "image-registry-tls" not found Jun 09 07:01:53.210117 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:53.210069 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:53.210327 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:53.210211 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 07:01:53.210327 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:53.210288 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls podName:74f83c3b-7e60-4a98-99c5-2566ad7e8134 nodeName:}" failed. No retries permitted until 2026-06-09 07:01:57.210273092 +0000 UTC m=+204.184928615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-nb6tm" (UID: "74f83c3b-7e60-4a98-99c5-2566ad7e8134") : secret "cluster-monitoring-operator-tls" not found Jun 09 07:01:54.246642 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:54.246608 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t"] Jun 09 07:01:54.248831 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:54.248813 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t" Jun 09 07:01:54.251370 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:54.251341 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 07:01:54.252364 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:54.252347 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wpvq5\"" Jun 09 07:01:54.252364 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:54.252357 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 07:01:54.261477 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:54.261457 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t"] Jun 09 07:01:54.320474 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:54.320437 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwxqp\" (UniqueName: \"kubernetes.io/projected/585c6571-f48c-4217-b902-4727dc1422ce-kube-api-access-nwxqp\") pod \"migrator-955ffdf5f-hxr2t\" (UID: \"585c6571-f48c-4217-b902-4727dc1422ce\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t" Jun 09 07:01:54.421383 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:54.421339 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwxqp\" (UniqueName: \"kubernetes.io/projected/585c6571-f48c-4217-b902-4727dc1422ce-kube-api-access-nwxqp\") pod \"migrator-955ffdf5f-hxr2t\" (UID: \"585c6571-f48c-4217-b902-4727dc1422ce\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t" Jun 09 07:01:54.429782 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:54.429756 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwxqp\" (UniqueName: \"kubernetes.io/projected/585c6571-f48c-4217-b902-4727dc1422ce-kube-api-access-nwxqp\") pod \"migrator-955ffdf5f-hxr2t\" (UID: \"585c6571-f48c-4217-b902-4727dc1422ce\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t" Jun 09 07:01:54.559457 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:54.559379 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t" Jun 09 07:01:54.687795 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:54.687760 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t"] Jun 09 07:01:54.690982 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:01:54.690949 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585c6571_f48c_4217_b902_4727dc1422ce.slice/crio-c31430801380cee94cc34874fd525a13702b1cd8644977f57ecf4f5f83671d4b WatchSource:0}: Error finding container c31430801380cee94cc34874fd525a13702b1cd8644977f57ecf4f5f83671d4b: Status 404 returned error can't find the container with id c31430801380cee94cc34874fd525a13702b1cd8644977f57ecf4f5f83671d4b Jun 09 07:01:55.064782 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:55.064750 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t" event={"ID":"585c6571-f48c-4217-b902-4727dc1422ce","Type":"ContainerStarted","Data":"c31430801380cee94cc34874fd525a13702b1cd8644977f57ecf4f5f83671d4b"} Jun 09 07:01:55.159371 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:55.159341 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qrvxd_9980c63f-e2a5-40ff-a193-80276600e53e/dns-node-resolver/0.log" Jun 09 07:01:56.069617 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:56.069582 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t" event={"ID":"585c6571-f48c-4217-b902-4727dc1422ce","Type":"ContainerStarted","Data":"8fab7a44dfb7a092dfce42bcbfb97530fcbe7db5860eb52b5f681d017d72eaad"} Jun 09 07:01:56.070017 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:56.069640 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t" event={"ID":"585c6571-f48c-4217-b902-4727dc1422ce","Type":"ContainerStarted","Data":"5650a3c5508726ef4ba7ab8398aa43f7a2f165c75a5bf8edfa61cc7cc62f9bb2"} Jun 09 07:01:56.086112 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:56.086014 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-hxr2t" podStartSLOduration=0.947106409 podStartE2EDuration="2.085996654s" totalImagesPullingTime="1.138890245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:01:56.085958758 +0000 UTC m=+203.060614303" watchObservedRunningTime="2026-06-09 07:01:56.085996654 +0000 UTC m=+203.060652200" Jun 09 07:01:56.155346 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:56.155322 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ck9kl_ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57/node-ca/0.log" Jun 09 07:01:57.143684 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:57.143641 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:01:57.144124 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:57.143774 2549 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:01:57.144124 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:57.143810 2549 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-88b5485f-jhcx6: secret "image-registry-tls" not found Jun 09 07:01:57.144124 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:57.143914 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls podName:74e55dde-097a-4c1d-b351-6c4cb30e27ac nodeName:}" failed. No retries permitted until 2026-06-09 07:02:05.143889466 +0000 UTC m=+212.118544989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls") pod "image-registry-88b5485f-jhcx6" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac") : secret "image-registry-tls" not found Jun 09 07:01:57.155236 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:57.155211 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b7kqp_ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa/serve-healthcheck-canary/0.log" Jun 09 07:01:57.244722 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:01:57.244676 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:01:57.244915 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:57.244839 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 07:01:57.244915 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:01:57.244912 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls podName:74f83c3b-7e60-4a98-99c5-2566ad7e8134 nodeName:}" failed. No retries permitted until 2026-06-09 07:02:05.244896617 +0000 UTC m=+212.219552140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-nb6tm" (UID: "74f83c3b-7e60-4a98-99c5-2566ad7e8134") : secret "cluster-monitoring-operator-tls" not found Jun 09 07:02:05.206925 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:05.206868 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:02:05.209247 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:05.209221 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls\") pod \"image-registry-88b5485f-jhcx6\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:02:05.307459 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:05.307411 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:02:05.307639 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:02:05.307561 2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 07:02:05.307639 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:02:05.307627 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls podName:74f83c3b-7e60-4a98-99c5-2566ad7e8134 nodeName:}" failed. No retries permitted until 2026-06-09 07:02:21.307609565 +0000 UTC m=+228.282265101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-nb6tm" (UID: "74f83c3b-7e60-4a98-99c5-2566ad7e8134") : secret "cluster-monitoring-operator-tls" not found Jun 09 07:02:05.319641 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:05.319610 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:02:05.453212 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:05.453180 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-88b5485f-jhcx6"] Jun 09 07:02:05.456213 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:02:05.456180 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e55dde_097a_4c1d_b351_6c4cb30e27ac.slice/crio-bafa7241a292eb485b9bb7a423556468464e082bb832e4d26f862e615de798f6 WatchSource:0}: Error finding container bafa7241a292eb485b9bb7a423556468464e082bb832e4d26f862e615de798f6: Status 404 returned error can't find the container with id bafa7241a292eb485b9bb7a423556468464e082bb832e4d26f862e615de798f6 Jun 09 07:02:06.102146 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:06.102106 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" event={"ID":"74e55dde-097a-4c1d-b351-6c4cb30e27ac","Type":"ContainerStarted","Data":"c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98"} Jun 09 07:02:06.102338 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:06.102161 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" event={"ID":"74e55dde-097a-4c1d-b351-6c4cb30e27ac","Type":"ContainerStarted","Data":"bafa7241a292eb485b9bb7a423556468464e082bb832e4d26f862e615de798f6"} Jun 09 07:02:06.102338 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:06.102198 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:02:06.122676 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:06.122624 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" podStartSLOduration=17.122604067 podStartE2EDuration="17.122604067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:06.121455981 +0000 UTC m=+213.096111526" watchObservedRunningTime="2026-06-09 07:02:06.122604067 +0000 UTC m=+213.097259613" Jun 09 07:02:19.543446 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.543413 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-thhfw"] Jun 09 07:02:19.546834 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.546816 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.557176 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.552555 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l9q29\"" Jun 09 07:02:19.557176 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.552578 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 07:02:19.557176 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.553734 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 07:02:19.584120 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.584078 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-thhfw"] Jun 09 07:02:19.613625 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.613584 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0460ca1-c50b-4cbe-b28e-25a10e446678-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.613830 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.613674 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0460ca1-c50b-4cbe-b28e-25a10e446678-crio-socket\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.613830 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.613716 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf2sq\" (UniqueName: \"kubernetes.io/projected/e0460ca1-c50b-4cbe-b28e-25a10e446678-kube-api-access-jf2sq\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.613830 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.613761 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0460ca1-c50b-4cbe-b28e-25a10e446678-data-volume\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.613830 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.613809 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0460ca1-c50b-4cbe-b28e-25a10e446678-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.675727 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.675693 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-88b5485f-jhcx6"] Jun 09 07:02:19.714656 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.714623 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0460ca1-c50b-4cbe-b28e-25a10e446678-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.714871 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.714668 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0460ca1-c50b-4cbe-b28e-25a10e446678-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.714871 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.714726 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0460ca1-c50b-4cbe-b28e-25a10e446678-crio-socket\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.714871 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.714751 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf2sq\" (UniqueName: \"kubernetes.io/projected/e0460ca1-c50b-4cbe-b28e-25a10e446678-kube-api-access-jf2sq\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.714871 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.714806 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0460ca1-c50b-4cbe-b28e-25a10e446678-data-volume\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.715092 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.714865 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0460ca1-c50b-4cbe-b28e-25a10e446678-crio-socket\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.715092 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.715079 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0460ca1-c50b-4cbe-b28e-25a10e446678-data-volume\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.715211 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.715189 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0460ca1-c50b-4cbe-b28e-25a10e446678-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.717331 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.717303 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0460ca1-c50b-4cbe-b28e-25a10e446678-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.735101 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.735062 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf2sq\" (UniqueName: \"kubernetes.io/projected/e0460ca1-c50b-4cbe-b28e-25a10e446678-kube-api-access-jf2sq\") pod \"insights-runtime-extractor-thhfw\" (UID: \"e0460ca1-c50b-4cbe-b28e-25a10e446678\") " pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.857850 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.857737 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-thhfw" Jun 09 07:02:19.987605 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:19.987571 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-thhfw"] Jun 09 07:02:19.990888 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:02:19.990862 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0460ca1_c50b_4cbe_b28e_25a10e446678.slice/crio-068d002d9249af60332216337be23443423b81ae517e4923b3a4be0ff8ff470c WatchSource:0}: Error finding container 068d002d9249af60332216337be23443423b81ae517e4923b3a4be0ff8ff470c: Status 404 returned error can't find the container with id 068d002d9249af60332216337be23443423b81ae517e4923b3a4be0ff8ff470c Jun 09 07:02:20.146696 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:20.146663 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-thhfw" event={"ID":"e0460ca1-c50b-4cbe-b28e-25a10e446678","Type":"ContainerStarted","Data":"70be99e6f46c80e2a88e563c93c8b6c7f0151f34ff83c6b8f8b6a751b46fc0cd"} Jun 09 07:02:20.146890 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:20.146718 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-thhfw" event={"ID":"e0460ca1-c50b-4cbe-b28e-25a10e446678","Type":"ContainerStarted","Data":"068d002d9249af60332216337be23443423b81ae517e4923b3a4be0ff8ff470c"} Jun 09 07:02:21.153069 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:21.153033 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-thhfw" event={"ID":"e0460ca1-c50b-4cbe-b28e-25a10e446678","Type":"ContainerStarted","Data":"66ba0cfc98889595da2285daa07a93309fad1aa6123efcbed7af1e1d29def081"} Jun 09 07:02:21.329470 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:21.329430 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:02:21.332129 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:21.332101 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74f83c3b-7e60-4a98-99c5-2566ad7e8134-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-nb6tm\" (UID: \"74f83c3b-7e60-4a98-99c5-2566ad7e8134\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:02:21.333917 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:21.333885 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" Jun 09 07:02:21.472108 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:21.472077 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm"] Jun 09 07:02:21.476046 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:02:21.476014 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f83c3b_7e60_4a98_99c5_2566ad7e8134.slice/crio-514f4f252507400a04ac4e68357b0557330c9daad9ed5893dbd1f44853379a89 WatchSource:0}: Error finding container 514f4f252507400a04ac4e68357b0557330c9daad9ed5893dbd1f44853379a89: Status 404 returned error can't find the container with id 514f4f252507400a04ac4e68357b0557330c9daad9ed5893dbd1f44853379a89 Jun 09 07:02:22.158203 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:22.158177 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" event={"ID":"74f83c3b-7e60-4a98-99c5-2566ad7e8134","Type":"ContainerStarted","Data":"514f4f252507400a04ac4e68357b0557330c9daad9ed5893dbd1f44853379a89"} Jun 09 07:02:23.164071 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:23.164034 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-thhfw" event={"ID":"e0460ca1-c50b-4cbe-b28e-25a10e446678","Type":"ContainerStarted","Data":"5d55733e046e08d52873296c6e95974294b89d7476a3bc63a0be2694e9a9a740"} Jun 09 07:02:23.182956 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:23.182892 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-thhfw" podStartSLOduration=2.143446783 podStartE2EDuration="4.182870747s" totalImagesPullingTime="2.039423964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:02:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:23.180805663 +0000 UTC m=+230.155461208" watchObservedRunningTime="2026-06-09 07:02:23.182870747 +0000 UTC m=+230.157526289" Jun 09 07:02:24.169500 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:24.169459 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" event={"ID":"74f83c3b-7e60-4a98-99c5-2566ad7e8134","Type":"ContainerStarted","Data":"d80f67368629ce3be986caa6f08d0cd94c7e7ac87b8149a36f70204b881d5af7"} Jun 09 07:02:24.184947 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:24.184884 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-nb6tm" podStartSLOduration=32.660402509 podStartE2EDuration="35.184864907s" totalImagesPullingTime="2.524462398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:24.184730856 +0000 UTC m=+231.159386404" watchObservedRunningTime="2026-06-09 07:02:24.184864907 +0000 UTC m=+231.159520536" Jun 09 07:02:29.681425 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:29.681387 2549 patch_prober.go:28] interesting pod/image-registry-88b5485f-jhcx6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 07:02:29.681810 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:29.681450 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" podUID="74e55dde-097a-4c1d-b351-6c4cb30e27ac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 07:02:32.903578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.903538 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh"] Jun 09 07:02:32.905879 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.905860 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pfchc"] Jun 09 07:02:32.906021 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.906001 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:32.908244 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.908223 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:32.908625 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.908605 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 07:02:32.908625 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.908618 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 07:02:32.908872 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.908698 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 07:02:32.909666 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.909651 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-w7vqw\"" Jun 09 07:02:32.909708 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.909676 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 07:02:32.910474 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.910461 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 07:02:32.910661 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.910650 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 07:02:32.910989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.910977 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-msfvm\"" Jun 09 07:02:32.913310 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.913146 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 07:02:32.922231 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:32.922208 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh"] Jun 09 07:02:33.025774 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.025730 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9705be75-1b0e-4938-924c-2eda579c28aa-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.025774 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.025775 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-textfile\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.026049 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.025828 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a850d51d-2a72-410f-b923-969ef31006ce-metrics-client-ca\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.026049 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.025884 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-wtmp\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.026049 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.025939 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a850d51d-2a72-410f-b923-969ef31006ce-sys\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.026049 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.025966 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9705be75-1b0e-4938-924c-2eda579c28aa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.026049 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.026009 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9705be75-1b0e-4938-924c-2eda579c28aa-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.026049 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.026027 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a850d51d-2a72-410f-b923-969ef31006ce-root\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.026049 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.026042 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.026246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.026059 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.026246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.026087 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-tls\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.026246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.026108 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmnx9\" (UniqueName: \"kubernetes.io/projected/a850d51d-2a72-410f-b923-969ef31006ce-kube-api-access-vmnx9\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.026246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.026226 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9705be75-1b0e-4938-924c-2eda579c28aa-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.026363 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.026259 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9705be75-1b0e-4938-924c-2eda579c28aa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.026363 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.026274 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfg46\" (UniqueName: \"kubernetes.io/projected/9705be75-1b0e-4938-924c-2eda579c28aa-kube-api-access-gfg46\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.127293 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127257 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a850d51d-2a72-410f-b923-969ef31006ce-metrics-client-ca\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.127293 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127298 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-wtmp\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.127539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127330 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a850d51d-2a72-410f-b923-969ef31006ce-sys\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.127539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127353 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9705be75-1b0e-4938-924c-2eda579c28aa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.127539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127377 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9705be75-1b0e-4938-924c-2eda579c28aa-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.127539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127393 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a850d51d-2a72-410f-b923-969ef31006ce-root\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.127539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127418 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.127539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127439 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.127539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127469 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-tls\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.127539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127486 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a850d51d-2a72-410f-b923-969ef31006ce-root\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.127539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127497 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmnx9\" (UniqueName: \"kubernetes.io/projected/a850d51d-2a72-410f-b923-969ef31006ce-kube-api-access-vmnx9\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.127539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127521 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-wtmp\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.128067 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127497 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a850d51d-2a72-410f-b923-969ef31006ce-sys\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.128067 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127843 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9705be75-1b0e-4938-924c-2eda579c28aa-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.128067 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127899 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9705be75-1b0e-4938-924c-2eda579c28aa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.128067 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127932 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfg46\" (UniqueName: \"kubernetes.io/projected/9705be75-1b0e-4938-924c-2eda579c28aa-kube-api-access-gfg46\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.128067 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127966 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9705be75-1b0e-4938-924c-2eda579c28aa-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.128067 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.127994 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-textfile\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.128067 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.128034 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a850d51d-2a72-410f-b923-969ef31006ce-metrics-client-ca\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.128405 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.128137 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.128405 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.128326 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-textfile\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.128661 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.128636 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9705be75-1b0e-4938-924c-2eda579c28aa-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.128930 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.128894 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9705be75-1b0e-4938-924c-2eda579c28aa-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.129424 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.129365 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9705be75-1b0e-4938-924c-2eda579c28aa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.130082 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.130055 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.130165 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.130151 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a850d51d-2a72-410f-b923-969ef31006ce-node-exporter-tls\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.130260 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.130243 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9705be75-1b0e-4938-924c-2eda579c28aa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.130366 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.130351 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9705be75-1b0e-4938-924c-2eda579c28aa-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.134573 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.134548 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmnx9\" (UniqueName: \"kubernetes.io/projected/a850d51d-2a72-410f-b923-969ef31006ce-kube-api-access-vmnx9\") pod \"node-exporter-pfchc\" (UID: \"a850d51d-2a72-410f-b923-969ef31006ce\") " pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.134855 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.134838 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfg46\" (UniqueName: \"kubernetes.io/projected/9705be75-1b0e-4938-924c-2eda579c28aa-kube-api-access-gfg46\") pod \"kube-state-metrics-57bbf8bfb5-cfvwh\" (UID: \"9705be75-1b0e-4938-924c-2eda579c28aa\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.216597 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.216520 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" Jun 09 07:02:33.221594 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.221571 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfchc" Jun 09 07:02:33.232315 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:02:33.232287 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda850d51d_2a72_410f_b923_969ef31006ce.slice/crio-3f61b29fa7dbf04dec167e304a0c3ad3afe172fe984a95bd39251fd57b43f853 WatchSource:0}: Error finding container 3f61b29fa7dbf04dec167e304a0c3ad3afe172fe984a95bd39251fd57b43f853: Status 404 returned error can't find the container with id 3f61b29fa7dbf04dec167e304a0c3ad3afe172fe984a95bd39251fd57b43f853 Jun 09 07:02:33.349176 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.349141 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh"] Jun 09 07:02:33.351960 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:02:33.351933 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9705be75_1b0e_4938_924c_2eda579c28aa.slice/crio-25f747f4a7b5caa7e3a3ede180aaa0195ac69a11e10303389e27ae1a112a1a40 WatchSource:0}: Error finding container 25f747f4a7b5caa7e3a3ede180aaa0195ac69a11e10303389e27ae1a112a1a40: Status 404 returned error can't find the container with id 25f747f4a7b5caa7e3a3ede180aaa0195ac69a11e10303389e27ae1a112a1a40 Jun 09 07:02:33.974715 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.974681 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 07:02:33.978723 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.978068 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:33.981211 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.981005 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 07:02:33.981211 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.981030 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 07:02:33.981211 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.981049 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 07:02:33.981211 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.981200 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 07:02:33.981492 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.981322 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 07:02:33.981492 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.981360 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 07:02:33.981492 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.981360 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 07:02:33.981635 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.981495 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-25nkf\"" Jun 09 07:02:33.981709 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.981686 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 07:02:33.988272 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.988254 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 07:02:33.993498 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:33.993475 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 07:02:34.137689 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.137615 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.137939 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.137746 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-config-volume\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.137939 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.137824 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z267z\" (UniqueName: \"kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-kube-api-access-z267z\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.137939 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.137900 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-tls-assets\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.137939 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.137933 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.138471 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.137974 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.138471 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.138015 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.138471 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.138058 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.138471 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.138087 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.138471 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.138126 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.138471 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.138156 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-config-out\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.138471 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.138186 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-web-config\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.138471 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.138228 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.206164 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.206122 2549 generic.go:356] "Generic (PLEG): container finished" podID="a850d51d-2a72-410f-b923-969ef31006ce" containerID="f71e8a4409c9e1d6cb60ff0a9d383143b99d89d46638445f2f6de3b601c18314" exitCode=0 Jun 09 07:02:34.206344 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.206189 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfchc" event={"ID":"a850d51d-2a72-410f-b923-969ef31006ce","Type":"ContainerDied","Data":"f71e8a4409c9e1d6cb60ff0a9d383143b99d89d46638445f2f6de3b601c18314"} Jun 09 07:02:34.206344 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.206239 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfchc" event={"ID":"a850d51d-2a72-410f-b923-969ef31006ce","Type":"ContainerStarted","Data":"3f61b29fa7dbf04dec167e304a0c3ad3afe172fe984a95bd39251fd57b43f853"} Jun 09 07:02:34.207735 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.207708 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" event={"ID":"9705be75-1b0e-4938-924c-2eda579c28aa","Type":"ContainerStarted","Data":"25f747f4a7b5caa7e3a3ede180aaa0195ac69a11e10303389e27ae1a112a1a40"} Jun 09 07:02:34.239588 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239503 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.239588 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239550 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-config-volume\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.239588 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239579 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z267z\" (UniqueName: \"kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-kube-api-access-z267z\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.239895 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239613 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-tls-assets\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.239895 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239641 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.239895 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239672 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.239895 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239707 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.239895 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239747 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.239895 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239776 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.239895 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239834 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.239895 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239861 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-config-out\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.239895 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239893 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-web-config\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.240313 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.239935 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.240615 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.240520 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.241010 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.240987 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.241130 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.241105 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.243141 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.243070 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-tls-assets\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.243875 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.243753 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.243875 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.243833 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-config-volume\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.244598 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.244524 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.244598 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.244554 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.245609 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.245577 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.246218 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.246162 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-config-out\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.246350 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.246323 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-web-config\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.246511 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.246471 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.248264 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.248240 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z267z\" (UniqueName: \"kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-kube-api-access-z267z\") pod \"alertmanager-main-0\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.290256 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.290218 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:02:34.681324 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.681284 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 07:02:34.689286 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:02:34.689240 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde398164_a263_4c54_acc3_fa91b7b42f87.slice/crio-4135129191c6c31bf80db573860ae4f89032632fd806998a05c1df916c275f82 WatchSource:0}: Error finding container 4135129191c6c31bf80db573860ae4f89032632fd806998a05c1df916c275f82: Status 404 returned error can't find the container with id 4135129191c6c31bf80db573860ae4f89032632fd806998a05c1df916c275f82 Jun 09 07:02:34.897516 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.897472 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dff4c7658-6vbxc"] Jun 09 07:02:34.901032 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.901011 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:34.903907 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.903882 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 07:02:34.904057 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.903933 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 07:02:34.904057 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.903988 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-snqjp\"" Jun 09 07:02:34.904057 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.904012 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9b4pfp60vblkd\"" Jun 09 07:02:34.904221 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.904158 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 07:02:34.904413 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.904392 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 07:02:34.904488 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.904473 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 07:02:34.920868 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:34.918530 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dff4c7658-6vbxc"] Jun 09 07:02:35.047468 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.047430 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-tls\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.047918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.047487 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.047918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.047563 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmns5\" (UniqueName: \"kubernetes.io/projected/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-kube-api-access-bmns5\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.047918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.047585 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-grpc-tls\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.047918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.047646 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.047918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.047664 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.047918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.047758 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-metrics-client-ca\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.047918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.047805 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.148528 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.148428 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-metrics-client-ca\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.148528 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.148481 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.148528 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.148512 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-tls\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.148845 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.148539 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.148845 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.148577 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmns5\" (UniqueName: \"kubernetes.io/projected/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-kube-api-access-bmns5\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.148845 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.148609 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-grpc-tls\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.148845 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.148715 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.148845 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.148745 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.149445 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.149419 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-metrics-client-ca\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.152066 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.152011 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.152511 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.152294 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.152511 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.152472 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.152651 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.152557 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.152945 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.152921 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-grpc-tls\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.153032 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.152965 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-secret-thanos-querier-tls\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.160758 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.160733 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmns5\" (UniqueName: \"kubernetes.io/projected/bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c-kube-api-access-bmns5\") pod \"thanos-querier-7dff4c7658-6vbxc\" (UID: \"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c\") " pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.211258 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.211217 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:35.214731 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.214697 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfchc" event={"ID":"a850d51d-2a72-410f-b923-969ef31006ce","Type":"ContainerStarted","Data":"d1e640c26076b953a09f5ff355bb19e0e4c435c48e77107ea203d597f7da4c53"} Jun 09 07:02:35.214863 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.214768 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfchc" event={"ID":"a850d51d-2a72-410f-b923-969ef31006ce","Type":"ContainerStarted","Data":"b93386553c6d6b770f76fbf62790a2aa801d82ccdd2324d2ded96857e8cb94e6"} Jun 09 07:02:35.216151 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.216121 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerStarted","Data":"4135129191c6c31bf80db573860ae4f89032632fd806998a05c1df916c275f82"} Jun 09 07:02:35.218592 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.218515 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" event={"ID":"9705be75-1b0e-4938-924c-2eda579c28aa","Type":"ContainerStarted","Data":"111daa222722266a6852d5c28711165f56b780c892436843f936a82497d2714e"} Jun 09 07:02:35.218592 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.218570 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" event={"ID":"9705be75-1b0e-4938-924c-2eda579c28aa","Type":"ContainerStarted","Data":"b524e54e34505280f0f038371b98893de4d601720c5789a68bebcbb560d0ccc0"} Jun 09 07:02:35.218755 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.218598 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" event={"ID":"9705be75-1b0e-4938-924c-2eda579c28aa","Type":"ContainerStarted","Data":"0b6ce0e905770a0c74719581e64cfc2b071df3df04a62e6fb279428728a12c3c"} Jun 09 07:02:35.238357 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.238299 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pfchc" podStartSLOduration=2.4142134889999998 podStartE2EDuration="3.238278349s" totalImagesPullingTime="745.097575ms" totalInitContainerRuntime="78.967285ms" isStatefulPod=true podCreationTimestamp="2026-06-09 07:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:35.236251326 +0000 UTC m=+242.210906873" watchObservedRunningTime="2026-06-09 07:02:35.238278349 +0000 UTC m=+242.212933896" Jun 09 07:02:35.256169 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.256083 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-cfvwh" podStartSLOduration=2.05948127 podStartE2EDuration="3.256060297s" totalImagesPullingTime="1.196579027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:35.254468628 +0000 UTC m=+242.229124174" watchObservedRunningTime="2026-06-09 07:02:35.256060297 +0000 UTC m=+242.230715845" Jun 09 07:02:35.367901 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:35.367868 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dff4c7658-6vbxc"] Jun 09 07:02:35.371882 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:02:35.371847 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec2a29c_b02c_4c1b_ad9d_ac117ff18c5c.slice/crio-a68db16a6169787ab01fd7b3926eb69ef1833296e3acffe224d89fcbd6c948e0 WatchSource:0}: Error finding container a68db16a6169787ab01fd7b3926eb69ef1833296e3acffe224d89fcbd6c948e0: Status 404 returned error can't find the container with id a68db16a6169787ab01fd7b3926eb69ef1833296e3acffe224d89fcbd6c948e0 Jun 09 07:02:36.224624 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:36.224591 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" event={"ID":"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c","Type":"ContainerStarted","Data":"a68db16a6169787ab01fd7b3926eb69ef1833296e3acffe224d89fcbd6c948e0"} Jun 09 07:02:36.226471 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:36.226437 2549 generic.go:356] "Generic (PLEG): container finished" podID="de398164-a263-4c54-acc3-fa91b7b42f87" containerID="8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681" exitCode=0 Jun 09 07:02:36.226614 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:36.226532 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerDied","Data":"8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681"} Jun 09 07:02:37.233669 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:37.233556 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" event={"ID":"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c","Type":"ContainerStarted","Data":"8dd4a7bd826d38657147a3c9cdf6b07e631be8616432e7e34d6f7accbf831d51"} Jun 09 07:02:37.233669 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:37.233646 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" event={"ID":"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c","Type":"ContainerStarted","Data":"3d38aaa5c0eb3e41a6877fcd4c84e9ae5df58aeaed6a2cf6cbbaa023654351b2"} Jun 09 07:02:37.234096 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:37.233691 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" event={"ID":"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c","Type":"ContainerStarted","Data":"23eb0f74bdca083aa7b11d49bb8f5c507c89b92122460ffd70d878314d2e9f98"} Jun 09 07:02:38.242168 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:38.242057 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" event={"ID":"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c","Type":"ContainerStarted","Data":"4f2d806a425969f80d6d509b5fce16839612e9807d7ac3fc007d4b54ab9c857e"} Jun 09 07:02:38.242588 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:38.242203 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:38.242588 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:38.242246 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" event={"ID":"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c","Type":"ContainerStarted","Data":"3ebd7f5b3efb12729c0cdf71f915f7768b05eb13bf5e939e82fd2d396508821c"} Jun 09 07:02:38.242588 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:38.242294 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" event={"ID":"bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c","Type":"ContainerStarted","Data":"b5bd873214c154ada3e80d91bae78e507993f290b89e718ee205960079adbcd2"} Jun 09 07:02:38.266344 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:38.266279 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" podStartSLOduration=1.8595403579999998 podStartE2EDuration="4.266261004s" totalImagesPullingTime="2.406720646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:02:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:38.264168085 +0000 UTC m=+245.238823628" watchObservedRunningTime="2026-06-09 07:02:38.266261004 +0000 UTC m=+245.240916574" Jun 09 07:02:39.250720 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:39.250675 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerStarted","Data":"6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14"} Jun 09 07:02:39.251165 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:39.250765 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerStarted","Data":"dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c"} Jun 09 07:02:39.251165 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:39.250817 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerStarted","Data":"4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886"} Jun 09 07:02:39.251165 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:39.250863 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerStarted","Data":"c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac"} Jun 09 07:02:39.251165 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:39.250901 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerStarted","Data":"e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5"} Jun 09 07:02:39.251165 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:39.250939 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerStarted","Data":"5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6"} Jun 09 07:02:39.279395 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:39.279339 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.059246976 podStartE2EDuration="6.279320685s" totalImagesPullingTime="3.204950193s" totalInitContainerRuntime="15.123516ms" isStatefulPod=false podCreationTimestamp="2026-06-09 07:02:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:39.277401981 +0000 UTC m=+246.252057527" watchObservedRunningTime="2026-06-09 07:02:39.279320685 +0000 UTC m=+246.253976261" Jun 09 07:02:39.680328 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:39.680292 2549 patch_prober.go:28] interesting pod/image-registry-88b5485f-jhcx6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 07:02:39.680493 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:39.680348 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" podUID="74e55dde-097a-4c1d-b351-6c4cb30e27ac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 07:02:41.325591 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.325551 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cd75b9868-ldwlb"] Jun 09 07:02:41.328240 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.328217 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.330681 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.330652 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vr4ww\"" Jun 09 07:02:41.330681 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.330652 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 07:02:41.330884 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.330652 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 07:02:41.331614 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.331596 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 07:02:41.331614 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.331597 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 07:02:41.331755 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.331641 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 07:02:41.331755 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.331658 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 07:02:41.331755 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.331700 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 07:02:41.339709 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.339685 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd75b9868-ldwlb"] Jun 09 07:02:41.510102 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.510062 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-oauth-serving-cert\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.510275 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.510125 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-serving-cert\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.510275 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.510161 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-oauth-config\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.510275 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.510183 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jhfs\" (UniqueName: \"kubernetes.io/projected/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-kube-api-access-5jhfs\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.510275 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.510207 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-service-ca\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.510275 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.510262 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-config\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.611696 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.611615 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-oauth-serving-cert\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.611696 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.611668 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-serving-cert\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.611696 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.611689 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-oauth-config\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.611979 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.611712 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jhfs\" (UniqueName: \"kubernetes.io/projected/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-kube-api-access-5jhfs\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.611979 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.611734 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-service-ca\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.611979 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.611757 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-config\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.612429 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.612403 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-oauth-serving-cert\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.612564 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.612542 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-service-ca\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.612629 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.612550 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-config\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.614125 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.614103 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-oauth-config\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.614247 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.614231 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-serving-cert\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.622948 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.622922 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jhfs\" (UniqueName: \"kubernetes.io/projected/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-kube-api-access-5jhfs\") pod \"console-cd75b9868-ldwlb\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.638030 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.638000 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:41.766593 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:41.766514 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd75b9868-ldwlb"] Jun 09 07:02:41.769256 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:02:41.769231 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bd63fe_d62c_4c96_8670_5f5c7b6e40f5.slice/crio-68ddf2553fe5852884126f5d4b0da7e20c04a444a12391f4e72516f56203847f WatchSource:0}: Error finding container 68ddf2553fe5852884126f5d4b0da7e20c04a444a12391f4e72516f56203847f: Status 404 returned error can't find the container with id 68ddf2553fe5852884126f5d4b0da7e20c04a444a12391f4e72516f56203847f Jun 09 07:02:42.264183 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:42.264149 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd75b9868-ldwlb" event={"ID":"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5","Type":"ContainerStarted","Data":"68ddf2553fe5852884126f5d4b0da7e20c04a444a12391f4e72516f56203847f"} Jun 09 07:02:44.258034 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:44.257997 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dff4c7658-6vbxc" Jun 09 07:02:44.695259 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:44.695211 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" podUID="74e55dde-097a-4c1d-b351-6c4cb30e27ac" containerName="registry" containerID="cri-o://c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98" gracePeriod=30 Jun 09 07:02:45.252347 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.252320 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:02:45.285371 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.285335 2549 generic.go:356] "Generic (PLEG): container finished" podID="74e55dde-097a-4c1d-b351-6c4cb30e27ac" containerID="c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98" exitCode=0 Jun 09 07:02:45.285850 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.285402 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" Jun 09 07:02:45.285850 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.285419 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" event={"ID":"74e55dde-097a-4c1d-b351-6c4cb30e27ac","Type":"ContainerDied","Data":"c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98"} Jun 09 07:02:45.285850 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.285511 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-88b5485f-jhcx6" event={"ID":"74e55dde-097a-4c1d-b351-6c4cb30e27ac","Type":"ContainerDied","Data":"bafa7241a292eb485b9bb7a423556468464e082bb832e4d26f862e615de798f6"} Jun 09 07:02:45.285850 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.285546 2549 scope.go:117] "RemoveContainer" containerID="c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98" Jun 09 07:02:45.287434 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.287406 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd75b9868-ldwlb" event={"ID":"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5","Type":"ContainerStarted","Data":"dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577"} Jun 09 07:02:45.294490 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.294460 2549 scope.go:117] "RemoveContainer" containerID="c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98" Jun 09 07:02:45.294834 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:02:45.294803 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98\": container with ID starting with c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98 not found: ID does not exist" containerID="c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98" Jun 09 07:02:45.294953 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.294845 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98"} err="failed to get container status \"c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98\": rpc error: code = NotFound desc = could not find container \"c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98\": container with ID starting with c497903130e87cad2655f80e9e7d6183c654433209f3a6ba495f3a0fc3cf7c98 not found: ID does not exist" Jun 09 07:02:45.304296 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.304207 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cd75b9868-ldwlb" podStartSLOduration=0.922057259 podStartE2EDuration="4.304189458s" totalImagesPullingTime="3.382132199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:02:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:45.30374959 +0000 UTC m=+252.278405143" watchObservedRunningTime="2026-06-09 07:02:45.304189458 +0000 UTC m=+252.278845015" Jun 09 07:02:45.342864 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.342822 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-image-registry-private-configuration\") pod \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " Jun 09 07:02:45.343033 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.342876 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-bound-sa-token\") pod \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " Jun 09 07:02:45.343033 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.342903 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls\") pod \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " Jun 09 07:02:45.343033 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.342920 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtpdw\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-kube-api-access-wtpdw\") pod \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " Jun 09 07:02:45.343033 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.342943 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-certificates\") pod \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " Jun 09 07:02:45.343033 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.342965 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-installation-pull-secrets\") pod \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " Jun 09 07:02:45.343033 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.343013 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-trusted-ca\") pod \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " Jun 09 07:02:45.343359 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.343222 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 07:02:45.343501 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.343470 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "74e55dde-097a-4c1d-b351-6c4cb30e27ac" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:02:45.343573 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.343507 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "74e55dde-097a-4c1d-b351-6c4cb30e27ac" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:02:45.345468 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.345430 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "74e55dde-097a-4c1d-b351-6c4cb30e27ac" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:02:45.345592 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.345534 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "74e55dde-097a-4c1d-b351-6c4cb30e27ac" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:02:45.345592 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.345545 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "74e55dde-097a-4c1d-b351-6c4cb30e27ac" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:02:45.346082 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.346055 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-kube-api-access-wtpdw" (OuterVolumeSpecName: "kube-api-access-wtpdw") pod "74e55dde-097a-4c1d-b351-6c4cb30e27ac" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac"). InnerVolumeSpecName "kube-api-access-wtpdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:02:45.346180 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.346097 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "74e55dde-097a-4c1d-b351-6c4cb30e27ac" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:02:45.346436 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.346418 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ff5d471-42f5-46ff-84d5-e276685218dc-metrics-certs\") pod \"network-metrics-daemon-5gj2q\" (UID: \"6ff5d471-42f5-46ff-84d5-e276685218dc\") " pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 07:02:45.364968 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.364941 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-775hf\"" Jun 09 07:02:45.373191 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.373130 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5gj2q" Jun 09 07:02:45.443887 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.443857 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e55dde-097a-4c1d-b351-6c4cb30e27ac-ca-trust-extracted\") pod \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\" (UID: \"74e55dde-097a-4c1d-b351-6c4cb30e27ac\") " Jun 09 07:02:45.444570 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.444022 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtpdw\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-kube-api-access-wtpdw\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:02:45.444570 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.444036 2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-certificates\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:02:45.444570 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.444045 2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-installation-pull-secrets\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:02:45.444570 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.444054 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e55dde-097a-4c1d-b351-6c4cb30e27ac-trusted-ca\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:02:45.444570 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.444063 2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e55dde-097a-4c1d-b351-6c4cb30e27ac-image-registry-private-configuration\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:02:45.444570 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.444071 2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-bound-sa-token\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:02:45.444570 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.444080 2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e55dde-097a-4c1d-b351-6c4cb30e27ac-registry-tls\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:02:45.452063 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.452028 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e55dde-097a-4c1d-b351-6c4cb30e27ac-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "74e55dde-097a-4c1d-b351-6c4cb30e27ac" (UID: "74e55dde-097a-4c1d-b351-6c4cb30e27ac"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:02:45.504729 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.504689 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5gj2q"] Jun 09 07:02:45.507136 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:02:45.507109 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff5d471_42f5_46ff_84d5_e276685218dc.slice/crio-77df61d3d3cd9e47450fe685c58c8f980399426dcff55fde6dd876537df38fee WatchSource:0}: Error finding container 77df61d3d3cd9e47450fe685c58c8f980399426dcff55fde6dd876537df38fee: Status 404 returned error can't find the container with id 77df61d3d3cd9e47450fe685c58c8f980399426dcff55fde6dd876537df38fee Jun 09 07:02:45.544587 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.544549 2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e55dde-097a-4c1d-b351-6c4cb30e27ac-ca-trust-extracted\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:02:45.600280 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.600245 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-88b5485f-jhcx6"] Jun 09 07:02:45.604254 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:45.604228 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-88b5485f-jhcx6"] Jun 09 07:02:46.292485 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:46.292446 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5gj2q" event={"ID":"6ff5d471-42f5-46ff-84d5-e276685218dc","Type":"ContainerStarted","Data":"77df61d3d3cd9e47450fe685c58c8f980399426dcff55fde6dd876537df38fee"} Jun 09 07:02:47.299626 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:47.299588 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5gj2q" event={"ID":"6ff5d471-42f5-46ff-84d5-e276685218dc","Type":"ContainerStarted","Data":"cefb2fc38f67402665909f72f8fe1988bd5b9498e2e87d253ef06c4af932e7cf"} Jun 09 07:02:47.300037 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:47.299642 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5gj2q" event={"ID":"6ff5d471-42f5-46ff-84d5-e276685218dc","Type":"ContainerStarted","Data":"58e9aba8e585908af864ac8a6f08887fe3f0bfb3585cd357b97a0c3ab203c61b"} Jun 09 07:02:47.314177 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:47.314118 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5gj2q" podStartSLOduration=253.570853629 podStartE2EDuration="4m14.314098491s" totalImagesPullingTime="743.244862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 06:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:47.313902924 +0000 UTC m=+254.288558480" watchObservedRunningTime="2026-06-09 07:02:47.314098491 +0000 UTC m=+254.288754238" Jun 09 07:02:47.467191 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:47.467159 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e55dde-097a-4c1d-b351-6c4cb30e27ac" path="/var/lib/kubelet/pods/74e55dde-097a-4c1d-b351-6c4cb30e27ac/volumes" Jun 09 07:02:51.638725 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:51.638695 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:51.639204 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:51.638752 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:02:51.640277 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:51.640252 2549 patch_prober.go:28] interesting pod/console-cd75b9868-ldwlb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 09 07:02:51.640401 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:51.640299 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cd75b9868-ldwlb" podUID="52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 09 07:02:58.342776 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:58.342736 2549 generic.go:356] "Generic (PLEG): container finished" podID="093db7d2-34f9-4e0f-8654-9b89613f0777" containerID="8e51daefaacc4361da8f5644785dfb0d8f9c7e878425701ff96ef80a866bfd05" exitCode=0 Jun 09 07:02:58.343184 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:58.342815 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6z6kw" event={"ID":"093db7d2-34f9-4e0f-8654-9b89613f0777","Type":"ContainerDied","Data":"8e51daefaacc4361da8f5644785dfb0d8f9c7e878425701ff96ef80a866bfd05"} Jun 09 07:02:58.343227 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:58.343189 2549 scope.go:117] "RemoveContainer" containerID="8e51daefaacc4361da8f5644785dfb0d8f9c7e878425701ff96ef80a866bfd05" Jun 09 07:02:59.348807 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:02:59.348750 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-6z6kw" event={"ID":"093db7d2-34f9-4e0f-8654-9b89613f0777","Type":"ContainerStarted","Data":"c52f3643b4b14e34d047f1924e7161a5187e0819662347a4629dc118bdee5d84"} Jun 09 07:03:01.394027 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:01.394000 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_de398164-a263-4c54-acc3-fa91b7b42f87/init-config-reloader/0.log" Jun 09 07:03:01.594698 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:01.594670 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_de398164-a263-4c54-acc3-fa91b7b42f87/alertmanager/0.log" Jun 09 07:03:01.638430 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:01.638398 2549 patch_prober.go:28] interesting pod/console-cd75b9868-ldwlb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 09 07:03:01.638611 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:01.638450 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cd75b9868-ldwlb" podUID="52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 09 07:03:01.794842 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:01.794809 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_de398164-a263-4c54-acc3-fa91b7b42f87/config-reloader/0.log" Jun 09 07:03:01.994776 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:01.994747 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_de398164-a263-4c54-acc3-fa91b7b42f87/kube-rbac-proxy-web/0.log" Jun 09 07:03:02.194563 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:02.194535 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_de398164-a263-4c54-acc3-fa91b7b42f87/kube-rbac-proxy/0.log" Jun 09 07:03:02.394232 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:02.394201 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_de398164-a263-4c54-acc3-fa91b7b42f87/kube-rbac-proxy-metric/0.log" Jun 09 07:03:02.593813 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:02.593705 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_de398164-a263-4c54-acc3-fa91b7b42f87/prom-label-proxy/0.log" Jun 09 07:03:02.796301 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:02.796273 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-nb6tm_74f83c3b-7e60-4a98-99c5-2566ad7e8134/cluster-monitoring-operator/0.log" Jun 09 07:03:02.994236 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:02.994206 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-cfvwh_9705be75-1b0e-4938-924c-2eda579c28aa/kube-state-metrics/0.log" Jun 09 07:03:03.193953 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:03.193901 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-cfvwh_9705be75-1b0e-4938-924c-2eda579c28aa/kube-rbac-proxy-main/0.log" Jun 09 07:03:03.394430 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:03.394359 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-cfvwh_9705be75-1b0e-4938-924c-2eda579c28aa/kube-rbac-proxy-self/0.log" Jun 09 07:03:05.194732 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:05.194705 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfchc_a850d51d-2a72-410f-b923-969ef31006ce/init-textfile/0.log" Jun 09 07:03:05.395096 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:05.395062 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfchc_a850d51d-2a72-410f-b923-969ef31006ce/node-exporter/0.log" Jun 09 07:03:05.594342 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:05.594262 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfchc_a850d51d-2a72-410f-b923-969ef31006ce/kube-rbac-proxy/0.log" Jun 09 07:03:08.994180 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:08.994152 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/thanos-query/0.log" Jun 09 07:03:09.193862 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:09.193835 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/kube-rbac-proxy-web/0.log" Jun 09 07:03:09.394068 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:09.393993 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/kube-rbac-proxy/0.log" Jun 09 07:03:09.594487 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:09.594458 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/prom-label-proxy/0.log" Jun 09 07:03:09.794821 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:09.794777 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/kube-rbac-proxy-rules/0.log" Jun 09 07:03:09.994182 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:09.994154 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/kube-rbac-proxy-metrics/0.log" Jun 09 07:03:10.995682 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:10.995656 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cd75b9868-ldwlb_52bd63fe-d62c-4c96-8670-5f5c7b6e40f5/console/0.log" Jun 09 07:03:11.639196 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:11.639163 2549 patch_prober.go:28] interesting pod/console-cd75b9868-ldwlb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 09 07:03:11.639352 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:11.639229 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cd75b9868-ldwlb" podUID="52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 09 07:03:12.593899 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:12.593872 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qrvxd_9980c63f-e2a5-40ff-a193-80276600e53e/dns-node-resolver/0.log" Jun 09 07:03:13.593720 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:13.593682 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ck9kl_ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57/node-ca/0.log" Jun 09 07:03:14.593667 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:14.593637 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b7kqp_ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa/serve-healthcheck-canary/0.log" Jun 09 07:03:14.944852 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:03:14.944811 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mzkvs" podUID="27d1e129-2183-4926-8818-8e57fb66b135" Jun 09 07:03:15.410057 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:15.410025 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mzkvs" Jun 09 07:03:17.913282 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:17.912650 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 07:03:17.916637 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:17.916572 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27d1e129-2183-4926-8818-8e57fb66b135-metrics-tls\") pod \"dns-default-mzkvs\" (UID: \"27d1e129-2183-4926-8818-8e57fb66b135\") " pod="openshift-dns/dns-default-mzkvs" Jun 09 07:03:18.114449 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:18.114403 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4jm8\"" Jun 09 07:03:18.121737 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:18.121707 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mzkvs" Jun 09 07:03:18.312569 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:18.312462 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mzkvs"] Jun 09 07:03:18.320473 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:03:18.320437 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d1e129_2183_4926_8818_8e57fb66b135.slice/crio-621802bc209ee51c8de53621c6727d3bb3d7af525948d3c8f042e5f5ba687027 WatchSource:0}: Error finding container 621802bc209ee51c8de53621c6727d3bb3d7af525948d3c8f042e5f5ba687027: Status 404 returned error can't find the container with id 621802bc209ee51c8de53621c6727d3bb3d7af525948d3c8f042e5f5ba687027 Jun 09 07:03:18.433588 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:18.433504 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mzkvs" event={"ID":"27d1e129-2183-4926-8818-8e57fb66b135","Type":"ContainerStarted","Data":"621802bc209ee51c8de53621c6727d3bb3d7af525948d3c8f042e5f5ba687027"} Jun 09 07:03:19.440237 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:19.440199 2549 generic.go:356] "Generic (PLEG): container finished" podID="c338b8e4-252b-4e2d-914a-1914664f7a3b" containerID="9a64bfacf091f85277742a9933ceb0c17c9a4eab0794847f89e828cfce07c21d" exitCode=0 Jun 09 07:03:19.440702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:19.440238 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" event={"ID":"c338b8e4-252b-4e2d-914a-1914664f7a3b","Type":"ContainerDied","Data":"9a64bfacf091f85277742a9933ceb0c17c9a4eab0794847f89e828cfce07c21d"} Jun 09 07:03:19.440702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:19.440605 2549 scope.go:117] "RemoveContainer" containerID="9a64bfacf091f85277742a9933ceb0c17c9a4eab0794847f89e828cfce07c21d" Jun 09 07:03:20.446010 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:20.445969 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-pjrd6" event={"ID":"c338b8e4-252b-4e2d-914a-1914664f7a3b","Type":"ContainerStarted","Data":"e91543167fe0f33d43f61d7ea9c7c7d0a60db11ed58f2e80a96b2fc5861a9a47"} Jun 09 07:03:20.447845 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:20.447822 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mzkvs" event={"ID":"27d1e129-2183-4926-8818-8e57fb66b135","Type":"ContainerStarted","Data":"713236abb987538df71d9a917423e061757c733700c22ab91e4a7c0fdb0e2f5c"} Jun 09 07:03:20.447967 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:20.447863 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mzkvs" event={"ID":"27d1e129-2183-4926-8818-8e57fb66b135","Type":"ContainerStarted","Data":"1d4a103dba3cd299ed55a4dfe7f8709328bae057b148bf4eefc794f331fb973a"} Jun 09 07:03:20.447967 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:20.447951 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mzkvs" Jun 09 07:03:20.476362 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:20.476307 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mzkvs" podStartSLOduration=251.919492974 podStartE2EDuration="4m13.476289053s" totalImagesPullingTime="1.556796079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 06:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:03:20.475231919 +0000 UTC m=+287.449887465" watchObservedRunningTime="2026-06-09 07:03:20.476289053 +0000 UTC m=+287.450944598" Jun 09 07:03:21.642488 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:21.642460 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:03:21.653728 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:21.651225 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:03:25.904449 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:25.904410 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd75b9868-ldwlb"] Jun 09 07:03:30.454449 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:30.454417 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mzkvs" Jun 09 07:03:33.432943 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:33.432915 2549 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 07:03:50.924310 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:50.924268 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-cd75b9868-ldwlb" podUID="52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" containerName="console" containerID="cri-o://dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577" gracePeriod=15 Jun 09 07:03:51.161013 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.160987 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:03:51.200901 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.200804 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-oauth-config\") pod \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " Jun 09 07:03:51.200901 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.200849 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-serving-cert\") pod \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " Jun 09 07:03:51.200901 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.200893 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-config\") pod \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " Jun 09 07:03:51.201167 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.200931 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jhfs\" (UniqueName: \"kubernetes.io/projected/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-kube-api-access-5jhfs\") pod \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " Jun 09 07:03:51.201167 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.201004 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-oauth-serving-cert\") pod \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " Jun 09 07:03:51.201167 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.201026 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-service-ca\") pod \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\" (UID: \"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5\") " Jun 09 07:03:51.201370 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.201342 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-config" (OuterVolumeSpecName: "console-config") pod "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" (UID: "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:51.201427 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.201371 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" (UID: "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:51.201487 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.201462 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" (UID: "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:51.203171 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.203140 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" (UID: "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:51.203286 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.203218 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" (UID: "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:51.203333 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.203293 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-kube-api-access-5jhfs" (OuterVolumeSpecName: "kube-api-access-5jhfs") pod "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" (UID: "52bd63fe-d62c-4c96-8670-5f5c7b6e40f5"). InnerVolumeSpecName "kube-api-access-5jhfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:03:51.301603 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.301562 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-oauth-serving-cert\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:51.301603 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.301596 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-service-ca\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:51.301603 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.301609 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-oauth-config\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:51.301881 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.301620 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-serving-cert\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:51.301881 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.301632 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-console-config\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:51.301881 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.301643 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jhfs\" (UniqueName: \"kubernetes.io/projected/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5-kube-api-access-5jhfs\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:51.568902 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.568866 2549 generic.go:356] "Generic (PLEG): container finished" podID="52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" containerID="dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577" exitCode=0 Jun 09 07:03:51.569079 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.568924 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd75b9868-ldwlb" Jun 09 07:03:51.569079 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.568947 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd75b9868-ldwlb" event={"ID":"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5","Type":"ContainerDied","Data":"dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577"} Jun 09 07:03:51.569079 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.568994 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd75b9868-ldwlb" event={"ID":"52bd63fe-d62c-4c96-8670-5f5c7b6e40f5","Type":"ContainerDied","Data":"68ddf2553fe5852884126f5d4b0da7e20c04a444a12391f4e72516f56203847f"} Jun 09 07:03:51.569079 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.569013 2549 scope.go:117] "RemoveContainer" containerID="dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577" Jun 09 07:03:51.577355 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.577337 2549 scope.go:117] "RemoveContainer" containerID="dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577" Jun 09 07:03:51.577627 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:03:51.577605 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577\": container with ID starting with dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577 not found: ID does not exist" containerID="dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577" Jun 09 07:03:51.577691 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.577640 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577"} err="failed to get container status \"dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577\": rpc error: code = NotFound desc = could not find container \"dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577\": container with ID starting with dd7c0ca658e6e956f4aac0043b77f7c7269418fa0db228dea18a4db28ab52577 not found: ID does not exist" Jun 09 07:03:51.585594 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.585569 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd75b9868-ldwlb"] Jun 09 07:03:51.589600 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:51.589574 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cd75b9868-ldwlb"] Jun 09 07:03:53.213740 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.213706 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 07:03:53.214186 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.214025 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="alertmanager" containerID="cri-o://5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6" gracePeriod=120 Jun 09 07:03:53.214186 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.214082 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy-metric" containerID="cri-o://dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c" gracePeriod=120 Jun 09 07:03:53.214315 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.214191 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy-web" containerID="cri-o://c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac" gracePeriod=120 Jun 09 07:03:53.214315 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.214193 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy" containerID="cri-o://4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886" gracePeriod=120 Jun 09 07:03:53.214315 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.214278 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="config-reloader" containerID="cri-o://e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5" gracePeriod=120 Jun 09 07:03:53.214450 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.214377 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="prom-label-proxy" containerID="cri-o://6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14" gracePeriod=120 Jun 09 07:03:53.466519 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.466440 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" path="/var/lib/kubelet/pods/52bd63fe-d62c-4c96-8670-5f5c7b6e40f5/volumes" Jun 09 07:03:53.581560 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.581528 2549 generic.go:356] "Generic (PLEG): container finished" podID="de398164-a263-4c54-acc3-fa91b7b42f87" containerID="6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14" exitCode=0 Jun 09 07:03:53.581560 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.581553 2549 generic.go:356] "Generic (PLEG): container finished" podID="de398164-a263-4c54-acc3-fa91b7b42f87" containerID="4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886" exitCode=0 Jun 09 07:03:53.581560 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.581559 2549 generic.go:356] "Generic (PLEG): container finished" podID="de398164-a263-4c54-acc3-fa91b7b42f87" containerID="e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5" exitCode=0 Jun 09 07:03:53.581560 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.581566 2549 generic.go:356] "Generic (PLEG): container finished" podID="de398164-a263-4c54-acc3-fa91b7b42f87" containerID="5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6" exitCode=0 Jun 09 07:03:53.581836 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.581596 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerDied","Data":"6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14"} Jun 09 07:03:53.581836 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.581657 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerDied","Data":"4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886"} Jun 09 07:03:53.581836 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.581683 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerDied","Data":"e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5"} Jun 09 07:03:53.581836 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:53.581708 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerDied","Data":"5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6"} Jun 09 07:03:54.457494 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.457468 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.532219 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532185 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-config-volume\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532376 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532235 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-cluster-tls-config\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532376 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532267 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z267z\" (UniqueName: \"kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-kube-api-access-z267z\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532376 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532286 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-main-db\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532376 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532313 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-web\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532376 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532365 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532650 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532394 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-config-out\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532650 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532435 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-metric\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532650 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532477 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-metrics-client-ca\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532650 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532509 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-web-config\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532650 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532536 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-trusted-ca-bundle\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532650 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532559 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-main-tls\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.532650 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532600 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-tls-assets\") pod \"de398164-a263-4c54-acc3-fa91b7b42f87\" (UID: \"de398164-a263-4c54-acc3-fa91b7b42f87\") " Jun 09 07:03:54.533035 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532657 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:03:54.533035 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.532930 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-main-db\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.533149 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.533065 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:54.533149 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.533078 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:54.535140 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.535112 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-kube-api-access-z267z" (OuterVolumeSpecName: "kube-api-access-z267z") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "kube-api-access-z267z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:03:54.535436 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.535402 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-config-volume" (OuterVolumeSpecName: "config-volume") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:54.536144 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.536069 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:54.536344 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.536311 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:54.536779 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.536743 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:54.537165 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.537141 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:54.537377 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.537351 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-config-out" (OuterVolumeSpecName: "config-out") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:03:54.537665 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.537641 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:03:54.540970 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.540947 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:54.546753 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.546701 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-web-config" (OuterVolumeSpecName: "web-config") pod "de398164-a263-4c54-acc3-fa91b7b42f87" (UID: "de398164-a263-4c54-acc3-fa91b7b42f87"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:54.589200 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.589163 2549 generic.go:356] "Generic (PLEG): container finished" podID="de398164-a263-4c54-acc3-fa91b7b42f87" containerID="dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c" exitCode=0 Jun 09 07:03:54.589200 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.589189 2549 generic.go:356] "Generic (PLEG): container finished" podID="de398164-a263-4c54-acc3-fa91b7b42f87" containerID="c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac" exitCode=0 Jun 09 07:03:54.589391 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.589253 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.589391 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.589252 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerDied","Data":"dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c"} Jun 09 07:03:54.589391 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.589339 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerDied","Data":"c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac"} Jun 09 07:03:54.589391 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.589381 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de398164-a263-4c54-acc3-fa91b7b42f87","Type":"ContainerDied","Data":"4135129191c6c31bf80db573860ae4f89032632fd806998a05c1df916c275f82"} Jun 09 07:03:54.589525 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.589410 2549 scope.go:117] "RemoveContainer" containerID="6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14" Jun 09 07:03:54.597985 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.597966 2549 scope.go:117] "RemoveContainer" containerID="dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c" Jun 09 07:03:54.605291 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.605274 2549 scope.go:117] "RemoveContainer" containerID="4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886" Jun 09 07:03:54.612500 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.612475 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 07:03:54.613196 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.613175 2549 scope.go:117] "RemoveContainer" containerID="c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac" Jun 09 07:03:54.618192 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.618163 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 07:03:54.621334 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.621314 2549 scope.go:117] "RemoveContainer" containerID="e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5" Jun 09 07:03:54.630290 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.630269 2549 scope.go:117] "RemoveContainer" containerID="5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6" Jun 09 07:03:54.633894 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633726 2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-tls-assets\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.633894 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633755 2549 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-config-volume\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.633894 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633768 2549 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-cluster-tls-config\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.633894 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633808 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z267z\" (UniqueName: \"kubernetes.io/projected/de398164-a263-4c54-acc3-fa91b7b42f87-kube-api-access-z267z\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.633894 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633857 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.633894 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633870 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.633894 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633884 2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de398164-a263-4c54-acc3-fa91b7b42f87-config-out\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.633894 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633896 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.634200 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633911 2549 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-metrics-client-ca\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.634200 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633924 2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-web-config\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.634200 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633937 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de398164-a263-4c54-acc3-fa91b7b42f87-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.634200 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.633950 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de398164-a263-4c54-acc3-fa91b7b42f87-secret-alertmanager-main-tls\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:03:54.638202 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.638184 2549 scope.go:117] "RemoveContainer" containerID="8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681" Jun 09 07:03:54.641830 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.641807 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 07:03:54.642091 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642070 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e55dde-097a-4c1d-b351-6c4cb30e27ac" containerName="registry" Jun 09 07:03:54.642091 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642090 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e55dde-097a-4c1d-b351-6c4cb30e27ac" containerName="registry" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642104 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="config-reloader" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642114 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="config-reloader" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642130 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="prom-label-proxy" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642136 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="prom-label-proxy" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642143 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="init-config-reloader" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642148 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="init-config-reloader" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642154 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy-web" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642160 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy-web" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642170 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642177 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642187 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy-metric" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642192 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy-metric" Jun 09 07:03:54.642201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642201 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" containerName="console" Jun 09 07:03:54.642702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642207 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" containerName="console" Jun 09 07:03:54.642702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642215 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="alertmanager" Jun 09 07:03:54.642702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642221 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="alertmanager" Jun 09 07:03:54.642702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642283 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="config-reloader" Jun 09 07:03:54.642702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642290 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy" Jun 09 07:03:54.642702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642296 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="52bd63fe-d62c-4c96-8670-5f5c7b6e40f5" containerName="console" Jun 09 07:03:54.642702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642302 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="alertmanager" Jun 09 07:03:54.642702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642308 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="prom-label-proxy" Jun 09 07:03:54.642702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642314 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy-metric" Jun 09 07:03:54.642702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642323 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" containerName="kube-rbac-proxy-web" Jun 09 07:03:54.642702 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.642331 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e55dde-097a-4c1d-b351-6c4cb30e27ac" containerName="registry" Jun 09 07:03:54.645901 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.645883 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.646106 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.646060 2549 scope.go:117] "RemoveContainer" containerID="6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14" Jun 09 07:03:54.646412 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:03:54.646386 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14\": container with ID starting with 6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14 not found: ID does not exist" containerID="6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14" Jun 09 07:03:54.646479 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.646426 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14"} err="failed to get container status \"6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14\": rpc error: code = NotFound desc = could not find container \"6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14\": container with ID starting with 6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14 not found: ID does not exist" Jun 09 07:03:54.646479 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.646451 2549 scope.go:117] "RemoveContainer" containerID="dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c" Jun 09 07:03:54.646725 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:03:54.646705 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c\": container with ID starting with dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c not found: ID does not exist" containerID="dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c" Jun 09 07:03:54.646846 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.646736 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c"} err="failed to get container status \"dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c\": rpc error: code = NotFound desc = could not find container \"dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c\": container with ID starting with dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c not found: ID does not exist" Jun 09 07:03:54.646846 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.646762 2549 scope.go:117] "RemoveContainer" containerID="4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886" Jun 09 07:03:54.647138 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:03:54.647121 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886\": container with ID starting with 4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886 not found: ID does not exist" containerID="4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886" Jun 09 07:03:54.647188 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.647143 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886"} err="failed to get container status \"4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886\": rpc error: code = NotFound desc = could not find container \"4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886\": container with ID starting with 4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886 not found: ID does not exist" Jun 09 07:03:54.647188 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.647158 2549 scope.go:117] "RemoveContainer" containerID="c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac" Jun 09 07:03:54.647415 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:03:54.647399 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac\": container with ID starting with c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac not found: ID does not exist" containerID="c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac" Jun 09 07:03:54.647491 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.647422 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac"} err="failed to get container status \"c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac\": rpc error: code = NotFound desc = could not find container \"c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac\": container with ID starting with c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac not found: ID does not exist" Jun 09 07:03:54.647491 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.647444 2549 scope.go:117] "RemoveContainer" containerID="e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5" Jun 09 07:03:54.647706 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:03:54.647679 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5\": container with ID starting with e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5 not found: ID does not exist" containerID="e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5" Jun 09 07:03:54.647747 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.647714 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5"} err="failed to get container status \"e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5\": rpc error: code = NotFound desc = could not find container \"e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5\": container with ID starting with e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5 not found: ID does not exist" Jun 09 07:03:54.647747 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.647734 2549 scope.go:117] "RemoveContainer" containerID="5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6" Jun 09 07:03:54.648016 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:03:54.647995 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6\": container with ID starting with 5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6 not found: ID does not exist" containerID="5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6" Jun 09 07:03:54.648113 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648021 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6"} err="failed to get container status \"5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6\": rpc error: code = NotFound desc = could not find container \"5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6\": container with ID starting with 5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6 not found: ID does not exist" Jun 09 07:03:54.648113 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648036 2549 scope.go:117] "RemoveContainer" containerID="8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681" Jun 09 07:03:54.648308 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:03:54.648290 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681\": container with ID starting with 8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681 not found: ID does not exist" containerID="8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681" Jun 09 07:03:54.648381 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648317 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681"} err="failed to get container status \"8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681\": rpc error: code = NotFound desc = could not find container \"8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681\": container with ID starting with 8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681 not found: ID does not exist" Jun 09 07:03:54.648381 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648336 2549 scope.go:117] "RemoveContainer" containerID="6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14" Jun 09 07:03:54.648511 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648495 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 07:03:54.648564 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648532 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-25nkf\"" Jun 09 07:03:54.648564 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648499 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 07:03:54.648649 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648555 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14"} err="failed to get container status \"6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14\": rpc error: code = NotFound desc = could not find container \"6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14\": container with ID starting with 6c0fefade7014989de684ee9962ceda62fd3afea41032e967e48634b1d5f2b14 not found: ID does not exist" Jun 09 07:03:54.648649 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648578 2549 scope.go:117] "RemoveContainer" containerID="dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c" Jun 09 07:03:54.648649 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648534 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 07:03:54.648649 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648495 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 07:03:54.648939 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648920 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 07:03:54.649043 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648941 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 07:03:54.649043 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648954 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c"} err="failed to get container status \"dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c\": rpc error: code = NotFound desc = could not find container \"dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c\": container with ID starting with dae88365a83995dd5384a2f70c9474af6910661b4c6d08aa1727152558b6989c not found: ID does not exist" Jun 09 07:03:54.649043 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.648981 2549 scope.go:117] "RemoveContainer" containerID="4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886" Jun 09 07:03:54.649043 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.649002 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 07:03:54.649345 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.649328 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 07:03:54.649425 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.649342 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886"} err="failed to get container status \"4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886\": rpc error: code = NotFound desc = could not find container \"4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886\": container with ID starting with 4face779a4f5dcc97b92ea8e786db50ed5ea6c3067a1877924d4a967c42d6886 not found: ID does not exist" Jun 09 07:03:54.649425 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.649362 2549 scope.go:117] "RemoveContainer" containerID="c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac" Jun 09 07:03:54.649632 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.649607 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac"} err="failed to get container status \"c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac\": rpc error: code = NotFound desc = could not find container \"c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac\": container with ID starting with c19ea794da03b4b5046a652f4431efeed519b587b5fe793dab8251611c0ac3ac not found: ID does not exist" Jun 09 07:03:54.649703 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.649635 2549 scope.go:117] "RemoveContainer" containerID="e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5" Jun 09 07:03:54.649942 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.649918 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5"} err="failed to get container status \"e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5\": rpc error: code = NotFound desc = could not find container \"e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5\": container with ID starting with e2e374be5527c16036e5b154378e853d77ccb4ce3230d5446fddae72b2d50fb5 not found: ID does not exist" Jun 09 07:03:54.650025 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.649943 2549 scope.go:117] "RemoveContainer" containerID="5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6" Jun 09 07:03:54.650223 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.650198 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6"} err="failed to get container status \"5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6\": rpc error: code = NotFound desc = could not find container \"5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6\": container with ID starting with 5b11b4b8d579c0cc3037a8ffaf64565964549322b849f5b0ef71eca0c4c072c6 not found: ID does not exist" Jun 09 07:03:54.650311 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.650225 2549 scope.go:117] "RemoveContainer" containerID="8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681" Jun 09 07:03:54.650494 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.650474 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681"} err="failed to get container status \"8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681\": rpc error: code = NotFound desc = could not find container \"8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681\": container with ID starting with 8671d89deff69ff8822dc87d56300596538069b1f035cdbfecb0498dd7c88681 not found: ID does not exist" Jun 09 07:03:54.653739 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.653719 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 07:03:54.662113 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.662092 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 07:03:54.735069 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735036 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735069 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735072 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brqqt\" (UniqueName: \"kubernetes.io/projected/af916cda-6a97-4f71-bb38-8496080973a5-kube-api-access-brqqt\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735276 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735098 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735276 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735158 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/af916cda-6a97-4f71-bb38-8496080973a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735276 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735209 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af916cda-6a97-4f71-bb38-8496080973a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735276 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735236 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-web-config\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735276 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735273 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735426 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735308 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735426 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735341 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735426 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735368 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735426 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735398 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af916cda-6a97-4f71-bb38-8496080973a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735426 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735419 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af916cda-6a97-4f71-bb38-8496080973a5-config-out\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.735578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.735438 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af916cda-6a97-4f71-bb38-8496080973a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.836457 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.836339 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.836457 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.836401 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brqqt\" (UniqueName: \"kubernetes.io/projected/af916cda-6a97-4f71-bb38-8496080973a5-kube-api-access-brqqt\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.836457 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.836426 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.836457 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.836443 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/af916cda-6a97-4f71-bb38-8496080973a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.836457 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.836461 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af916cda-6a97-4f71-bb38-8496080973a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.836873 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.836479 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-web-config\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.836873 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.836497 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.836873 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.836519 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.837025 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.836919 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.837025 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.836964 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.837124 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.837022 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af916cda-6a97-4f71-bb38-8496080973a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.837124 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.837061 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af916cda-6a97-4f71-bb38-8496080973a5-config-out\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.837124 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.837088 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af916cda-6a97-4f71-bb38-8496080973a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.837335 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.837306 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af916cda-6a97-4f71-bb38-8496080973a5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.838331 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.838299 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af916cda-6a97-4f71-bb38-8496080973a5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.839707 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.839680 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-config-volume\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.839707 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.837026 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/af916cda-6a97-4f71-bb38-8496080973a5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.839883 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.839687 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.839920 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.839883 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-web-config\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.840192 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.840167 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af916cda-6a97-4f71-bb38-8496080973a5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.840303 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.840285 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.840603 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.840582 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.840714 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.840695 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.840929 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.840908 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af916cda-6a97-4f71-bb38-8496080973a5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.841603 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.841588 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af916cda-6a97-4f71-bb38-8496080973a5-config-out\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.844925 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.844907 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brqqt\" (UniqueName: \"kubernetes.io/projected/af916cda-6a97-4f71-bb38-8496080973a5-kube-api-access-brqqt\") pod \"alertmanager-main-0\" (UID: \"af916cda-6a97-4f71-bb38-8496080973a5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:54.955915 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:54.955879 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 07:03:55.092132 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:55.092097 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 07:03:55.094537 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:03:55.094506 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf916cda_6a97_4f71_bb38_8496080973a5.slice/crio-469295fa87d98a0df7c8b63e17355edc07fe2ba745bed90ab80253f09f70152f WatchSource:0}: Error finding container 469295fa87d98a0df7c8b63e17355edc07fe2ba745bed90ab80253f09f70152f: Status 404 returned error can't find the container with id 469295fa87d98a0df7c8b63e17355edc07fe2ba745bed90ab80253f09f70152f Jun 09 07:03:55.470763 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:55.469105 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de398164-a263-4c54-acc3-fa91b7b42f87" path="/var/lib/kubelet/pods/de398164-a263-4c54-acc3-fa91b7b42f87/volumes" Jun 09 07:03:55.594664 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:55.594625 2549 generic.go:356] "Generic (PLEG): container finished" podID="af916cda-6a97-4f71-bb38-8496080973a5" containerID="ac564371d0547275e3ccb3b7d5874b4e7dde07f1736732bbb6a9fb1c30e6f381" exitCode=0 Jun 09 07:03:55.594880 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:55.594711 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af916cda-6a97-4f71-bb38-8496080973a5","Type":"ContainerDied","Data":"ac564371d0547275e3ccb3b7d5874b4e7dde07f1736732bbb6a9fb1c30e6f381"} Jun 09 07:03:55.594880 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:55.594777 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af916cda-6a97-4f71-bb38-8496080973a5","Type":"ContainerStarted","Data":"469295fa87d98a0df7c8b63e17355edc07fe2ba745bed90ab80253f09f70152f"} Jun 09 07:03:56.604501 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:56.604465 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af916cda-6a97-4f71-bb38-8496080973a5","Type":"ContainerStarted","Data":"6cd251a5b8ba7d58860bc6f9318e2fa8a8ee53e66fb26f263411dfd58925782a"} Jun 09 07:03:56.604986 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:56.604529 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af916cda-6a97-4f71-bb38-8496080973a5","Type":"ContainerStarted","Data":"1ae1557c5fb1770bad4122fe285b67f2d92b9dfd2e3cb9de50656ee074cf8995"} Jun 09 07:03:56.604986 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:56.604556 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af916cda-6a97-4f71-bb38-8496080973a5","Type":"ContainerStarted","Data":"acdf7f7787cb1de7083d05f78cdf297d7d7bf2e1634147b33e16e28733f7f4cd"} Jun 09 07:03:56.604986 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:56.604581 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af916cda-6a97-4f71-bb38-8496080973a5","Type":"ContainerStarted","Data":"942c734dda68f5a89660da7b39a90cd2867b4cc770c4f1c711d119d1a0c23fc0"} Jun 09 07:03:56.604986 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:56.604604 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af916cda-6a97-4f71-bb38-8496080973a5","Type":"ContainerStarted","Data":"1ea8d1bc04e7bf9298ac2d62d68cb493c57392165c61d2524a68efa8d2fef6ed"} Jun 09 07:03:56.604986 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:56.604627 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"af916cda-6a97-4f71-bb38-8496080973a5","Type":"ContainerStarted","Data":"df795e7e35b429a20d0e3b447678c23e76c47a5358edadd7eef568ad33f731a0"} Jun 09 07:03:56.630001 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:03:56.629938 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.612962801 podStartE2EDuration="2.62991735s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.954549ms" isStatefulPod=false podCreationTimestamp="2026-06-09 07:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:03:56.62698861 +0000 UTC m=+323.601644156" watchObservedRunningTime="2026-06-09 07:03:56.62991735 +0000 UTC m=+323.604572898" Jun 09 07:04:34.480980 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.480937 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz"] Jun 09 07:04:34.484540 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.484516 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:04:34.487324 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.487303 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 07:04:34.488246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.488232 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 07:04:34.488346 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.488301 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9lbqs\"" Jun 09 07:04:34.494532 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.494510 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz"] Jun 09 07:04:34.566347 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.566309 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:04:34.566540 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.566425 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs95p\" (UniqueName: \"kubernetes.io/projected/530d5dde-ca73-4524-857a-c3d313bc60bd-kube-api-access-gs95p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:04:34.566540 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.566460 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:04:34.667087 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.667054 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:04:34.667239 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.667097 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:04:34.667239 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.667161 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs95p\" (UniqueName: \"kubernetes.io/projected/530d5dde-ca73-4524-857a-c3d313bc60bd-kube-api-access-gs95p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:04:34.667433 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.667414 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:04:34.667470 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.667449 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:04:34.675570 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.675545 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs95p\" (UniqueName: \"kubernetes.io/projected/530d5dde-ca73-4524-857a-c3d313bc60bd-kube-api-access-gs95p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:04:34.794653 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.794554 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:04:34.922515 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.922482 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz"] Jun 09 07:04:34.925841 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:04:34.925807 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530d5dde_ca73_4524_857a_c3d313bc60bd.slice/crio-4ec1a9013afe5ece4ceb5b498f9e8f3d154f5ab6c91d5e6b7f87cd86a2853b9a WatchSource:0}: Error finding container 4ec1a9013afe5ece4ceb5b498f9e8f3d154f5ab6c91d5e6b7f87cd86a2853b9a: Status 404 returned error can't find the container with id 4ec1a9013afe5ece4ceb5b498f9e8f3d154f5ab6c91d5e6b7f87cd86a2853b9a Jun 09 07:04:34.927714 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:34.927694 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 07:04:35.759334 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:35.759293 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" event={"ID":"530d5dde-ca73-4524-857a-c3d313bc60bd","Type":"ContainerStarted","Data":"4ec1a9013afe5ece4ceb5b498f9e8f3d154f5ab6c91d5e6b7f87cd86a2853b9a"} Jun 09 07:04:44.797021 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:44.796984 2549 generic.go:356] "Generic (PLEG): container finished" podID="530d5dde-ca73-4524-857a-c3d313bc60bd" containerID="a5dc961742eb2e60a226dffc1953cc9b0131100fc27d3fc83d01878de106f565" exitCode=0 Jun 09 07:04:44.797417 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:44.797074 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" event={"ID":"530d5dde-ca73-4524-857a-c3d313bc60bd","Type":"ContainerDied","Data":"a5dc961742eb2e60a226dffc1953cc9b0131100fc27d3fc83d01878de106f565"} Jun 09 07:04:45.526819 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.526770 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s"] Jun 09 07:04:45.529561 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.529529 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s" Jun 09 07:04:45.533179 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.533152 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 07:04:45.533179 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.533171 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 07:04:45.533421 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.533171 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jdg7g\"" Jun 09 07:04:45.533421 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.533319 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 07:04:45.533560 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.533489 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 07:04:45.537596 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.537570 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s"] Jun 09 07:04:45.544586 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.544557 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ef07b35-04c8-4872-a1b1-57194481e312-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bfc7dc686-7455s\" (UID: \"6ef07b35-04c8-4872-a1b1-57194481e312\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s" Jun 09 07:04:45.544748 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.544604 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfz9f\" (UniqueName: \"kubernetes.io/projected/6ef07b35-04c8-4872-a1b1-57194481e312-kube-api-access-cfz9f\") pod \"managed-serviceaccount-addon-agent-5bfc7dc686-7455s\" (UID: \"6ef07b35-04c8-4872-a1b1-57194481e312\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s" Jun 09 07:04:45.634246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.634209 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb"] Jun 09 07:04:45.637149 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.637122 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.639828 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.639782 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 07:04:45.639976 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.639920 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 07:04:45.640253 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.640192 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 07:04:45.640368 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.640276 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 07:04:45.645247 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.645222 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ef07b35-04c8-4872-a1b1-57194481e312-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bfc7dc686-7455s\" (UID: \"6ef07b35-04c8-4872-a1b1-57194481e312\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s" Jun 09 07:04:45.645372 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.645262 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.645372 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.645292 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6nd7\" (UniqueName: \"kubernetes.io/projected/790463b3-8ef3-42ac-ac45-7c8460a20517-kube-api-access-m6nd7\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.645372 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.645323 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfz9f\" (UniqueName: \"kubernetes.io/projected/6ef07b35-04c8-4872-a1b1-57194481e312-kube-api-access-cfz9f\") pod \"managed-serviceaccount-addon-agent-5bfc7dc686-7455s\" (UID: \"6ef07b35-04c8-4872-a1b1-57194481e312\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s" Jun 09 07:04:45.645556 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.645533 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-hub\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.645603 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.645573 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/790463b3-8ef3-42ac-ac45-7c8460a20517-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.645650 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.645626 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-ca\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.645704 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.645667 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.649076 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.649039 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ef07b35-04c8-4872-a1b1-57194481e312-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5bfc7dc686-7455s\" (UID: \"6ef07b35-04c8-4872-a1b1-57194481e312\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s" Jun 09 07:04:45.649680 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.649654 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb"] Jun 09 07:04:45.654121 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.654098 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfz9f\" (UniqueName: \"kubernetes.io/projected/6ef07b35-04c8-4872-a1b1-57194481e312-kube-api-access-cfz9f\") pod \"managed-serviceaccount-addon-agent-5bfc7dc686-7455s\" (UID: \"6ef07b35-04c8-4872-a1b1-57194481e312\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s" Jun 09 07:04:45.746252 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.746218 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.746252 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.746255 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6nd7\" (UniqueName: \"kubernetes.io/projected/790463b3-8ef3-42ac-ac45-7c8460a20517-kube-api-access-m6nd7\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.746506 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.746304 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-hub\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.746506 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.746335 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/790463b3-8ef3-42ac-ac45-7c8460a20517-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.746506 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.746379 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-ca\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.746506 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.746425 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.747293 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.747260 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/790463b3-8ef3-42ac-ac45-7c8460a20517-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.749429 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.749320 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.749540 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.749430 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-ca\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.749540 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.749479 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.749540 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.749481 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/790463b3-8ef3-42ac-ac45-7c8460a20517-hub\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.753915 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.753890 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6nd7\" (UniqueName: \"kubernetes.io/projected/790463b3-8ef3-42ac-ac45-7c8460a20517-kube-api-access-m6nd7\") pod \"cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb\" (UID: \"790463b3-8ef3-42ac-ac45-7c8460a20517\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.851556 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.851458 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s" Jun 09 07:04:45.950460 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.950414 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" Jun 09 07:04:45.995627 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:45.995565 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s"] Jun 09 07:04:46.651368 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:04:46.651335 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ef07b35_04c8_4872_a1b1_57194481e312.slice/crio-6f8b1f67c7b13d2e3fd1b9de228f811211d5b33768ba9e1719283abec59bcaa7 WatchSource:0}: Error finding container 6f8b1f67c7b13d2e3fd1b9de228f811211d5b33768ba9e1719283abec59bcaa7: Status 404 returned error can't find the container with id 6f8b1f67c7b13d2e3fd1b9de228f811211d5b33768ba9e1719283abec59bcaa7 Jun 09 07:04:46.797937 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:46.797905 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb"] Jun 09 07:04:46.802398 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:04:46.802365 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod790463b3_8ef3_42ac_ac45_7c8460a20517.slice/crio-89b63a086e2a501a6d119c5b9ca4143de4dc6a9d53dcb1c79596e82295e7c898 WatchSource:0}: Error finding container 89b63a086e2a501a6d119c5b9ca4143de4dc6a9d53dcb1c79596e82295e7c898: Status 404 returned error can't find the container with id 89b63a086e2a501a6d119c5b9ca4143de4dc6a9d53dcb1c79596e82295e7c898 Jun 09 07:04:46.807558 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:46.807525 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s" event={"ID":"6ef07b35-04c8-4872-a1b1-57194481e312","Type":"ContainerStarted","Data":"6f8b1f67c7b13d2e3fd1b9de228f811211d5b33768ba9e1719283abec59bcaa7"} Jun 09 07:04:46.810356 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:46.810326 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" event={"ID":"530d5dde-ca73-4524-857a-c3d313bc60bd","Type":"ContainerStarted","Data":"9585e928a6eeacfadcc0e242923d8d2ec248539a10807b7885d597e5391fd08b"} Jun 09 07:04:47.818131 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:47.818086 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" event={"ID":"790463b3-8ef3-42ac-ac45-7c8460a20517","Type":"ContainerStarted","Data":"89b63a086e2a501a6d119c5b9ca4143de4dc6a9d53dcb1c79596e82295e7c898"} Jun 09 07:04:47.820911 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:47.820865 2549 generic.go:356] "Generic (PLEG): container finished" podID="530d5dde-ca73-4524-857a-c3d313bc60bd" containerID="9585e928a6eeacfadcc0e242923d8d2ec248539a10807b7885d597e5391fd08b" exitCode=0 Jun 09 07:04:47.821115 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:47.820931 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" event={"ID":"530d5dde-ca73-4524-857a-c3d313bc60bd","Type":"ContainerDied","Data":"9585e928a6eeacfadcc0e242923d8d2ec248539a10807b7885d597e5391fd08b"} Jun 09 07:04:49.832069 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:49.832023 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s" event={"ID":"6ef07b35-04c8-4872-a1b1-57194481e312","Type":"ContainerStarted","Data":"3fbbc43897a8367352d7c6218c016611b29faed5df967ab25d34ea6be0288659"} Jun 09 07:04:49.849094 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:49.849033 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5bfc7dc686-7455s" podStartSLOduration=2.248806311 podStartE2EDuration="4.8490136s" totalImagesPullingTime="2.600207289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:04:49.847890866 +0000 UTC m=+376.822546412" watchObservedRunningTime="2026-06-09 07:04:49.8490136 +0000 UTC m=+376.823669144" Jun 09 07:04:50.838245 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:50.838209 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" event={"ID":"790463b3-8ef3-42ac-ac45-7c8460a20517","Type":"ContainerStarted","Data":"9557d793dfc87f8006556c036196b6a090b0936ab2246ed1091d09e017c7f051"} Jun 09 07:04:50.838574 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:50.838254 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" event={"ID":"790463b3-8ef3-42ac-ac45-7c8460a20517","Type":"ContainerStarted","Data":"31cda57ce468aec24048e619871f7615fd51d284bedb508df51b7ce8d80adba3"} Jun 09 07:04:51.843903 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:51.843865 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" event={"ID":"790463b3-8ef3-42ac-ac45-7c8460a20517","Type":"ContainerStarted","Data":"a11f7506333d7e52b6d84f5a3771e399063def4384e85eda9f1165fc6d62e9ce"} Jun 09 07:04:51.861286 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:51.861235 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fb55fcfcb-n9ljb" podStartSLOduration=2.991879863 podStartE2EDuration="6.861219212s" totalImagesPullingTime="3.869339349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:04:51.860272892 +0000 UTC m=+378.834928437" watchObservedRunningTime="2026-06-09 07:04:51.861219212 +0000 UTC m=+378.835874779" Jun 09 07:04:58.874894 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:58.874780 2549 generic.go:356] "Generic (PLEG): container finished" podID="530d5dde-ca73-4524-857a-c3d313bc60bd" containerID="696234929b28f2ce9bb27e0fe2308f12d2dda6dd936171de0dc0abafea389da5" exitCode=0 Jun 09 07:04:58.874894 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:04:58.874877 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" event={"ID":"530d5dde-ca73-4524-857a-c3d313bc60bd","Type":"ContainerDied","Data":"696234929b28f2ce9bb27e0fe2308f12d2dda6dd936171de0dc0abafea389da5"} Jun 09 07:05:00.072650 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.072613 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:05:00.180367 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.180329 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs95p\" (UniqueName: \"kubernetes.io/projected/530d5dde-ca73-4524-857a-c3d313bc60bd-kube-api-access-gs95p\") pod \"530d5dde-ca73-4524-857a-c3d313bc60bd\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " Jun 09 07:05:00.180367 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.180375 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-util\") pod \"530d5dde-ca73-4524-857a-c3d313bc60bd\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " Jun 09 07:05:00.180609 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.180423 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-bundle\") pod \"530d5dde-ca73-4524-857a-c3d313bc60bd\" (UID: \"530d5dde-ca73-4524-857a-c3d313bc60bd\") " Jun 09 07:05:00.181187 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.181164 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-bundle" (OuterVolumeSpecName: "bundle") pod "530d5dde-ca73-4524-857a-c3d313bc60bd" (UID: "530d5dde-ca73-4524-857a-c3d313bc60bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:05:00.182878 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.182861 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530d5dde-ca73-4524-857a-c3d313bc60bd-kube-api-access-gs95p" (OuterVolumeSpecName: "kube-api-access-gs95p") pod "530d5dde-ca73-4524-857a-c3d313bc60bd" (UID: "530d5dde-ca73-4524-857a-c3d313bc60bd"). InnerVolumeSpecName "kube-api-access-gs95p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:05:00.185721 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.185691 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-util" (OuterVolumeSpecName: "util") pod "530d5dde-ca73-4524-857a-c3d313bc60bd" (UID: "530d5dde-ca73-4524-857a-c3d313bc60bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:05:00.281164 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.281129 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-bundle\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:05:00.281164 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.281158 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs95p\" (UniqueName: \"kubernetes.io/projected/530d5dde-ca73-4524-857a-c3d313bc60bd-kube-api-access-gs95p\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:05:00.281164 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.281168 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530d5dde-ca73-4524-857a-c3d313bc60bd-util\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:05:00.884578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.884545 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" Jun 09 07:05:00.884806 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.884537 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45czz" event={"ID":"530d5dde-ca73-4524-857a-c3d313bc60bd","Type":"ContainerDied","Data":"4ec1a9013afe5ece4ceb5b498f9e8f3d154f5ab6c91d5e6b7f87cd86a2853b9a"} Jun 09 07:05:00.884806 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:00.884705 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ec1a9013afe5ece4ceb5b498f9e8f3d154f5ab6c91d5e6b7f87cd86a2853b9a" Jun 09 07:05:14.333633 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.333591 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76"] Jun 09 07:05:14.334232 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.334035 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530d5dde-ca73-4524-857a-c3d313bc60bd" containerName="pull" Jun 09 07:05:14.334232 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.334054 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="530d5dde-ca73-4524-857a-c3d313bc60bd" containerName="pull" Jun 09 07:05:14.334232 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.334074 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530d5dde-ca73-4524-857a-c3d313bc60bd" containerName="extract" Jun 09 07:05:14.334232 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.334082 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="530d5dde-ca73-4524-857a-c3d313bc60bd" containerName="extract" Jun 09 07:05:14.334232 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.334100 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530d5dde-ca73-4524-857a-c3d313bc60bd" containerName="util" Jun 09 07:05:14.334232 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.334110 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="530d5dde-ca73-4524-857a-c3d313bc60bd" containerName="util" Jun 09 07:05:14.334232 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.334197 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="530d5dde-ca73-4524-857a-c3d313bc60bd" containerName="extract" Jun 09 07:05:14.336521 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.336499 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:14.339006 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.338979 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 07:05:14.339129 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.338980 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9lbqs\"" Jun 09 07:05:14.339129 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.338980 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 07:05:14.345453 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.345428 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76"] Jun 09 07:05:14.504827 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.504763 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f6z2\" (UniqueName: \"kubernetes.io/projected/58d38f99-c59c-4288-94df-12faea97fd33-kube-api-access-9f6z2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:14.505007 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.504844 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:14.505007 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.504867 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:14.605998 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.605875 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f6z2\" (UniqueName: \"kubernetes.io/projected/58d38f99-c59c-4288-94df-12faea97fd33-kube-api-access-9f6z2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:14.605998 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.605955 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:14.605998 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.605982 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:14.606372 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.606345 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:14.606445 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.606390 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:14.614518 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.614483 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f6z2\" (UniqueName: \"kubernetes.io/projected/58d38f99-c59c-4288-94df-12faea97fd33-kube-api-access-9f6z2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:14.646510 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.646473 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:14.777083 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.777051 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76"] Jun 09 07:05:14.780248 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:05:14.780218 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d38f99_c59c_4288_94df_12faea97fd33.slice/crio-9a814cca17ea107261549b25e50565108d2a23609f7fa5fcfebf04aa3cad366b WatchSource:0}: Error finding container 9a814cca17ea107261549b25e50565108d2a23609f7fa5fcfebf04aa3cad366b: Status 404 returned error can't find the container with id 9a814cca17ea107261549b25e50565108d2a23609f7fa5fcfebf04aa3cad366b Jun 09 07:05:14.946011 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.945974 2549 generic.go:356] "Generic (PLEG): container finished" podID="58d38f99-c59c-4288-94df-12faea97fd33" containerID="ff463ec5c96928690470359f7ca1e2e378e2d6549d746b7dd2095c206751ddd1" exitCode=0 Jun 09 07:05:14.946179 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.946026 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" event={"ID":"58d38f99-c59c-4288-94df-12faea97fd33","Type":"ContainerDied","Data":"ff463ec5c96928690470359f7ca1e2e378e2d6549d746b7dd2095c206751ddd1"} Jun 09 07:05:14.946179 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:14.946081 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" event={"ID":"58d38f99-c59c-4288-94df-12faea97fd33","Type":"ContainerStarted","Data":"9a814cca17ea107261549b25e50565108d2a23609f7fa5fcfebf04aa3cad366b"} Jun 09 07:05:16.956812 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:16.956762 2549 generic.go:356] "Generic (PLEG): container finished" podID="58d38f99-c59c-4288-94df-12faea97fd33" containerID="9d3321d474ec7eb3c365c742bcc9f678046af9d808573c9d41d494a2ad65ed63" exitCode=0 Jun 09 07:05:16.957279 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:16.956822 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" event={"ID":"58d38f99-c59c-4288-94df-12faea97fd33","Type":"ContainerDied","Data":"9d3321d474ec7eb3c365c742bcc9f678046af9d808573c9d41d494a2ad65ed63"} Jun 09 07:05:17.963733 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:17.963698 2549 generic.go:356] "Generic (PLEG): container finished" podID="58d38f99-c59c-4288-94df-12faea97fd33" containerID="9e0aea790da31a563c9bac2e6acbe2b9aebf2f75526cbe8d5ba438736a8d6011" exitCode=0 Jun 09 07:05:17.964120 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:17.963810 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" event={"ID":"58d38f99-c59c-4288-94df-12faea97fd33","Type":"ContainerDied","Data":"9e0aea790da31a563c9bac2e6acbe2b9aebf2f75526cbe8d5ba438736a8d6011"} Jun 09 07:05:19.092856 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.092827 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:19.248243 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.248145 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-bundle\") pod \"58d38f99-c59c-4288-94df-12faea97fd33\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " Jun 09 07:05:19.248423 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.248275 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f6z2\" (UniqueName: \"kubernetes.io/projected/58d38f99-c59c-4288-94df-12faea97fd33-kube-api-access-9f6z2\") pod \"58d38f99-c59c-4288-94df-12faea97fd33\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " Jun 09 07:05:19.248423 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.248365 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-util\") pod \"58d38f99-c59c-4288-94df-12faea97fd33\" (UID: \"58d38f99-c59c-4288-94df-12faea97fd33\") " Jun 09 07:05:19.248528 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.248490 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-bundle" (OuterVolumeSpecName: "bundle") pod "58d38f99-c59c-4288-94df-12faea97fd33" (UID: "58d38f99-c59c-4288-94df-12faea97fd33"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:05:19.248700 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.248683 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-bundle\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:05:19.250392 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.250367 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d38f99-c59c-4288-94df-12faea97fd33-kube-api-access-9f6z2" (OuterVolumeSpecName: "kube-api-access-9f6z2") pod "58d38f99-c59c-4288-94df-12faea97fd33" (UID: "58d38f99-c59c-4288-94df-12faea97fd33"). InnerVolumeSpecName "kube-api-access-9f6z2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:05:19.254389 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.254361 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-util" (OuterVolumeSpecName: "util") pod "58d38f99-c59c-4288-94df-12faea97fd33" (UID: "58d38f99-c59c-4288-94df-12faea97fd33"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:05:19.349340 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.349303 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58d38f99-c59c-4288-94df-12faea97fd33-util\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:05:19.349340 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.349334 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f6z2\" (UniqueName: \"kubernetes.io/projected/58d38f99-c59c-4288-94df-12faea97fd33-kube-api-access-9f6z2\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:05:19.973369 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.973339 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" Jun 09 07:05:19.973542 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.973345 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvgm76" event={"ID":"58d38f99-c59c-4288-94df-12faea97fd33","Type":"ContainerDied","Data":"9a814cca17ea107261549b25e50565108d2a23609f7fa5fcfebf04aa3cad366b"} Jun 09 07:05:19.973542 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:19.973456 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a814cca17ea107261549b25e50565108d2a23609f7fa5fcfebf04aa3cad366b" Jun 09 07:05:31.182845 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.182807 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf"] Jun 09 07:05:31.183246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.183119 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d38f99-c59c-4288-94df-12faea97fd33" containerName="pull" Jun 09 07:05:31.183246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.183130 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d38f99-c59c-4288-94df-12faea97fd33" containerName="pull" Jun 09 07:05:31.183246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.183140 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d38f99-c59c-4288-94df-12faea97fd33" containerName="util" Jun 09 07:05:31.183246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.183146 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d38f99-c59c-4288-94df-12faea97fd33" containerName="util" Jun 09 07:05:31.183246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.183154 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58d38f99-c59c-4288-94df-12faea97fd33" containerName="extract" Jun 09 07:05:31.183246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.183160 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="58d38f99-c59c-4288-94df-12faea97fd33" containerName="extract" Jun 09 07:05:31.183246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.183214 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="58d38f99-c59c-4288-94df-12faea97fd33" containerName="extract" Jun 09 07:05:31.186094 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.186073 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:31.188911 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.188891 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 07:05:31.189035 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.188950 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 07:05:31.189943 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.189920 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9lbqs\"" Jun 09 07:05:31.196520 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.196486 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf"] Jun 09 07:05:31.249902 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.249847 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:31.249902 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.249889 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:31.250212 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.250017 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsx5f\" (UniqueName: \"kubernetes.io/projected/ed03350c-9410-46f8-9be4-0245afda0e6c-kube-api-access-jsx5f\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:31.351091 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.351057 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsx5f\" (UniqueName: \"kubernetes.io/projected/ed03350c-9410-46f8-9be4-0245afda0e6c-kube-api-access-jsx5f\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:31.351252 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.351110 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:31.351252 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.351132 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:31.351563 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.351540 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:31.351618 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.351551 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:31.359156 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.359131 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsx5f\" (UniqueName: \"kubernetes.io/projected/ed03350c-9410-46f8-9be4-0245afda0e6c-kube-api-access-jsx5f\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:31.496734 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.496635 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:31.629892 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:31.629719 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf"] Jun 09 07:05:31.633030 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:05:31.632991 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded03350c_9410_46f8_9be4_0245afda0e6c.slice/crio-8ca0d3649be3f6fb1afcfa69f67dcac258b3b37b612ece7712012f36cb60196f WatchSource:0}: Error finding container 8ca0d3649be3f6fb1afcfa69f67dcac258b3b37b612ece7712012f36cb60196f: Status 404 returned error can't find the container with id 8ca0d3649be3f6fb1afcfa69f67dcac258b3b37b612ece7712012f36cb60196f Jun 09 07:05:32.022611 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:32.022570 2549 generic.go:356] "Generic (PLEG): container finished" podID="ed03350c-9410-46f8-9be4-0245afda0e6c" containerID="c898b08430b4d24424044a1ea544fd160df8788ad5689af79b2c2b92e0f88134" exitCode=0 Jun 09 07:05:32.022928 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:32.022662 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" event={"ID":"ed03350c-9410-46f8-9be4-0245afda0e6c","Type":"ContainerDied","Data":"c898b08430b4d24424044a1ea544fd160df8788ad5689af79b2c2b92e0f88134"} Jun 09 07:05:32.022928 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:32.022745 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" event={"ID":"ed03350c-9410-46f8-9be4-0245afda0e6c","Type":"ContainerStarted","Data":"8ca0d3649be3f6fb1afcfa69f67dcac258b3b37b612ece7712012f36cb60196f"} Jun 09 07:05:33.028500 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:33.028410 2549 generic.go:356] "Generic (PLEG): container finished" podID="ed03350c-9410-46f8-9be4-0245afda0e6c" containerID="828e7cc932013107eed0ef50c797bf46098c0e0cd9bc0dc3359a882474e790ae" exitCode=0 Jun 09 07:05:33.028500 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:33.028487 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" event={"ID":"ed03350c-9410-46f8-9be4-0245afda0e6c","Type":"ContainerDied","Data":"828e7cc932013107eed0ef50c797bf46098c0e0cd9bc0dc3359a882474e790ae"} Jun 09 07:05:34.034477 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:34.034436 2549 generic.go:356] "Generic (PLEG): container finished" podID="ed03350c-9410-46f8-9be4-0245afda0e6c" containerID="55a44291953fc650d3552d34bd7e86c469676e72fa43fbeea90fa5c7efa9d746" exitCode=0 Jun 09 07:05:34.034871 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:34.034518 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" event={"ID":"ed03350c-9410-46f8-9be4-0245afda0e6c","Type":"ContainerDied","Data":"55a44291953fc650d3552d34bd7e86c469676e72fa43fbeea90fa5c7efa9d746"} Jun 09 07:05:35.164618 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:35.164592 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:35.187848 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:35.187812 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-bundle\") pod \"ed03350c-9410-46f8-9be4-0245afda0e6c\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " Jun 09 07:05:35.187848 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:35.187866 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-util\") pod \"ed03350c-9410-46f8-9be4-0245afda0e6c\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " Jun 09 07:05:35.188103 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:35.187921 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsx5f\" (UniqueName: \"kubernetes.io/projected/ed03350c-9410-46f8-9be4-0245afda0e6c-kube-api-access-jsx5f\") pod \"ed03350c-9410-46f8-9be4-0245afda0e6c\" (UID: \"ed03350c-9410-46f8-9be4-0245afda0e6c\") " Jun 09 07:05:35.188723 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:35.188669 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-bundle" (OuterVolumeSpecName: "bundle") pod "ed03350c-9410-46f8-9be4-0245afda0e6c" (UID: "ed03350c-9410-46f8-9be4-0245afda0e6c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:05:35.190668 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:35.190633 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed03350c-9410-46f8-9be4-0245afda0e6c-kube-api-access-jsx5f" (OuterVolumeSpecName: "kube-api-access-jsx5f") pod "ed03350c-9410-46f8-9be4-0245afda0e6c" (UID: "ed03350c-9410-46f8-9be4-0245afda0e6c"). InnerVolumeSpecName "kube-api-access-jsx5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:05:35.197145 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:35.197105 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-util" (OuterVolumeSpecName: "util") pod "ed03350c-9410-46f8-9be4-0245afda0e6c" (UID: "ed03350c-9410-46f8-9be4-0245afda0e6c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:05:35.289357 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:35.289255 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-bundle\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:05:35.289357 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:35.289296 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed03350c-9410-46f8-9be4-0245afda0e6c-util\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:05:35.289590 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:35.289307 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsx5f\" (UniqueName: \"kubernetes.io/projected/ed03350c-9410-46f8-9be4-0245afda0e6c-kube-api-access-jsx5f\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:05:36.044395 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:36.044366 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" Jun 09 07:05:36.044395 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:36.044377 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbwkxf" event={"ID":"ed03350c-9410-46f8-9be4-0245afda0e6c","Type":"ContainerDied","Data":"8ca0d3649be3f6fb1afcfa69f67dcac258b3b37b612ece7712012f36cb60196f"} Jun 09 07:05:36.044610 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:36.044431 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ca0d3649be3f6fb1afcfa69f67dcac258b3b37b612ece7712012f36cb60196f" Jun 09 07:05:45.683746 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.683674 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb"] Jun 09 07:05:45.684220 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.684004 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed03350c-9410-46f8-9be4-0245afda0e6c" containerName="extract" Jun 09 07:05:45.684220 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.684018 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed03350c-9410-46f8-9be4-0245afda0e6c" containerName="extract" Jun 09 07:05:45.684220 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.684036 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed03350c-9410-46f8-9be4-0245afda0e6c" containerName="pull" Jun 09 07:05:45.684220 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.684041 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed03350c-9410-46f8-9be4-0245afda0e6c" containerName="pull" Jun 09 07:05:45.684220 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.684064 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed03350c-9410-46f8-9be4-0245afda0e6c" containerName="util" Jun 09 07:05:45.684220 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.684069 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed03350c-9410-46f8-9be4-0245afda0e6c" containerName="util" Jun 09 07:05:45.684220 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.684123 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed03350c-9410-46f8-9be4-0245afda0e6c" containerName="extract" Jun 09 07:05:45.686238 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.686221 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.689598 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.689578 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 07:05:45.690981 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.690963 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 07:05:45.691160 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.691134 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h92lg\"" Jun 09 07:05:45.691727 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.691714 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 07:05:45.692400 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.692382 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 07:05:45.722203 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.722167 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb"] Jun 09 07:05:45.771447 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.771413 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-manifests\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.771447 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.771455 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhg6h\" (UniqueName: \"kubernetes.io/projected/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-kube-api-access-hhg6h\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.771735 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.771485 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-webhook-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.771735 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.771513 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-tmp\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.771735 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.771616 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.872658 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.872616 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-manifests\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.872902 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.872670 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhg6h\" (UniqueName: \"kubernetes.io/projected/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-kube-api-access-hhg6h\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.872902 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.872695 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-webhook-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.872902 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.872726 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-tmp\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.872902 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.872771 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.873128 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.873037 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-manifests\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.875018 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.874992 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-tmp\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.875125 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.875082 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.875125 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.875113 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-webhook-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.883186 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.883162 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhg6h\" (UniqueName: \"kubernetes.io/projected/78d7d9b1-2ace-4ef0-8fa1-a520bf059d62-kube-api-access-hhg6h\") pod \"opendatahub-operator-controller-manager-579b94c545-8qhkb\" (UID: \"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:45.997448 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:45.997356 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:46.138178 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:46.138085 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb"] Jun 09 07:05:46.140656 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:05:46.140625 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d7d9b1_2ace_4ef0_8fa1_a520bf059d62.slice/crio-1029e3c78275393ccc323127cff99ad54c5ced189ffb44423afd1d1f316c3253 WatchSource:0}: Error finding container 1029e3c78275393ccc323127cff99ad54c5ced189ffb44423afd1d1f316c3253: Status 404 returned error can't find the container with id 1029e3c78275393ccc323127cff99ad54c5ced189ffb44423afd1d1f316c3253 Jun 09 07:05:47.090966 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:47.090926 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" event={"ID":"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62","Type":"ContainerStarted","Data":"1029e3c78275393ccc323127cff99ad54c5ced189ffb44423afd1d1f316c3253"} Jun 09 07:05:49.101781 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:49.101743 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" event={"ID":"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62","Type":"ContainerStarted","Data":"e95b44461e62b33ca952c552ac536876350729e2a98fa27d65da0910335118fc"} Jun 09 07:05:50.107806 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:50.107754 2549 generic.go:356] "Generic (PLEG): container finished" podID="78d7d9b1-2ace-4ef0-8fa1-a520bf059d62" containerID="e95b44461e62b33ca952c552ac536876350729e2a98fa27d65da0910335118fc" exitCode=0 Jun 09 07:05:50.108204 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:50.107813 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" event={"ID":"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62","Type":"ContainerDied","Data":"e95b44461e62b33ca952c552ac536876350729e2a98fa27d65da0910335118fc"} Jun 09 07:05:51.115368 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:51.115326 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" event={"ID":"78d7d9b1-2ace-4ef0-8fa1-a520bf059d62","Type":"ContainerStarted","Data":"630fbbaa77d4bbf4a3a9fe8bd608ac51c88c58b423b277f66948c9b4ea46dd8a"} Jun 09 07:05:51.115762 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:51.115507 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:05:51.136539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:05:51.136484 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" podStartSLOduration=1.873263111 podStartE2EDuration="6.136468203s" totalImagesPullingTime="3.198619378s" totalInitContainerRuntime="1.064585714s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:05:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:05:51.134297462 +0000 UTC m=+438.108953031" watchObservedRunningTime="2026-06-09 07:05:51.136468203 +0000 UTC m=+438.111123748" Jun 09 07:06:02.122765 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:02.122732 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-8qhkb" Jun 09 07:06:04.289780 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.289717 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng"] Jun 09 07:06:04.299956 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.299922 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.304579 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.304555 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 07:06:04.304985 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.304961 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g9bbb\"" Jun 09 07:06:04.304985 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.304987 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 07:06:04.305149 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.304987 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 07:06:04.305149 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.304971 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 07:06:04.305149 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.305033 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 07:06:04.317230 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.317202 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng"] Jun 09 07:06:04.430642 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.430604 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37177d7a-ee8b-44a8-8330-5b42be2fb37a-manager-config\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.430833 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.430652 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37177d7a-ee8b-44a8-8330-5b42be2fb37a-metrics-cert\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.430833 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.430743 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smfq5\" (UniqueName: \"kubernetes.io/projected/37177d7a-ee8b-44a8-8330-5b42be2fb37a-kube-api-access-smfq5\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.430936 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.430869 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37177d7a-ee8b-44a8-8330-5b42be2fb37a-cert\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.531937 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.531899 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37177d7a-ee8b-44a8-8330-5b42be2fb37a-manager-config\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.531937 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.531943 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37177d7a-ee8b-44a8-8330-5b42be2fb37a-metrics-cert\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.532181 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.531975 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smfq5\" (UniqueName: \"kubernetes.io/projected/37177d7a-ee8b-44a8-8330-5b42be2fb37a-kube-api-access-smfq5\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.532181 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.532024 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37177d7a-ee8b-44a8-8330-5b42be2fb37a-cert\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.532953 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.532923 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37177d7a-ee8b-44a8-8330-5b42be2fb37a-manager-config\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.534676 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.534649 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37177d7a-ee8b-44a8-8330-5b42be2fb37a-cert\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.534805 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.534653 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37177d7a-ee8b-44a8-8330-5b42be2fb37a-metrics-cert\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.555115 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.555052 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smfq5\" (UniqueName: \"kubernetes.io/projected/37177d7a-ee8b-44a8-8330-5b42be2fb37a-kube-api-access-smfq5\") pod \"lws-controller-manager-d96c9b794-g8jng\" (UID: \"37177d7a-ee8b-44a8-8330-5b42be2fb37a\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.610151 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.610103 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:04.872061 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:04.871933 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng"] Jun 09 07:06:04.877180 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:06:04.877149 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37177d7a_ee8b_44a8_8330_5b42be2fb37a.slice/crio-a0dd151665d1af0051955ba1c47cf98a5747570ab08f2c98c624c6df14aec472 WatchSource:0}: Error finding container a0dd151665d1af0051955ba1c47cf98a5747570ab08f2c98c624c6df14aec472: Status 404 returned error can't find the container with id a0dd151665d1af0051955ba1c47cf98a5747570ab08f2c98c624c6df14aec472 Jun 09 07:06:05.181636 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:05.181591 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" event={"ID":"37177d7a-ee8b-44a8-8330-5b42be2fb37a","Type":"ContainerStarted","Data":"a0dd151665d1af0051955ba1c47cf98a5747570ab08f2c98c624c6df14aec472"} Jun 09 07:06:07.195578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.195541 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" event={"ID":"37177d7a-ee8b-44a8-8330-5b42be2fb37a","Type":"ContainerStarted","Data":"260cb0100749d83829f60e957834a17d2a54a2e8912a403fbfcd1033c1a89328"} Jun 09 07:06:07.196008 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.195616 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:07.228985 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.228928 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" podStartSLOduration=1.682743361 podStartE2EDuration="3.228910303s" totalImagesPullingTime="1.546166942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:06:07.22787596 +0000 UTC m=+454.202531506" watchObservedRunningTime="2026-06-09 07:06:07.228910303 +0000 UTC m=+454.203565847" Jun 09 07:06:07.266131 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.266096 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq"] Jun 09 07:06:07.270503 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.270482 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:07.273216 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.273189 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 07:06:07.273412 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.273397 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9lbqs\"" Jun 09 07:06:07.273476 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.273422 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 07:06:07.282048 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.282020 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq"] Jun 09 07:06:07.359539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.359498 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:07.359761 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.359614 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:07.359761 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.359641 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b79nl\" (UniqueName: \"kubernetes.io/projected/d1e7a5c1-44cf-426e-9cd7-dc932703174c-kube-api-access-b79nl\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:07.461104 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.460997 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:07.461104 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.461052 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b79nl\" (UniqueName: \"kubernetes.io/projected/d1e7a5c1-44cf-426e-9cd7-dc932703174c-kube-api-access-b79nl\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:07.461331 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.461177 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:07.461480 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.461459 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:07.461539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.461467 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:07.471194 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.471157 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b79nl\" (UniqueName: \"kubernetes.io/projected/d1e7a5c1-44cf-426e-9cd7-dc932703174c-kube-api-access-b79nl\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:07.582320 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.582284 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:07.768446 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:07.768410 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq"] Jun 09 07:06:07.772204 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:06:07.772165 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e7a5c1_44cf_426e_9cd7_dc932703174c.slice/crio-88099aae7c3392d3dd02dc4def00971b61913ca947b70f8b343ff80ac92ae659 WatchSource:0}: Error finding container 88099aae7c3392d3dd02dc4def00971b61913ca947b70f8b343ff80ac92ae659: Status 404 returned error can't find the container with id 88099aae7c3392d3dd02dc4def00971b61913ca947b70f8b343ff80ac92ae659 Jun 09 07:06:08.202012 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:08.201975 2549 generic.go:356] "Generic (PLEG): container finished" podID="d1e7a5c1-44cf-426e-9cd7-dc932703174c" containerID="859e8ab1c2e29ddbbe5c157a8dcbb505930e9ca17d02a91a79a2c324eb46a41c" exitCode=0 Jun 09 07:06:08.202446 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:08.202068 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" event={"ID":"d1e7a5c1-44cf-426e-9cd7-dc932703174c","Type":"ContainerDied","Data":"859e8ab1c2e29ddbbe5c157a8dcbb505930e9ca17d02a91a79a2c324eb46a41c"} Jun 09 07:06:08.202446 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:08.202136 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" event={"ID":"d1e7a5c1-44cf-426e-9cd7-dc932703174c","Type":"ContainerStarted","Data":"88099aae7c3392d3dd02dc4def00971b61913ca947b70f8b343ff80ac92ae659"} Jun 09 07:06:09.208904 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:09.208870 2549 generic.go:356] "Generic (PLEG): container finished" podID="d1e7a5c1-44cf-426e-9cd7-dc932703174c" containerID="22fd79d16a00c14906f65a62b9c14994eb2829dd56f326b37f53cdeb3eb90dc7" exitCode=0 Jun 09 07:06:09.209372 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:09.208954 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" event={"ID":"d1e7a5c1-44cf-426e-9cd7-dc932703174c","Type":"ContainerDied","Data":"22fd79d16a00c14906f65a62b9c14994eb2829dd56f326b37f53cdeb3eb90dc7"} Jun 09 07:06:10.215807 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:10.215761 2549 generic.go:356] "Generic (PLEG): container finished" podID="d1e7a5c1-44cf-426e-9cd7-dc932703174c" containerID="690d9984c818dbbf8cbdd0b76efbda10915ea8de0073eea41c319cb1ad5e6a4e" exitCode=0 Jun 09 07:06:10.216196 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:10.215844 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" event={"ID":"d1e7a5c1-44cf-426e-9cd7-dc932703174c","Type":"ContainerDied","Data":"690d9984c818dbbf8cbdd0b76efbda10915ea8de0073eea41c319cb1ad5e6a4e"} Jun 09 07:06:11.354452 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:11.354428 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:11.496119 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:11.496087 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-util\") pod \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " Jun 09 07:06:11.496236 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:11.496158 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b79nl\" (UniqueName: \"kubernetes.io/projected/d1e7a5c1-44cf-426e-9cd7-dc932703174c-kube-api-access-b79nl\") pod \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " Jun 09 07:06:11.496236 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:11.496212 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-bundle\") pod \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\" (UID: \"d1e7a5c1-44cf-426e-9cd7-dc932703174c\") " Jun 09 07:06:11.497091 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:11.497061 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-bundle" (OuterVolumeSpecName: "bundle") pod "d1e7a5c1-44cf-426e-9cd7-dc932703174c" (UID: "d1e7a5c1-44cf-426e-9cd7-dc932703174c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:06:11.498314 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:11.498291 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e7a5c1-44cf-426e-9cd7-dc932703174c-kube-api-access-b79nl" (OuterVolumeSpecName: "kube-api-access-b79nl") pod "d1e7a5c1-44cf-426e-9cd7-dc932703174c" (UID: "d1e7a5c1-44cf-426e-9cd7-dc932703174c"). InnerVolumeSpecName "kube-api-access-b79nl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:06:11.505107 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:11.505075 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-util" (OuterVolumeSpecName: "util") pod "d1e7a5c1-44cf-426e-9cd7-dc932703174c" (UID: "d1e7a5c1-44cf-426e-9cd7-dc932703174c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:06:11.597161 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:11.597117 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-bundle\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:06:11.597161 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:11.597157 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a5c1-44cf-426e-9cd7-dc932703174c-util\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:06:11.597161 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:11.597171 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b79nl\" (UniqueName: \"kubernetes.io/projected/d1e7a5c1-44cf-426e-9cd7-dc932703174c-kube-api-access-b79nl\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:06:12.227149 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:12.227123 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" Jun 09 07:06:12.227331 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:12.227153 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06spxcq" event={"ID":"d1e7a5c1-44cf-426e-9cd7-dc932703174c","Type":"ContainerDied","Data":"88099aae7c3392d3dd02dc4def00971b61913ca947b70f8b343ff80ac92ae659"} Jun 09 07:06:12.227331 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:12.227199 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88099aae7c3392d3dd02dc4def00971b61913ca947b70f8b343ff80ac92ae659" Jun 09 07:06:18.204638 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:18.204606 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-g8jng" Jun 09 07:06:20.717095 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.717056 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v"] Jun 09 07:06:20.717487 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.717407 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e7a5c1-44cf-426e-9cd7-dc932703174c" containerName="util" Jun 09 07:06:20.717487 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.717419 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e7a5c1-44cf-426e-9cd7-dc932703174c" containerName="util" Jun 09 07:06:20.717487 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.717430 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e7a5c1-44cf-426e-9cd7-dc932703174c" containerName="pull" Jun 09 07:06:20.717487 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.717436 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e7a5c1-44cf-426e-9cd7-dc932703174c" containerName="pull" Jun 09 07:06:20.717487 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.717445 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e7a5c1-44cf-426e-9cd7-dc932703174c" containerName="extract" Jun 09 07:06:20.717487 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.717451 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e7a5c1-44cf-426e-9cd7-dc932703174c" containerName="extract" Jun 09 07:06:20.717678 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.717504 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e7a5c1-44cf-426e-9cd7-dc932703174c" containerName="extract" Jun 09 07:06:20.720194 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.720177 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:20.729917 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.729889 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 07:06:20.730076 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.729889 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 07:06:20.731036 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.731016 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9lbqs\"" Jun 09 07:06:20.767441 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.767397 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v"] Jun 09 07:06:20.782956 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.782921 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:20.783132 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.782983 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:20.783132 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.783099 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lbc2\" (UniqueName: \"kubernetes.io/projected/9e69b3c5-735c-42e4-87d3-cfcb98450829-kube-api-access-7lbc2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:20.883643 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.883601 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lbc2\" (UniqueName: \"kubernetes.io/projected/9e69b3c5-735c-42e4-87d3-cfcb98450829-kube-api-access-7lbc2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:20.883874 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.883675 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:20.883874 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.883719 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:20.884101 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.884065 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:20.884173 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.884112 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:20.900296 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:20.900260 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lbc2\" (UniqueName: \"kubernetes.io/projected/9e69b3c5-735c-42e4-87d3-cfcb98450829-kube-api-access-7lbc2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:21.031287 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.031198 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:21.189040 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.188892 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v"] Jun 09 07:06:21.192455 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:06:21.192417 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e69b3c5_735c_42e4_87d3_cfcb98450829.slice/crio-588a654e94eb00466bb9c2461718d527dba955f3484d011868f77670bed0ecf8 WatchSource:0}: Error finding container 588a654e94eb00466bb9c2461718d527dba955f3484d011868f77670bed0ecf8: Status 404 returned error can't find the container with id 588a654e94eb00466bb9c2461718d527dba955f3484d011868f77670bed0ecf8 Jun 09 07:06:21.271530 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.271478 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" event={"ID":"9e69b3c5-735c-42e4-87d3-cfcb98450829","Type":"ContainerStarted","Data":"92d78342452aa019fe4e39a7ea3734cfc616917741130597021e78c6aaaf6472"} Jun 09 07:06:21.271726 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.271556 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" event={"ID":"9e69b3c5-735c-42e4-87d3-cfcb98450829","Type":"ContainerStarted","Data":"588a654e94eb00466bb9c2461718d527dba955f3484d011868f77670bed0ecf8"} Jun 09 07:06:21.782987 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.782955 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-797c685dfd-fjqbk"] Jun 09 07:06:21.786083 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.786059 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-797c685dfd-fjqbk" Jun 09 07:06:21.788728 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.788697 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tj9pd\"" Jun 09 07:06:21.788870 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.788697 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 07:06:21.791833 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.791781 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4jlr\" (UniqueName: \"kubernetes.io/projected/03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080-kube-api-access-d4jlr\") pod \"dashboard-redirect-797c685dfd-fjqbk\" (UID: \"03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080\") " pod="opendatahub/dashboard-redirect-797c685dfd-fjqbk" Jun 09 07:06:21.791963 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.791924 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080-redirect-config\") pod \"dashboard-redirect-797c685dfd-fjqbk\" (UID: \"03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080\") " pod="opendatahub/dashboard-redirect-797c685dfd-fjqbk" Jun 09 07:06:21.803588 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.803555 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-797c685dfd-fjqbk"] Jun 09 07:06:21.892395 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.892354 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4jlr\" (UniqueName: \"kubernetes.io/projected/03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080-kube-api-access-d4jlr\") pod \"dashboard-redirect-797c685dfd-fjqbk\" (UID: \"03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080\") " pod="opendatahub/dashboard-redirect-797c685dfd-fjqbk" Jun 09 07:06:21.892584 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.892439 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080-redirect-config\") pod \"dashboard-redirect-797c685dfd-fjqbk\" (UID: \"03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080\") " pod="opendatahub/dashboard-redirect-797c685dfd-fjqbk" Jun 09 07:06:21.893208 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.893190 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080-redirect-config\") pod \"dashboard-redirect-797c685dfd-fjqbk\" (UID: \"03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080\") " pod="opendatahub/dashboard-redirect-797c685dfd-fjqbk" Jun 09 07:06:21.901622 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:21.901596 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4jlr\" (UniqueName: \"kubernetes.io/projected/03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080-kube-api-access-d4jlr\") pod \"dashboard-redirect-797c685dfd-fjqbk\" (UID: \"03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080\") " pod="opendatahub/dashboard-redirect-797c685dfd-fjqbk" Jun 09 07:06:22.097122 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:22.097014 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-797c685dfd-fjqbk" Jun 09 07:06:22.239160 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:22.239132 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-797c685dfd-fjqbk"] Jun 09 07:06:22.241543 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:06:22.241513 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e10bb1_aaf0_41ea_bdb1_e6fd36ee0080.slice/crio-99f71ba6b8658677cf236c96c7e493fbd8bf0653eaf1f9f41a6e725fd7ada53b WatchSource:0}: Error finding container 99f71ba6b8658677cf236c96c7e493fbd8bf0653eaf1f9f41a6e725fd7ada53b: Status 404 returned error can't find the container with id 99f71ba6b8658677cf236c96c7e493fbd8bf0653eaf1f9f41a6e725fd7ada53b Jun 09 07:06:22.277656 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:22.277619 2549 generic.go:356] "Generic (PLEG): container finished" podID="9e69b3c5-735c-42e4-87d3-cfcb98450829" containerID="92d78342452aa019fe4e39a7ea3734cfc616917741130597021e78c6aaaf6472" exitCode=0 Jun 09 07:06:22.277876 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:22.277704 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" event={"ID":"9e69b3c5-735c-42e4-87d3-cfcb98450829","Type":"ContainerDied","Data":"92d78342452aa019fe4e39a7ea3734cfc616917741130597021e78c6aaaf6472"} Jun 09 07:06:22.278983 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:22.278963 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-797c685dfd-fjqbk" event={"ID":"03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080","Type":"ContainerStarted","Data":"99f71ba6b8658677cf236c96c7e493fbd8bf0653eaf1f9f41a6e725fd7ada53b"} Jun 09 07:06:24.292113 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:24.292071 2549 generic.go:356] "Generic (PLEG): container finished" podID="9e69b3c5-735c-42e4-87d3-cfcb98450829" containerID="726c5df10da80b0f8d8cf99a7736653811d61eb83a93e0d5e4df750657e1a4e1" exitCode=0 Jun 09 07:06:24.292572 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:24.292135 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" event={"ID":"9e69b3c5-735c-42e4-87d3-cfcb98450829","Type":"ContainerDied","Data":"726c5df10da80b0f8d8cf99a7736653811d61eb83a93e0d5e4df750657e1a4e1"} Jun 09 07:06:25.299002 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:25.298964 2549 generic.go:356] "Generic (PLEG): container finished" podID="9e69b3c5-735c-42e4-87d3-cfcb98450829" containerID="781947b37ce08e3b632a491ccf674d18430c83069643238364f2484de1c954b0" exitCode=0 Jun 09 07:06:25.299472 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:25.299049 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" event={"ID":"9e69b3c5-735c-42e4-87d3-cfcb98450829","Type":"ContainerDied","Data":"781947b37ce08e3b632a491ccf674d18430c83069643238364f2484de1c954b0"} Jun 09 07:06:25.300511 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:25.300487 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-797c685dfd-fjqbk" event={"ID":"03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080","Type":"ContainerStarted","Data":"9bbe8fcef75b3247284cb3652392b9a84cb17466dab39ee7b7503e8f2653b741"} Jun 09 07:06:25.336572 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:25.336522 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-797c685dfd-fjqbk" podStartSLOduration=2.036490233 podStartE2EDuration="4.336507424s" totalImagesPullingTime="2.300017191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:06:25.335710619 +0000 UTC m=+472.310366165" watchObservedRunningTime="2026-06-09 07:06:25.336507424 +0000 UTC m=+472.311162984" Jun 09 07:06:26.436261 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:26.436231 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:26.537480 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:26.537443 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lbc2\" (UniqueName: \"kubernetes.io/projected/9e69b3c5-735c-42e4-87d3-cfcb98450829-kube-api-access-7lbc2\") pod \"9e69b3c5-735c-42e4-87d3-cfcb98450829\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " Jun 09 07:06:26.537680 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:26.537509 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-util\") pod \"9e69b3c5-735c-42e4-87d3-cfcb98450829\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " Jun 09 07:06:26.537680 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:26.537543 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-bundle\") pod \"9e69b3c5-735c-42e4-87d3-cfcb98450829\" (UID: \"9e69b3c5-735c-42e4-87d3-cfcb98450829\") " Jun 09 07:06:26.538432 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:26.538397 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-bundle" (OuterVolumeSpecName: "bundle") pod "9e69b3c5-735c-42e4-87d3-cfcb98450829" (UID: "9e69b3c5-735c-42e4-87d3-cfcb98450829"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:06:26.539609 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:26.539586 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e69b3c5-735c-42e4-87d3-cfcb98450829-kube-api-access-7lbc2" (OuterVolumeSpecName: "kube-api-access-7lbc2") pod "9e69b3c5-735c-42e4-87d3-cfcb98450829" (UID: "9e69b3c5-735c-42e4-87d3-cfcb98450829"). InnerVolumeSpecName "kube-api-access-7lbc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:06:26.541996 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:26.541972 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-util" (OuterVolumeSpecName: "util") pod "9e69b3c5-735c-42e4-87d3-cfcb98450829" (UID: "9e69b3c5-735c-42e4-87d3-cfcb98450829"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:06:26.638381 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:26.638281 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-util\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:06:26.638381 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:26.638315 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9e69b3c5-735c-42e4-87d3-cfcb98450829-bundle\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:06:26.638381 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:26.638327 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lbc2\" (UniqueName: \"kubernetes.io/projected/9e69b3c5-735c-42e4-87d3-cfcb98450829-kube-api-access-7lbc2\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:06:27.312440 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:27.312407 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" Jun 09 07:06:27.312592 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:27.312407 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2kk5v" event={"ID":"9e69b3c5-735c-42e4-87d3-cfcb98450829","Type":"ContainerDied","Data":"588a654e94eb00466bb9c2461718d527dba955f3484d011868f77670bed0ecf8"} Jun 09 07:06:27.312592 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:27.312534 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="588a654e94eb00466bb9c2461718d527dba955f3484d011868f77670bed0ecf8" Jun 09 07:06:40.990198 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.990162 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df"] Jun 09 07:06:40.990636 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.990554 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e69b3c5-735c-42e4-87d3-cfcb98450829" containerName="util" Jun 09 07:06:40.990636 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.990567 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e69b3c5-735c-42e4-87d3-cfcb98450829" containerName="util" Jun 09 07:06:40.990636 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.990582 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e69b3c5-735c-42e4-87d3-cfcb98450829" containerName="pull" Jun 09 07:06:40.990636 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.990588 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e69b3c5-735c-42e4-87d3-cfcb98450829" containerName="pull" Jun 09 07:06:40.990636 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.990595 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e69b3c5-735c-42e4-87d3-cfcb98450829" containerName="extract" Jun 09 07:06:40.990636 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.990601 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e69b3c5-735c-42e4-87d3-cfcb98450829" containerName="extract" Jun 09 07:06:40.990873 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.990655 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e69b3c5-735c-42e4-87d3-cfcb98450829" containerName="extract" Jun 09 07:06:40.992986 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.992968 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:40.995472 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.995447 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 07:06:40.995643 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.995513 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 07:06:40.995643 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.995568 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 07:06:40.995643 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:40.995573 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qhfws\"" Jun 09 07:06:41.004407 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.004381 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df"] Jun 09 07:06:41.065686 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.065651 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.065686 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.065696 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.065967 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.065726 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.065967 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.065775 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.065967 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.065808 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.065967 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.065853 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.065967 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.065879 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.065967 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.065908 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.066189 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.065983 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxp9k\" (UniqueName: \"kubernetes.io/projected/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-kube-api-access-sxp9k\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.166868 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.166835 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167063 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.166886 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxp9k\" (UniqueName: \"kubernetes.io/projected/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-kube-api-access-sxp9k\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167063 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.166908 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167063 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.166943 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167063 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.166978 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167063 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.167006 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167063 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.167032 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167367 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.167081 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167367 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.167120 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167511 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.167491 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167573 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.167534 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167640 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.167619 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167677 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.167648 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.167779 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.167764 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.169450 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.169427 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.169570 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.169548 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.178060 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.178036 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.178159 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.178107 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxp9k\" (UniqueName: \"kubernetes.io/projected/abbd5c72-5ff3-4ba4-a9d9-681253c274a8-kube-api-access-sxp9k\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg8df\" (UID: \"abbd5c72-5ff3-4ba4-a9d9-681253c274a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.304186 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.304080 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:41.446049 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:41.446020 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df"] Jun 09 07:06:41.447875 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:06:41.447846 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabbd5c72_5ff3_4ba4_a9d9_681253c274a8.slice/crio-7f887ca5b57b3e93f1803ed3bf44f4b9a2938aefa0600c3e661eff93e028e437 WatchSource:0}: Error finding container 7f887ca5b57b3e93f1803ed3bf44f4b9a2938aefa0600c3e661eff93e028e437: Status 404 returned error can't find the container with id 7f887ca5b57b3e93f1803ed3bf44f4b9a2938aefa0600c3e661eff93e028e437 Jun 09 07:06:42.386771 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:42.386726 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" event={"ID":"abbd5c72-5ff3-4ba4-a9d9-681253c274a8","Type":"ContainerStarted","Data":"7f887ca5b57b3e93f1803ed3bf44f4b9a2938aefa0600c3e661eff93e028e437"} Jun 09 07:06:43.898080 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:43.898035 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 07:06:43.898376 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:43.898115 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 07:06:43.898376 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:43.898150 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 07:06:44.399355 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:44.399317 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" event={"ID":"abbd5c72-5ff3-4ba4-a9d9-681253c274a8","Type":"ContainerStarted","Data":"79d3d5deed5c226c1e405e09f5fbda51a76e1d1276b0c2b830d65fc37d5fbe38"} Jun 09 07:06:44.423436 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:44.423382 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" podStartSLOduration=1.975605178 podStartE2EDuration="4.423362064s" totalImagesPullingTime="2.447756886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:06:44.421008435 +0000 UTC m=+491.395663980" watchObservedRunningTime="2026-06-09 07:06:44.423362064 +0000 UTC m=+491.398017608" Jun 09 07:06:45.304382 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:45.304335 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:45.309118 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:45.309089 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:45.403940 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:45.403911 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:06:45.404960 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:06:45.404940 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg8df" Jun 09 07:07:06.548668 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:06.548628 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49jfm"] Jun 09 07:07:06.556435 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:06.556404 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-49jfm" Jun 09 07:07:06.559374 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:06.559341 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 07:07:06.559587 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:06.559348 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 07:07:06.559735 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:06.559718 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2bhz4\"" Jun 09 07:07:06.561456 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:06.561423 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49jfm"] Jun 09 07:07:06.582496 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:06.582461 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5rn6\" (UniqueName: \"kubernetes.io/projected/025d8412-2568-466f-901f-d77c762cba8a-kube-api-access-w5rn6\") pod \"kuadrant-operator-catalog-49jfm\" (UID: \"025d8412-2568-466f-901f-d77c762cba8a\") " pod="kuadrant-system/kuadrant-operator-catalog-49jfm" Jun 09 07:07:06.683418 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:06.683382 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5rn6\" (UniqueName: \"kubernetes.io/projected/025d8412-2568-466f-901f-d77c762cba8a-kube-api-access-w5rn6\") pod \"kuadrant-operator-catalog-49jfm\" (UID: \"025d8412-2568-466f-901f-d77c762cba8a\") " pod="kuadrant-system/kuadrant-operator-catalog-49jfm" Jun 09 07:07:06.691246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:06.691214 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5rn6\" (UniqueName: \"kubernetes.io/projected/025d8412-2568-466f-901f-d77c762cba8a-kube-api-access-w5rn6\") pod \"kuadrant-operator-catalog-49jfm\" (UID: \"025d8412-2568-466f-901f-d77c762cba8a\") " pod="kuadrant-system/kuadrant-operator-catalog-49jfm" Jun 09 07:07:06.869024 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:06.868922 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-49jfm" Jun 09 07:07:06.887716 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:06.887686 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49jfm"] Jun 09 07:07:07.006499 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:07.006470 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49jfm"] Jun 09 07:07:07.010104 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:07:07.010068 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025d8412_2568_466f_901f_d77c762cba8a.slice/crio-8ccb76d061b12c0ce068ba2793ba75d727a792e61126f8038985213895eca57a WatchSource:0}: Error finding container 8ccb76d061b12c0ce068ba2793ba75d727a792e61126f8038985213895eca57a: Status 404 returned error can't find the container with id 8ccb76d061b12c0ce068ba2793ba75d727a792e61126f8038985213895eca57a Jun 09 07:07:07.094991 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:07.094948 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mnttc"] Jun 09 07:07:07.098396 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:07.098364 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mnttc" Jun 09 07:07:07.105993 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:07.105965 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mnttc"] Jun 09 07:07:07.187087 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:07.187045 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86g46\" (UniqueName: \"kubernetes.io/projected/547ddf52-50e4-4b91-9432-2efd530c0cae-kube-api-access-86g46\") pod \"kuadrant-operator-catalog-mnttc\" (UID: \"547ddf52-50e4-4b91-9432-2efd530c0cae\") " pod="kuadrant-system/kuadrant-operator-catalog-mnttc" Jun 09 07:07:07.287721 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:07.287681 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86g46\" (UniqueName: \"kubernetes.io/projected/547ddf52-50e4-4b91-9432-2efd530c0cae-kube-api-access-86g46\") pod \"kuadrant-operator-catalog-mnttc\" (UID: \"547ddf52-50e4-4b91-9432-2efd530c0cae\") " pod="kuadrant-system/kuadrant-operator-catalog-mnttc" Jun 09 07:07:07.295779 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:07.295743 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86g46\" (UniqueName: \"kubernetes.io/projected/547ddf52-50e4-4b91-9432-2efd530c0cae-kube-api-access-86g46\") pod \"kuadrant-operator-catalog-mnttc\" (UID: \"547ddf52-50e4-4b91-9432-2efd530c0cae\") " pod="kuadrant-system/kuadrant-operator-catalog-mnttc" Jun 09 07:07:07.409514 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:07.409472 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mnttc" Jun 09 07:07:07.508892 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:07.508832 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-49jfm" event={"ID":"025d8412-2568-466f-901f-d77c762cba8a","Type":"ContainerStarted","Data":"8ccb76d061b12c0ce068ba2793ba75d727a792e61126f8038985213895eca57a"} Jun 09 07:07:07.541919 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:07.541753 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mnttc"] Jun 09 07:07:07.544495 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:07:07.544465 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod547ddf52_50e4_4b91_9432_2efd530c0cae.slice/crio-2fbcdc35729ed40f9b54d104cf5d004590b0372f076229cb95b7bd23d856a1cb WatchSource:0}: Error finding container 2fbcdc35729ed40f9b54d104cf5d004590b0372f076229cb95b7bd23d856a1cb: Status 404 returned error can't find the container with id 2fbcdc35729ed40f9b54d104cf5d004590b0372f076229cb95b7bd23d856a1cb Jun 09 07:07:08.514930 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:08.514898 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mnttc" event={"ID":"547ddf52-50e4-4b91-9432-2efd530c0cae","Type":"ContainerStarted","Data":"2fbcdc35729ed40f9b54d104cf5d004590b0372f076229cb95b7bd23d856a1cb"} Jun 09 07:07:10.528742 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:10.528700 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mnttc" event={"ID":"547ddf52-50e4-4b91-9432-2efd530c0cae","Type":"ContainerStarted","Data":"5e847bac6c63996c7f1c7c884ef5738e4fd020c845ee8546aa2b4ae6107ecc14"} Jun 09 07:07:10.530223 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:10.530199 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-49jfm" event={"ID":"025d8412-2568-466f-901f-d77c762cba8a","Type":"ContainerStarted","Data":"bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1"} Jun 09 07:07:10.530367 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:10.530245 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-49jfm" podUID="025d8412-2568-466f-901f-d77c762cba8a" containerName="registry-server" containerID="cri-o://bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1" gracePeriod=2 Jun 09 07:07:10.544454 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:10.544329 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mnttc" podStartSLOduration=1.281262309 podStartE2EDuration="3.544313479s" totalImagesPullingTime="2.26305117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:07:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:07:10.543274834 +0000 UTC m=+517.517930383" watchObservedRunningTime="2026-06-09 07:07:10.544313479 +0000 UTC m=+517.518969023" Jun 09 07:07:10.559009 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:10.558958 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-49jfm" podStartSLOduration=1.757952356 podStartE2EDuration="4.558942445s" totalImagesPullingTime="2.800990089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:07:10.557294302 +0000 UTC m=+517.531949846" watchObservedRunningTime="2026-06-09 07:07:10.558942445 +0000 UTC m=+517.533597995" Jun 09 07:07:10.780176 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:10.780112 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-49jfm" Jun 09 07:07:10.825590 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:10.825559 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5rn6\" (UniqueName: \"kubernetes.io/projected/025d8412-2568-466f-901f-d77c762cba8a-kube-api-access-w5rn6\") pod \"025d8412-2568-466f-901f-d77c762cba8a\" (UID: \"025d8412-2568-466f-901f-d77c762cba8a\") " Jun 09 07:07:10.827719 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:10.827693 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/025d8412-2568-466f-901f-d77c762cba8a-kube-api-access-w5rn6" (OuterVolumeSpecName: "kube-api-access-w5rn6") pod "025d8412-2568-466f-901f-d77c762cba8a" (UID: "025d8412-2568-466f-901f-d77c762cba8a"). InnerVolumeSpecName "kube-api-access-w5rn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:07:10.926172 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:10.926133 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5rn6\" (UniqueName: \"kubernetes.io/projected/025d8412-2568-466f-901f-d77c762cba8a-kube-api-access-w5rn6\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:11.536509 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:11.536477 2549 generic.go:356] "Generic (PLEG): container finished" podID="025d8412-2568-466f-901f-d77c762cba8a" containerID="bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1" exitCode=0 Jun 09 07:07:11.536936 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:11.536522 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-49jfm" Jun 09 07:07:11.536936 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:11.536567 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-49jfm" event={"ID":"025d8412-2568-466f-901f-d77c762cba8a","Type":"ContainerDied","Data":"bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1"} Jun 09 07:07:11.536936 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:11.536613 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-49jfm" event={"ID":"025d8412-2568-466f-901f-d77c762cba8a","Type":"ContainerDied","Data":"8ccb76d061b12c0ce068ba2793ba75d727a792e61126f8038985213895eca57a"} Jun 09 07:07:11.536936 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:11.536638 2549 scope.go:117] "RemoveContainer" containerID="bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1" Jun 09 07:07:11.546144 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:11.546124 2549 scope.go:117] "RemoveContainer" containerID="bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1" Jun 09 07:07:11.546437 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:07:11.546414 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1\": container with ID starting with bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1 not found: ID does not exist" containerID="bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1" Jun 09 07:07:11.546472 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:11.546449 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1"} err="failed to get container status \"bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1\": rpc error: code = NotFound desc = could not find container \"bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1\": container with ID starting with bf6e000523b818d32fe0c9dccf2ed8fd35a6d7ecc30c0bdd9659315e1e523da1 not found: ID does not exist" Jun 09 07:07:11.553511 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:11.553485 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49jfm"] Jun 09 07:07:11.558617 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:11.558591 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49jfm"] Jun 09 07:07:13.467521 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:13.467490 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="025d8412-2568-466f-901f-d77c762cba8a" path="/var/lib/kubelet/pods/025d8412-2568-466f-901f-d77c762cba8a/volumes" Jun 09 07:07:17.410330 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:17.410295 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mnttc" Jun 09 07:07:17.410764 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:17.410441 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mnttc" Jun 09 07:07:17.433242 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:17.433212 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mnttc" Jun 09 07:07:17.594456 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:17.594424 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mnttc" Jun 09 07:07:22.079225 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.079191 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc"] Jun 09 07:07:22.079619 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.079532 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025d8412-2568-466f-901f-d77c762cba8a" containerName="registry-server" Jun 09 07:07:22.079619 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.079543 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="025d8412-2568-466f-901f-d77c762cba8a" containerName="registry-server" Jun 09 07:07:22.079619 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.079615 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="025d8412-2568-466f-901f-d77c762cba8a" containerName="registry-server" Jun 09 07:07:22.085304 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.085282 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:22.088453 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.088427 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n72cf\"" Jun 09 07:07:22.090313 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.090286 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc"] Jun 09 07:07:22.130350 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.130316 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:22.130528 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.130376 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjsjk\" (UniqueName: \"kubernetes.io/projected/3f92eb4f-245b-46ab-a11e-833a4e1646dc-kube-api-access-pjsjk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:22.130528 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.130438 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:22.231734 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.231699 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:22.231943 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.231857 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:22.231943 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.231929 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjsjk\" (UniqueName: \"kubernetes.io/projected/3f92eb4f-245b-46ab-a11e-833a4e1646dc-kube-api-access-pjsjk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:22.232171 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.232142 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:22.232297 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.232192 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:22.240270 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.240236 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjsjk\" (UniqueName: \"kubernetes.io/projected/3f92eb4f-245b-46ab-a11e-833a4e1646dc-kube-api-access-pjsjk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:22.395710 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.395681 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:22.527422 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.527395 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc"] Jun 09 07:07:22.529389 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:07:22.529353 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f92eb4f_245b_46ab_a11e_833a4e1646dc.slice/crio-7f0e1be59258408afb66089ee9bc1a24f8773a8906b766d0b25e5a924a9e9203 WatchSource:0}: Error finding container 7f0e1be59258408afb66089ee9bc1a24f8773a8906b766d0b25e5a924a9e9203: Status 404 returned error can't find the container with id 7f0e1be59258408afb66089ee9bc1a24f8773a8906b766d0b25e5a924a9e9203 Jun 09 07:07:22.597473 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.597441 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" event={"ID":"3f92eb4f-245b-46ab-a11e-833a4e1646dc","Type":"ContainerStarted","Data":"7f0e1be59258408afb66089ee9bc1a24f8773a8906b766d0b25e5a924a9e9203"} Jun 09 07:07:22.898363 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.898319 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6"] Jun 09 07:07:22.901017 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.900992 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:22.916608 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:22.916576 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6"] Jun 09 07:07:23.040112 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.040074 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj4f2\" (UniqueName: \"kubernetes.io/projected/c14a8f47-a4c9-4063-bac5-5393baf484d7-kube-api-access-qj4f2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:23.040303 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.040162 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:23.040303 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.040277 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:23.141512 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.141455 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj4f2\" (UniqueName: \"kubernetes.io/projected/c14a8f47-a4c9-4063-bac5-5393baf484d7-kube-api-access-qj4f2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:23.141952 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.141534 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:23.141952 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.141584 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:23.142039 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.141950 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:23.142039 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.141985 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:23.149326 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.149256 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj4f2\" (UniqueName: \"kubernetes.io/projected/c14a8f47-a4c9-4063-bac5-5393baf484d7-kube-api-access-qj4f2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:23.210471 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.210433 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:23.275703 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.275665 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw"] Jun 09 07:07:23.279107 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.279082 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:23.287465 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.287439 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw"] Jun 09 07:07:23.343035 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.342999 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:23.343218 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.343117 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:23.343218 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.343181 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2bt4\" (UniqueName: \"kubernetes.io/projected/8c0485c5-8e01-4d9c-994f-32cd10793e3a-kube-api-access-t2bt4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:23.351904 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.351876 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6"] Jun 09 07:07:23.353717 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:07:23.353689 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14a8f47_a4c9_4063_bac5_5393baf484d7.slice/crio-8b90116a86d23c8566e6e2940b5c3a27888eab5c47ce2a0e7239ae0ed70d70a3 WatchSource:0}: Error finding container 8b90116a86d23c8566e6e2940b5c3a27888eab5c47ce2a0e7239ae0ed70d70a3: Status 404 returned error can't find the container with id 8b90116a86d23c8566e6e2940b5c3a27888eab5c47ce2a0e7239ae0ed70d70a3 Jun 09 07:07:23.443923 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.443884 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:23.444112 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.443949 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2bt4\" (UniqueName: \"kubernetes.io/projected/8c0485c5-8e01-4d9c-994f-32cd10793e3a-kube-api-access-t2bt4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:23.444112 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.444007 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:23.444276 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.444253 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:23.444416 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.444393 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:23.481803 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.478716 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2bt4\" (UniqueName: \"kubernetes.io/projected/8c0485c5-8e01-4d9c-994f-32cd10793e3a-kube-api-access-t2bt4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:23.590646 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.590617 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:23.603554 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.603522 2549 generic.go:356] "Generic (PLEG): container finished" podID="c14a8f47-a4c9-4063-bac5-5393baf484d7" containerID="f377d40537ff752a5cbd37e87b8c0a20a9e49a334264c1653623e55f48f8507a" exitCode=0 Jun 09 07:07:23.603705 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.603626 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" event={"ID":"c14a8f47-a4c9-4063-bac5-5393baf484d7","Type":"ContainerDied","Data":"f377d40537ff752a5cbd37e87b8c0a20a9e49a334264c1653623e55f48f8507a"} Jun 09 07:07:23.603705 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.603687 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" event={"ID":"c14a8f47-a4c9-4063-bac5-5393baf484d7","Type":"ContainerStarted","Data":"8b90116a86d23c8566e6e2940b5c3a27888eab5c47ce2a0e7239ae0ed70d70a3"} Jun 09 07:07:23.605612 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.605583 2549 generic.go:356] "Generic (PLEG): container finished" podID="3f92eb4f-245b-46ab-a11e-833a4e1646dc" containerID="2726aee8269c170c15f05c19392c481c5874d7a2e60d570f9ecc677dfc3f259f" exitCode=0 Jun 09 07:07:23.605726 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.605670 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" event={"ID":"3f92eb4f-245b-46ab-a11e-833a4e1646dc","Type":"ContainerDied","Data":"2726aee8269c170c15f05c19392c481c5874d7a2e60d570f9ecc677dfc3f259f"} Jun 09 07:07:23.681898 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.681860 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9"] Jun 09 07:07:23.685801 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.685768 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:23.693917 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.693850 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9"] Jun 09 07:07:23.732561 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.732532 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw"] Jun 09 07:07:23.735168 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:07:23.735143 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0485c5_8e01_4d9c_994f_32cd10793e3a.slice/crio-fc9b82d78b1091500358ed9c6956ea5c51dde08a3e17825c58a4f7fa35e949d3 WatchSource:0}: Error finding container fc9b82d78b1091500358ed9c6956ea5c51dde08a3e17825c58a4f7fa35e949d3: Status 404 returned error can't find the container with id fc9b82d78b1091500358ed9c6956ea5c51dde08a3e17825c58a4f7fa35e949d3 Jun 09 07:07:23.746255 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.746223 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:23.746383 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.746266 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:23.746426 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.746383 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7725\" (UniqueName: \"kubernetes.io/projected/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-kube-api-access-s7725\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:23.847208 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.847170 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:23.847208 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.847212 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:23.847405 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.847248 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7725\" (UniqueName: \"kubernetes.io/projected/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-kube-api-access-s7725\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:23.847629 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.847602 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:23.847666 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.847613 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:23.856315 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.856285 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7725\" (UniqueName: \"kubernetes.io/projected/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-kube-api-access-s7725\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:23.998708 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:23.998616 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:24.130348 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:24.130321 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9"] Jun 09 07:07:24.132464 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:07:24.132438 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48fc4cb9_49ca_4889_9375_1feaaaad1ea4.slice/crio-da4122956f4f103ac6c45968f1e90b52166a575917c5e46fdeafd8eec03bdaaa WatchSource:0}: Error finding container da4122956f4f103ac6c45968f1e90b52166a575917c5e46fdeafd8eec03bdaaa: Status 404 returned error can't find the container with id da4122956f4f103ac6c45968f1e90b52166a575917c5e46fdeafd8eec03bdaaa Jun 09 07:07:24.613029 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:24.613004 2549 generic.go:356] "Generic (PLEG): container finished" podID="8c0485c5-8e01-4d9c-994f-32cd10793e3a" containerID="a3f780fd377eca9da11d799d4f708a81fcb8643d71a076afa81ea827ffa40e41" exitCode=0 Jun 09 07:07:24.613364 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:24.613082 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" event={"ID":"8c0485c5-8e01-4d9c-994f-32cd10793e3a","Type":"ContainerDied","Data":"a3f780fd377eca9da11d799d4f708a81fcb8643d71a076afa81ea827ffa40e41"} Jun 09 07:07:24.613364 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:24.613135 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" event={"ID":"8c0485c5-8e01-4d9c-994f-32cd10793e3a","Type":"ContainerStarted","Data":"fc9b82d78b1091500358ed9c6956ea5c51dde08a3e17825c58a4f7fa35e949d3"} Jun 09 07:07:24.614842 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:24.614822 2549 generic.go:356] "Generic (PLEG): container finished" podID="48fc4cb9-49ca-4889-9375-1feaaaad1ea4" containerID="919028eb1856c1745601709193d19d9628d75c7537b53b4c960eecabe2beb60f" exitCode=0 Jun 09 07:07:24.614943 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:24.614856 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" event={"ID":"48fc4cb9-49ca-4889-9375-1feaaaad1ea4","Type":"ContainerDied","Data":"919028eb1856c1745601709193d19d9628d75c7537b53b4c960eecabe2beb60f"} Jun 09 07:07:24.614943 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:24.614905 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" event={"ID":"48fc4cb9-49ca-4889-9375-1feaaaad1ea4","Type":"ContainerStarted","Data":"da4122956f4f103ac6c45968f1e90b52166a575917c5e46fdeafd8eec03bdaaa"} Jun 09 07:07:24.616964 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:24.616939 2549 generic.go:356] "Generic (PLEG): container finished" podID="3f92eb4f-245b-46ab-a11e-833a4e1646dc" containerID="823e9c708c942230fa674377aecc7c6c978aa96f9a8c9053cefc6eef7b2ff360" exitCode=0 Jun 09 07:07:24.617071 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:24.617013 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" event={"ID":"3f92eb4f-245b-46ab-a11e-833a4e1646dc","Type":"ContainerDied","Data":"823e9c708c942230fa674377aecc7c6c978aa96f9a8c9053cefc6eef7b2ff360"} Jun 09 07:07:25.624463 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:25.624427 2549 generic.go:356] "Generic (PLEG): container finished" podID="8c0485c5-8e01-4d9c-994f-32cd10793e3a" containerID="1359b7bcd6c0fc7209d0345f2b830c095521ce62ee9e9201d9528a7198e03f96" exitCode=0 Jun 09 07:07:25.624938 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:25.624502 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" event={"ID":"8c0485c5-8e01-4d9c-994f-32cd10793e3a","Type":"ContainerDied","Data":"1359b7bcd6c0fc7209d0345f2b830c095521ce62ee9e9201d9528a7198e03f96"} Jun 09 07:07:25.626562 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:25.626544 2549 generic.go:356] "Generic (PLEG): container finished" podID="48fc4cb9-49ca-4889-9375-1feaaaad1ea4" containerID="38a1b1e245de6eadad3d725d1effd7cd53e3d9d8330cc52ed3689114e9c1420f" exitCode=0 Jun 09 07:07:25.626661 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:25.626609 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" event={"ID":"48fc4cb9-49ca-4889-9375-1feaaaad1ea4","Type":"ContainerDied","Data":"38a1b1e245de6eadad3d725d1effd7cd53e3d9d8330cc52ed3689114e9c1420f"} Jun 09 07:07:25.628743 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:25.628719 2549 generic.go:356] "Generic (PLEG): container finished" podID="c14a8f47-a4c9-4063-bac5-5393baf484d7" containerID="d40e634d285ee8cae20647e6c279e632a785b89b6136cc5d71914a2573e794a1" exitCode=0 Jun 09 07:07:25.628874 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:25.628822 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" event={"ID":"c14a8f47-a4c9-4063-bac5-5393baf484d7","Type":"ContainerDied","Data":"d40e634d285ee8cae20647e6c279e632a785b89b6136cc5d71914a2573e794a1"} Jun 09 07:07:25.631323 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:25.631302 2549 generic.go:356] "Generic (PLEG): container finished" podID="3f92eb4f-245b-46ab-a11e-833a4e1646dc" containerID="3153c3405d08e65d1f6039e469ba39d84dc8075ba531b19d69848c659b9d8cd5" exitCode=0 Jun 09 07:07:25.631401 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:25.631383 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" event={"ID":"3f92eb4f-245b-46ab-a11e-833a4e1646dc","Type":"ContainerDied","Data":"3153c3405d08e65d1f6039e469ba39d84dc8075ba531b19d69848c659b9d8cd5"} Jun 09 07:07:26.638199 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.638157 2549 generic.go:356] "Generic (PLEG): container finished" podID="8c0485c5-8e01-4d9c-994f-32cd10793e3a" containerID="3133ddcf937368576542b0dab3b5d66c11fbb7286a5e0bb3a27bbe04f0943a11" exitCode=0 Jun 09 07:07:26.638645 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.638247 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" event={"ID":"8c0485c5-8e01-4d9c-994f-32cd10793e3a","Type":"ContainerDied","Data":"3133ddcf937368576542b0dab3b5d66c11fbb7286a5e0bb3a27bbe04f0943a11"} Jun 09 07:07:26.640351 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.640326 2549 generic.go:356] "Generic (PLEG): container finished" podID="48fc4cb9-49ca-4889-9375-1feaaaad1ea4" containerID="c79b01e3f47b434a349235eaafb83598ff5f5e3adeaffe0415c43d156dd1863c" exitCode=0 Jun 09 07:07:26.640476 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.640407 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" event={"ID":"48fc4cb9-49ca-4889-9375-1feaaaad1ea4","Type":"ContainerDied","Data":"c79b01e3f47b434a349235eaafb83598ff5f5e3adeaffe0415c43d156dd1863c"} Jun 09 07:07:26.642360 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.642337 2549 generic.go:356] "Generic (PLEG): container finished" podID="c14a8f47-a4c9-4063-bac5-5393baf484d7" containerID="d650dc15dcdcee39a2fe541ba4e79853e2bdeb5c3e66d0fec9cb56d602cfd9dc" exitCode=0 Jun 09 07:07:26.642472 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.642408 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" event={"ID":"c14a8f47-a4c9-4063-bac5-5393baf484d7","Type":"ContainerDied","Data":"d650dc15dcdcee39a2fe541ba4e79853e2bdeb5c3e66d0fec9cb56d602cfd9dc"} Jun 09 07:07:26.778138 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.778112 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:26.876124 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.876085 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-bundle\") pod \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " Jun 09 07:07:26.876302 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.876163 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-util\") pod \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " Jun 09 07:07:26.876302 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.876214 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjsjk\" (UniqueName: \"kubernetes.io/projected/3f92eb4f-245b-46ab-a11e-833a4e1646dc-kube-api-access-pjsjk\") pod \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\" (UID: \"3f92eb4f-245b-46ab-a11e-833a4e1646dc\") " Jun 09 07:07:26.876776 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.876737 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-bundle" (OuterVolumeSpecName: "bundle") pod "3f92eb4f-245b-46ab-a11e-833a4e1646dc" (UID: "3f92eb4f-245b-46ab-a11e-833a4e1646dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:07:26.878386 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.878355 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f92eb4f-245b-46ab-a11e-833a4e1646dc-kube-api-access-pjsjk" (OuterVolumeSpecName: "kube-api-access-pjsjk") pod "3f92eb4f-245b-46ab-a11e-833a4e1646dc" (UID: "3f92eb4f-245b-46ab-a11e-833a4e1646dc"). InnerVolumeSpecName "kube-api-access-pjsjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:07:26.881388 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.881358 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-util" (OuterVolumeSpecName: "util") pod "3f92eb4f-245b-46ab-a11e-833a4e1646dc" (UID: "3f92eb4f-245b-46ab-a11e-833a4e1646dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:07:26.977397 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.977360 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjsjk\" (UniqueName: \"kubernetes.io/projected/3f92eb4f-245b-46ab-a11e-833a4e1646dc-kube-api-access-pjsjk\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:26.977397 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.977392 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-bundle\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:26.977397 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:26.977401 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f92eb4f-245b-46ab-a11e-833a4e1646dc-util\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:27.650091 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.650057 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" Jun 09 07:07:27.650091 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.650084 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc" event={"ID":"3f92eb4f-245b-46ab-a11e-833a4e1646dc","Type":"ContainerDied","Data":"7f0e1be59258408afb66089ee9bc1a24f8773a8906b766d0b25e5a924a9e9203"} Jun 09 07:07:27.650622 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.650127 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f0e1be59258408afb66089ee9bc1a24f8773a8906b766d0b25e5a924a9e9203" Jun 09 07:07:27.796571 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.796543 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:27.843327 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.843305 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:27.846190 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.846170 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:27.884312 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.884281 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-bundle\") pod \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " Jun 09 07:07:27.884312 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.884318 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7725\" (UniqueName: \"kubernetes.io/projected/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-kube-api-access-s7725\") pod \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " Jun 09 07:07:27.884542 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.884398 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-util\") pod \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\" (UID: \"48fc4cb9-49ca-4889-9375-1feaaaad1ea4\") " Jun 09 07:07:27.884867 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.884829 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-bundle" (OuterVolumeSpecName: "bundle") pod "48fc4cb9-49ca-4889-9375-1feaaaad1ea4" (UID: "48fc4cb9-49ca-4889-9375-1feaaaad1ea4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:07:27.886608 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.886581 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-kube-api-access-s7725" (OuterVolumeSpecName: "kube-api-access-s7725") pod "48fc4cb9-49ca-4889-9375-1feaaaad1ea4" (UID: "48fc4cb9-49ca-4889-9375-1feaaaad1ea4"). InnerVolumeSpecName "kube-api-access-s7725". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:07:27.889758 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.889733 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-util" (OuterVolumeSpecName: "util") pod "48fc4cb9-49ca-4889-9375-1feaaaad1ea4" (UID: "48fc4cb9-49ca-4889-9375-1feaaaad1ea4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:07:27.985714 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.985677 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2bt4\" (UniqueName: \"kubernetes.io/projected/8c0485c5-8e01-4d9c-994f-32cd10793e3a-kube-api-access-t2bt4\") pod \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " Jun 09 07:07:27.985922 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.985734 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-util\") pod \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " Jun 09 07:07:27.985922 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.985769 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj4f2\" (UniqueName: \"kubernetes.io/projected/c14a8f47-a4c9-4063-bac5-5393baf484d7-kube-api-access-qj4f2\") pod \"c14a8f47-a4c9-4063-bac5-5393baf484d7\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " Jun 09 07:07:27.985922 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.985817 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-bundle\") pod \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\" (UID: \"8c0485c5-8e01-4d9c-994f-32cd10793e3a\") " Jun 09 07:07:27.985922 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.985839 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-bundle\") pod \"c14a8f47-a4c9-4063-bac5-5393baf484d7\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " Jun 09 07:07:27.985922 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.985866 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-util\") pod \"c14a8f47-a4c9-4063-bac5-5393baf484d7\" (UID: \"c14a8f47-a4c9-4063-bac5-5393baf484d7\") " Jun 09 07:07:27.986206 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.986098 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-bundle\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:27.986206 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.986120 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7725\" (UniqueName: \"kubernetes.io/projected/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-kube-api-access-s7725\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:27.986206 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.986135 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48fc4cb9-49ca-4889-9375-1feaaaad1ea4-util\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:27.986444 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.986421 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-bundle" (OuterVolumeSpecName: "bundle") pod "8c0485c5-8e01-4d9c-994f-32cd10793e3a" (UID: "8c0485c5-8e01-4d9c-994f-32cd10793e3a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:07:27.986527 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.986503 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-bundle" (OuterVolumeSpecName: "bundle") pod "c14a8f47-a4c9-4063-bac5-5393baf484d7" (UID: "c14a8f47-a4c9-4063-bac5-5393baf484d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:07:27.988041 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.988018 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14a8f47-a4c9-4063-bac5-5393baf484d7-kube-api-access-qj4f2" (OuterVolumeSpecName: "kube-api-access-qj4f2") pod "c14a8f47-a4c9-4063-bac5-5393baf484d7" (UID: "c14a8f47-a4c9-4063-bac5-5393baf484d7"). InnerVolumeSpecName "kube-api-access-qj4f2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:07:27.988320 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.988300 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c0485c5-8e01-4d9c-994f-32cd10793e3a-kube-api-access-t2bt4" (OuterVolumeSpecName: "kube-api-access-t2bt4") pod "8c0485c5-8e01-4d9c-994f-32cd10793e3a" (UID: "8c0485c5-8e01-4d9c-994f-32cd10793e3a"). InnerVolumeSpecName "kube-api-access-t2bt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:07:27.991955 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.991930 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-util" (OuterVolumeSpecName: "util") pod "8c0485c5-8e01-4d9c-994f-32cd10793e3a" (UID: "8c0485c5-8e01-4d9c-994f-32cd10793e3a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:07:27.992918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:27.992866 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-util" (OuterVolumeSpecName: "util") pod "c14a8f47-a4c9-4063-bac5-5393baf484d7" (UID: "c14a8f47-a4c9-4063-bac5-5393baf484d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:07:28.086930 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.086886 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-util\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:28.086930 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.086921 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj4f2\" (UniqueName: \"kubernetes.io/projected/c14a8f47-a4c9-4063-bac5-5393baf484d7-kube-api-access-qj4f2\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:28.086930 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.086932 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c0485c5-8e01-4d9c-994f-32cd10793e3a-bundle\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:28.086930 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.086941 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-bundle\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:28.087239 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.086949 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c14a8f47-a4c9-4063-bac5-5393baf484d7-util\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:28.087239 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.086956 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2bt4\" (UniqueName: \"kubernetes.io/projected/8c0485c5-8e01-4d9c-994f-32cd10793e3a-kube-api-access-t2bt4\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:07:28.659995 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.659959 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" event={"ID":"48fc4cb9-49ca-4889-9375-1feaaaad1ea4","Type":"ContainerDied","Data":"da4122956f4f103ac6c45968f1e90b52166a575917c5e46fdeafd8eec03bdaaa"} Jun 09 07:07:28.660437 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.660042 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da4122956f4f103ac6c45968f1e90b52166a575917c5e46fdeafd8eec03bdaaa" Jun 09 07:07:28.660437 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.659967 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9" Jun 09 07:07:28.661843 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.661823 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" Jun 09 07:07:28.661933 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.661818 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6" event={"ID":"c14a8f47-a4c9-4063-bac5-5393baf484d7","Type":"ContainerDied","Data":"8b90116a86d23c8566e6e2940b5c3a27888eab5c47ce2a0e7239ae0ed70d70a3"} Jun 09 07:07:28.661985 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.661963 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b90116a86d23c8566e6e2940b5c3a27888eab5c47ce2a0e7239ae0ed70d70a3" Jun 09 07:07:28.663646 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.663624 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" event={"ID":"8c0485c5-8e01-4d9c-994f-32cd10793e3a","Type":"ContainerDied","Data":"fc9b82d78b1091500358ed9c6956ea5c51dde08a3e17825c58a4f7fa35e949d3"} Jun 09 07:07:28.663764 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.663657 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc9b82d78b1091500358ed9c6956ea5c51dde08a3e17825c58a4f7fa35e949d3" Jun 09 07:07:28.663764 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:28.663661 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw" Jun 09 07:07:32.788497 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788463 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6"] Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788828 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0485c5-8e01-4d9c-994f-32cd10793e3a" containerName="util" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788841 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0485c5-8e01-4d9c-994f-32cd10793e3a" containerName="util" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788855 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48fc4cb9-49ca-4889-9375-1feaaaad1ea4" containerName="util" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788860 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="48fc4cb9-49ca-4889-9375-1feaaaad1ea4" containerName="util" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788871 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0485c5-8e01-4d9c-994f-32cd10793e3a" containerName="pull" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788877 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0485c5-8e01-4d9c-994f-32cd10793e3a" containerName="pull" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788888 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f92eb4f-245b-46ab-a11e-833a4e1646dc" containerName="extract" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788893 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f92eb4f-245b-46ab-a11e-833a4e1646dc" containerName="extract" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788902 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14a8f47-a4c9-4063-bac5-5393baf484d7" containerName="util" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788908 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14a8f47-a4c9-4063-bac5-5393baf484d7" containerName="util" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788916 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48fc4cb9-49ca-4889-9375-1feaaaad1ea4" containerName="extract" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788923 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="48fc4cb9-49ca-4889-9375-1feaaaad1ea4" containerName="extract" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788931 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14a8f47-a4c9-4063-bac5-5393baf484d7" containerName="extract" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788938 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14a8f47-a4c9-4063-bac5-5393baf484d7" containerName="extract" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788952 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f92eb4f-245b-46ab-a11e-833a4e1646dc" containerName="util" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788958 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f92eb4f-245b-46ab-a11e-833a4e1646dc" containerName="util" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788964 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0485c5-8e01-4d9c-994f-32cd10793e3a" containerName="extract" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788969 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0485c5-8e01-4d9c-994f-32cd10793e3a" containerName="extract" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788977 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14a8f47-a4c9-4063-bac5-5393baf484d7" containerName="pull" Jun 09 07:07:32.788989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.788982 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14a8f47-a4c9-4063-bac5-5393baf484d7" containerName="pull" Jun 09 07:07:32.789578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.789003 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f92eb4f-245b-46ab-a11e-833a4e1646dc" containerName="pull" Jun 09 07:07:32.789578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.789008 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f92eb4f-245b-46ab-a11e-833a4e1646dc" containerName="pull" Jun 09 07:07:32.789578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.789014 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48fc4cb9-49ca-4889-9375-1feaaaad1ea4" containerName="pull" Jun 09 07:07:32.789578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.789019 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="48fc4cb9-49ca-4889-9375-1feaaaad1ea4" containerName="pull" Jun 09 07:07:32.789578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.789076 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14a8f47-a4c9-4063-bac5-5393baf484d7" containerName="extract" Jun 09 07:07:32.789578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.789083 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c0485c5-8e01-4d9c-994f-32cd10793e3a" containerName="extract" Jun 09 07:07:32.789578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.789091 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f92eb4f-245b-46ab-a11e-833a4e1646dc" containerName="extract" Jun 09 07:07:32.789578 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.789096 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="48fc4cb9-49ca-4889-9375-1feaaaad1ea4" containerName="extract" Jun 09 07:07:32.792086 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.792066 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:07:32.794516 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.794495 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sldkj\"" Jun 09 07:07:32.801649 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.801621 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6"] Jun 09 07:07:32.931618 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:32.931567 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqhvs\" (UniqueName: \"kubernetes.io/projected/a3260128-65d7-4cfa-b1ad-f7ebc04bdd65-kube-api-access-cqhvs\") pod \"limitador-operator-controller-manager-859d7b78bd-rgrq6\" (UID: \"a3260128-65d7-4cfa-b1ad-f7ebc04bdd65\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:07:33.032631 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:33.032588 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqhvs\" (UniqueName: \"kubernetes.io/projected/a3260128-65d7-4cfa-b1ad-f7ebc04bdd65-kube-api-access-cqhvs\") pod \"limitador-operator-controller-manager-859d7b78bd-rgrq6\" (UID: \"a3260128-65d7-4cfa-b1ad-f7ebc04bdd65\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:07:33.040959 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:33.040885 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqhvs\" (UniqueName: \"kubernetes.io/projected/a3260128-65d7-4cfa-b1ad-f7ebc04bdd65-kube-api-access-cqhvs\") pod \"limitador-operator-controller-manager-859d7b78bd-rgrq6\" (UID: \"a3260128-65d7-4cfa-b1ad-f7ebc04bdd65\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:07:33.102909 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:33.102866 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:07:33.233828 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:33.233773 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6"] Jun 09 07:07:33.235406 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:07:33.235378 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3260128_65d7_4cfa_b1ad_f7ebc04bdd65.slice/crio-455edd24ed4ecc470ea29c1117f8ecc2eb0a18083a1a18842f07c58a2bb3044d WatchSource:0}: Error finding container 455edd24ed4ecc470ea29c1117f8ecc2eb0a18083a1a18842f07c58a2bb3044d: Status 404 returned error can't find the container with id 455edd24ed4ecc470ea29c1117f8ecc2eb0a18083a1a18842f07c58a2bb3044d Jun 09 07:07:33.694306 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:33.694272 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" event={"ID":"a3260128-65d7-4cfa-b1ad-f7ebc04bdd65","Type":"ContainerStarted","Data":"455edd24ed4ecc470ea29c1117f8ecc2eb0a18083a1a18842f07c58a2bb3044d"} Jun 09 07:07:35.722139 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:35.722098 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" event={"ID":"a3260128-65d7-4cfa-b1ad-f7ebc04bdd65","Type":"ContainerStarted","Data":"0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181"} Jun 09 07:07:35.722604 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:35.722156 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:07:35.743389 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:35.743330 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" podStartSLOduration=1.954469027 podStartE2EDuration="3.743314046s" totalImagesPullingTime="1.788845019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:07:35.741684564 +0000 UTC m=+542.716340126" watchObservedRunningTime="2026-06-09 07:07:35.743314046 +0000 UTC m=+542.717969591" Jun 09 07:07:36.835454 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:36.835419 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj"] Jun 09 07:07:36.838853 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:36.838835 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj" Jun 09 07:07:36.841304 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:36.841280 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6dzv2\"" Jun 09 07:07:36.854245 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:36.851527 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj"] Jun 09 07:07:36.974185 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:36.974139 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-459g2\" (UniqueName: \"kubernetes.io/projected/55e39ff3-dde5-432d-b979-2115a8050f34-kube-api-access-459g2\") pod \"authorino-operator-75cc8d5cb7-sn7bj\" (UID: \"55e39ff3-dde5-432d-b979-2115a8050f34\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj" Jun 09 07:07:37.074661 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:37.074626 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-459g2\" (UniqueName: \"kubernetes.io/projected/55e39ff3-dde5-432d-b979-2115a8050f34-kube-api-access-459g2\") pod \"authorino-operator-75cc8d5cb7-sn7bj\" (UID: \"55e39ff3-dde5-432d-b979-2115a8050f34\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj" Jun 09 07:07:37.095076 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:37.095003 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-459g2\" (UniqueName: \"kubernetes.io/projected/55e39ff3-dde5-432d-b979-2115a8050f34-kube-api-access-459g2\") pod \"authorino-operator-75cc8d5cb7-sn7bj\" (UID: \"55e39ff3-dde5-432d-b979-2115a8050f34\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj" Jun 09 07:07:37.156715 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:37.156670 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj" Jun 09 07:07:37.296967 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:37.296937 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj"] Jun 09 07:07:37.298905 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:07:37.298874 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e39ff3_dde5_432d_b979_2115a8050f34.slice/crio-1d5cf474af8061da659da9e0a6747079c4a57fa160a0a11acc2761751911fd72 WatchSource:0}: Error finding container 1d5cf474af8061da659da9e0a6747079c4a57fa160a0a11acc2761751911fd72: Status 404 returned error can't find the container with id 1d5cf474af8061da659da9e0a6747079c4a57fa160a0a11acc2761751911fd72 Jun 09 07:07:37.734469 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:37.734428 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj" event={"ID":"55e39ff3-dde5-432d-b979-2115a8050f34","Type":"ContainerStarted","Data":"1d5cf474af8061da659da9e0a6747079c4a57fa160a0a11acc2761751911fd72"} Jun 09 07:07:40.755902 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:40.755858 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj" event={"ID":"55e39ff3-dde5-432d-b979-2115a8050f34","Type":"ContainerStarted","Data":"5a5c7e2f8f8bdfa7d14d7adb9a6f14fa40f2adca515beb20fc432335caeb689a"} Jun 09 07:07:40.756362 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:40.755983 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj" Jun 09 07:07:40.780720 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:40.780647 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj" podStartSLOduration=1.479216981 podStartE2EDuration="4.78062234s" totalImagesPullingTime="3.301405359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:07:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:07:40.776695422 +0000 UTC m=+547.751350960" watchObservedRunningTime="2026-06-09 07:07:40.78062234 +0000 UTC m=+547.755277886" Jun 09 07:07:46.730246 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:46.730214 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:07:51.764640 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:51.764608 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sn7bj" Jun 09 07:07:56.415860 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.415819 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk"] Jun 09 07:07:56.419843 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.419817 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" Jun 09 07:07:56.422151 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.422126 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 07:07:56.422151 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.422147 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 07:07:56.422329 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.422168 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n72cf\"" Jun 09 07:07:56.429387 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.429358 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk"] Jun 09 07:07:56.450611 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.450576 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a33c1ad-239a-4123-ae64-8257b269946a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gq6xk\" (UID: \"9a33c1ad-239a-4123-ae64-8257b269946a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" Jun 09 07:07:56.450781 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.450631 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9ffc\" (UniqueName: \"kubernetes.io/projected/9a33c1ad-239a-4123-ae64-8257b269946a-kube-api-access-z9ffc\") pod \"kuadrant-console-plugin-66b5774985-gq6xk\" (UID: \"9a33c1ad-239a-4123-ae64-8257b269946a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" Jun 09 07:07:56.450781 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.450705 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a33c1ad-239a-4123-ae64-8257b269946a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gq6xk\" (UID: \"9a33c1ad-239a-4123-ae64-8257b269946a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" Jun 09 07:07:56.551885 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.551849 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ffc\" (UniqueName: \"kubernetes.io/projected/9a33c1ad-239a-4123-ae64-8257b269946a-kube-api-access-z9ffc\") pod \"kuadrant-console-plugin-66b5774985-gq6xk\" (UID: \"9a33c1ad-239a-4123-ae64-8257b269946a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" Jun 09 07:07:56.552066 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.551912 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a33c1ad-239a-4123-ae64-8257b269946a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gq6xk\" (UID: \"9a33c1ad-239a-4123-ae64-8257b269946a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" Jun 09 07:07:56.552066 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.551988 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a33c1ad-239a-4123-ae64-8257b269946a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gq6xk\" (UID: \"9a33c1ad-239a-4123-ae64-8257b269946a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" Jun 09 07:07:56.552673 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.552655 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a33c1ad-239a-4123-ae64-8257b269946a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gq6xk\" (UID: \"9a33c1ad-239a-4123-ae64-8257b269946a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" Jun 09 07:07:56.554424 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.554399 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a33c1ad-239a-4123-ae64-8257b269946a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gq6xk\" (UID: \"9a33c1ad-239a-4123-ae64-8257b269946a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" Jun 09 07:07:56.559338 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.559316 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9ffc\" (UniqueName: \"kubernetes.io/projected/9a33c1ad-239a-4123-ae64-8257b269946a-kube-api-access-z9ffc\") pod \"kuadrant-console-plugin-66b5774985-gq6xk\" (UID: \"9a33c1ad-239a-4123-ae64-8257b269946a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" Jun 09 07:07:56.730271 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.730173 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" Jun 09 07:07:56.864317 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:56.864290 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk"] Jun 09 07:07:56.865966 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:07:56.865946 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a33c1ad_239a_4123_ae64_8257b269946a.slice/crio-dea3f84cba5d8a0f7ba4918062cdfbd8b927ed72b1cdded02e9c7a84451b9576 WatchSource:0}: Error finding container dea3f84cba5d8a0f7ba4918062cdfbd8b927ed72b1cdded02e9c7a84451b9576: Status 404 returned error can't find the container with id dea3f84cba5d8a0f7ba4918062cdfbd8b927ed72b1cdded02e9c7a84451b9576 Jun 09 07:07:57.852674 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:07:57.852613 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" event={"ID":"9a33c1ad-239a-4123-ae64-8257b269946a","Type":"ContainerStarted","Data":"dea3f84cba5d8a0f7ba4918062cdfbd8b927ed72b1cdded02e9c7a84451b9576"} Jun 09 07:08:06.941510 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:06.941461 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6"] Jun 09 07:08:06.942030 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:06.941779 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" podUID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" containerName="manager" containerID="cri-o://0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181" gracePeriod=2 Jun 09 07:08:06.959827 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:06.959777 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6"] Jun 09 07:08:06.965019 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:08:06.964974 2549 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a3260128-65d7-4cfa-b1ad-f7ebc04bdd65\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-rgrq6\": pods \"limitador-operator-controller-manager-859d7b78bd-rgrq6\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:08:06.971404 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:06.971374 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j"] Jun 09 07:08:06.971851 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:06.971834 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" containerName="manager" Jun 09 07:08:06.971971 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:06.971852 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" containerName="manager" Jun 09 07:08:06.971971 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:06.971952 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" containerName="manager" Jun 09 07:08:06.975481 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:06.975457 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j" Jun 09 07:08:06.978335 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:08:06.978299 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rgrq6\" is forbidden: User \"system:node:ip-10-0-139-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-166.ec2.internal' and this object" podUID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:08:06.993899 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:06.989478 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j"] Jun 09 07:08:07.057407 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:07.057367 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c64xg\" (UniqueName: \"kubernetes.io/projected/3960b8e4-f167-4a22-9119-a1e954f8d8b3-kube-api-access-c64xg\") pod \"limitador-operator-controller-manager-859d7b78bd-g5h6j\" (UID: \"3960b8e4-f167-4a22-9119-a1e954f8d8b3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j" Jun 09 07:08:07.158768 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:07.158725 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c64xg\" (UniqueName: \"kubernetes.io/projected/3960b8e4-f167-4a22-9119-a1e954f8d8b3-kube-api-access-c64xg\") pod \"limitador-operator-controller-manager-859d7b78bd-g5h6j\" (UID: \"3960b8e4-f167-4a22-9119-a1e954f8d8b3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j" Jun 09 07:08:07.168036 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:07.168002 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c64xg\" (UniqueName: \"kubernetes.io/projected/3960b8e4-f167-4a22-9119-a1e954f8d8b3-kube-api-access-c64xg\") pod \"limitador-operator-controller-manager-859d7b78bd-g5h6j\" (UID: \"3960b8e4-f167-4a22-9119-a1e954f8d8b3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j" Jun 09 07:08:07.309664 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:07.309571 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j" Jun 09 07:08:21.287755 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:21.287720 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j"] Jun 09 07:08:21.332308 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:08:21.332276 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3960b8e4_f167_4a22_9119_a1e954f8d8b3.slice/crio-0e4ecaf3ac3292124fac96721274e5f4bf0664d441d56b1c18362ecc6524f812 WatchSource:0}: Error finding container 0e4ecaf3ac3292124fac96721274e5f4bf0664d441d56b1c18362ecc6524f812: Status 404 returned error can't find the container with id 0e4ecaf3ac3292124fac96721274e5f4bf0664d441d56b1c18362ecc6524f812 Jun 09 07:08:21.337136 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:21.337115 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:08:21.339213 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:08:21.339185 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rgrq6\" is forbidden: User \"system:node:ip-10-0-139-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-166.ec2.internal' and this object" podUID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:08:21.510763 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:21.510651 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqhvs\" (UniqueName: \"kubernetes.io/projected/a3260128-65d7-4cfa-b1ad-f7ebc04bdd65-kube-api-access-cqhvs\") pod \"a3260128-65d7-4cfa-b1ad-f7ebc04bdd65\" (UID: \"a3260128-65d7-4cfa-b1ad-f7ebc04bdd65\") " Jun 09 07:08:21.512780 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:21.512753 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3260128-65d7-4cfa-b1ad-f7ebc04bdd65-kube-api-access-cqhvs" (OuterVolumeSpecName: "kube-api-access-cqhvs") pod "a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" (UID: "a3260128-65d7-4cfa-b1ad-f7ebc04bdd65"). InnerVolumeSpecName "kube-api-access-cqhvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:08:21.612050 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:21.612007 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqhvs\" (UniqueName: \"kubernetes.io/projected/a3260128-65d7-4cfa-b1ad-f7ebc04bdd65-kube-api-access-cqhvs\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:08:22.000052 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:22.000016 2549 generic.go:356] "Generic (PLEG): container finished" podID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" containerID="0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181" exitCode=0 Jun 09 07:08:22.000266 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:22.000065 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:08:22.000266 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:22.000111 2549 scope.go:117] "RemoveContainer" containerID="0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181" Jun 09 07:08:22.001763 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:22.001728 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" event={"ID":"9a33c1ad-239a-4123-ae64-8257b269946a","Type":"ContainerStarted","Data":"2a56a7e6eaf45901aa022b97b8719266734585163ec1f0b769bbd7e9abbf659a"} Jun 09 07:08:22.002645 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:08:22.002614 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rgrq6\" is forbidden: User \"system:node:ip-10-0-139-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-166.ec2.internal' and this object" podUID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:08:22.003519 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:22.003494 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j" event={"ID":"3960b8e4-f167-4a22-9119-a1e954f8d8b3","Type":"ContainerStarted","Data":"6d1aae99a08b6358353a9719c4c0c383a08d8f51b7ba7090633ae444b09dd8ff"} Jun 09 07:08:22.003618 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:22.003542 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j" event={"ID":"3960b8e4-f167-4a22-9119-a1e954f8d8b3","Type":"ContainerStarted","Data":"0e4ecaf3ac3292124fac96721274e5f4bf0664d441d56b1c18362ecc6524f812"} Jun 09 07:08:22.003663 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:22.003651 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j" Jun 09 07:08:22.004921 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:08:22.004895 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rgrq6\" is forbidden: User \"system:node:ip-10-0-139-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-166.ec2.internal' and this object" podUID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:08:22.010596 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:22.010577 2549 scope.go:117] "RemoveContainer" containerID="0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181" Jun 09 07:08:22.010915 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:08:22.010897 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181\": container with ID starting with 0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181 not found: ID does not exist" containerID="0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181" Jun 09 07:08:22.010964 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:22.010924 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181"} err="failed to get container status \"0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181\": rpc error: code = NotFound desc = could not find container \"0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181\": container with ID starting with 0fe783eac152d19613597085ceb9801578e500df1d329bcb8f025d5a9b585181 not found: ID does not exist" Jun 09 07:08:22.020889 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:22.020846 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gq6xk" podStartSLOduration=1.643175947 podStartE2EDuration="26.020830042s" totalImagesPullingTime="24.377654095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:08:22.01934085 +0000 UTC m=+588.993996408" watchObservedRunningTime="2026-06-09 07:08:22.020830042 +0000 UTC m=+588.995485564" Jun 09 07:08:22.021238 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:08:22.021198 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rgrq6\" is forbidden: User \"system:node:ip-10-0-139-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-166.ec2.internal' and this object" podUID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:08:22.040366 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:22.040309 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j" podStartSLOduration=16.04029296 podStartE2EDuration="16.04029296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:08:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:08:22.038125405 +0000 UTC m=+589.012780951" watchObservedRunningTime="2026-06-09 07:08:22.04029296 +0000 UTC m=+589.014948505" Jun 09 07:08:23.468844 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:08:23.468799 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rgrq6\" is forbidden: User \"system:node:ip-10-0-139-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-166.ec2.internal' and this object" podUID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rgrq6" Jun 09 07:08:23.469938 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:23.469916 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3260128-65d7-4cfa-b1ad-f7ebc04bdd65" path="/var/lib/kubelet/pods/a3260128-65d7-4cfa-b1ad-f7ebc04bdd65/volumes" Jun 09 07:08:33.013089 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:33.013055 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5h6j" Jun 09 07:08:39.964693 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:39.964658 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d"] Jun 09 07:08:39.983609 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:39.983581 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:39.983800 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:39.983727 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d"] Jun 09 07:08:39.986561 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:39.986537 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-t6krn\"" Jun 09 07:08:40.070613 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.070581 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.070800 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.070621 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.070800 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.070659 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ce253a-3d07-447b-afb6-8c5332d0a63c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.070800 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.070681 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.070800 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.070698 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.070800 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.070722 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.070800 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.070776 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.071035 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.070830 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.071035 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.070879 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87knj\" (UniqueName: \"kubernetes.io/projected/12ce253a-3d07-447b-afb6-8c5332d0a63c-kube-api-access-87knj\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172122 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172083 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172122 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172123 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172391 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172257 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87knj\" (UniqueName: \"kubernetes.io/projected/12ce253a-3d07-447b-afb6-8c5332d0a63c-kube-api-access-87knj\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172391 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172300 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172391 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172328 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172391 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172363 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ce253a-3d07-447b-afb6-8c5332d0a63c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172391 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172392 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172682 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172413 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172749 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172681 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172749 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172728 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172898 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172817 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.172958 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.172910 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.173057 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.173010 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.173187 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.173147 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ce253a-3d07-447b-afb6-8c5332d0a63c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.174604 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.174578 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.174755 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.174739 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.181054 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.181025 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ce253a-3d07-447b-afb6-8c5332d0a63c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.181164 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.181142 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87knj\" (UniqueName: \"kubernetes.io/projected/12ce253a-3d07-447b-afb6-8c5332d0a63c-kube-api-access-87knj\") pod \"maas-default-gateway-openshift-default-687ff6996-mtb6d\" (UID: \"12ce253a-3d07-447b-afb6-8c5332d0a63c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.295638 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.295534 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:40.442179 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.442153 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d"] Jun 09 07:08:40.445010 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:08:40.444982 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ce253a_3d07_447b_afb6_8c5332d0a63c.slice/crio-adc0dde10b5a3e10ad1d1bc6848364d2e2696625c487a9039b2b66207e667250 WatchSource:0}: Error finding container adc0dde10b5a3e10ad1d1bc6848364d2e2696625c487a9039b2b66207e667250: Status 404 returned error can't find the container with id adc0dde10b5a3e10ad1d1bc6848364d2e2696625c487a9039b2b66207e667250 Jun 09 07:08:40.447239 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.447201 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 07:08:40.447328 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.447287 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 07:08:40.447457 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:40.447337 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 07:08:41.112233 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:41.112190 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" event={"ID":"12ce253a-3d07-447b-afb6-8c5332d0a63c","Type":"ContainerStarted","Data":"f7eaa15439f65d0260079696b01041ff0503da091c59ce98317fa8860bb2e3be"} Jun 09 07:08:41.112740 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:41.112283 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" event={"ID":"12ce253a-3d07-447b-afb6-8c5332d0a63c","Type":"ContainerStarted","Data":"adc0dde10b5a3e10ad1d1bc6848364d2e2696625c487a9039b2b66207e667250"} Jun 09 07:08:41.134685 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:41.134638 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" podStartSLOduration=2.134622432 podStartE2EDuration="2.134622432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:08:41.132930116 +0000 UTC m=+608.107585660" watchObservedRunningTime="2026-06-09 07:08:41.134622432 +0000 UTC m=+608.109277977" Jun 09 07:08:41.296660 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:41.296621 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:41.301631 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:41.301602 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:42.118142 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:42.118055 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:42.119157 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:42.119139 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:08:45.495963 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:45.495921 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-957pz"] Jun 09 07:08:45.553162 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:45.553126 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-957pz"] Jun 09 07:08:45.553330 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:45.553217 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-957pz" Jun 09 07:08:45.555657 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:45.555635 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nd5q5\"" Jun 09 07:08:45.621599 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:45.621558 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f6cw\" (UniqueName: \"kubernetes.io/projected/8fc49882-c16b-4840-8a4d-0bade541d86d-kube-api-access-9f6cw\") pod \"authorino-75d556bd77-957pz\" (UID: \"8fc49882-c16b-4840-8a4d-0bade541d86d\") " pod="kuadrant-system/authorino-75d556bd77-957pz" Jun 09 07:08:45.722473 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:45.722429 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f6cw\" (UniqueName: \"kubernetes.io/projected/8fc49882-c16b-4840-8a4d-0bade541d86d-kube-api-access-9f6cw\") pod \"authorino-75d556bd77-957pz\" (UID: \"8fc49882-c16b-4840-8a4d-0bade541d86d\") " pod="kuadrant-system/authorino-75d556bd77-957pz" Jun 09 07:08:45.731660 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:45.731633 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f6cw\" (UniqueName: \"kubernetes.io/projected/8fc49882-c16b-4840-8a4d-0bade541d86d-kube-api-access-9f6cw\") pod \"authorino-75d556bd77-957pz\" (UID: \"8fc49882-c16b-4840-8a4d-0bade541d86d\") " pod="kuadrant-system/authorino-75d556bd77-957pz" Jun 09 07:08:45.863140 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:45.863052 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-957pz" Jun 09 07:08:46.006365 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:46.006337 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-957pz"] Jun 09 07:08:46.008882 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:08:46.008852 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fc49882_c16b_4840_8a4d_0bade541d86d.slice/crio-eea19378bb3c16a06699b15c8292fcbd2baf19a3ace8826987fd1a2a96d9e7c4 WatchSource:0}: Error finding container eea19378bb3c16a06699b15c8292fcbd2baf19a3ace8826987fd1a2a96d9e7c4: Status 404 returned error can't find the container with id eea19378bb3c16a06699b15c8292fcbd2baf19a3ace8826987fd1a2a96d9e7c4 Jun 09 07:08:46.140826 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:46.140727 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-957pz" event={"ID":"8fc49882-c16b-4840-8a4d-0bade541d86d","Type":"ContainerStarted","Data":"eea19378bb3c16a06699b15c8292fcbd2baf19a3ace8826987fd1a2a96d9e7c4"} Jun 09 07:08:51.176663 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:51.176575 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-957pz" event={"ID":"8fc49882-c16b-4840-8a4d-0bade541d86d","Type":"ContainerStarted","Data":"1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b"} Jun 09 07:08:51.192547 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:08:51.192495 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-957pz" podStartSLOduration=1.290921469 podStartE2EDuration="6.192476923s" totalImagesPullingTime="4.901555454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:08:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:08:51.190416561 +0000 UTC m=+618.165072109" watchObservedRunningTime="2026-06-09 07:08:51.192476923 +0000 UTC m=+618.167132468" Jun 09 07:09:17.428845 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.428782 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69"] Jun 09 07:09:17.431656 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.431629 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:17.434090 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.434069 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9lbqs\"" Jun 09 07:09:17.434090 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.434070 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 07:09:17.435078 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.435057 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 07:09:17.440631 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.440608 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69"] Jun 09 07:09:17.519398 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.519354 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfsm5\" (UniqueName: \"kubernetes.io/projected/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-kube-api-access-gfsm5\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:17.519619 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.519416 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:17.519619 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.519520 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:17.620287 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.620246 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfsm5\" (UniqueName: \"kubernetes.io/projected/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-kube-api-access-gfsm5\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:17.620503 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.620312 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:17.620503 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.620351 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:17.620708 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.620685 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:17.620820 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.620758 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:17.629045 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.629015 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfsm5\" (UniqueName: \"kubernetes.io/projected/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-kube-api-access-gfsm5\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:17.742418 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.742312 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:17.881157 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:17.881121 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69"] Jun 09 07:09:17.882584 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:09:17.882560 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423ea5f4_3141_4a99_8d73_7eccb20c7bdd.slice/crio-2f74eca07d848593f9cecd25263967af4a384e19fd1b25a4afba41e889fc514f WatchSource:0}: Error finding container 2f74eca07d848593f9cecd25263967af4a384e19fd1b25a4afba41e889fc514f: Status 404 returned error can't find the container with id 2f74eca07d848593f9cecd25263967af4a384e19fd1b25a4afba41e889fc514f Jun 09 07:09:18.329620 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:18.329521 2549 generic.go:356] "Generic (PLEG): container finished" podID="423ea5f4-3141-4a99-8d73-7eccb20c7bdd" containerID="6889eb224d9c518f3aa3be70e2adc0a711769e2dcdccbd4e394bb8aac221c0bf" exitCode=0 Jun 09 07:09:18.329620 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:18.329584 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" event={"ID":"423ea5f4-3141-4a99-8d73-7eccb20c7bdd","Type":"ContainerDied","Data":"6889eb224d9c518f3aa3be70e2adc0a711769e2dcdccbd4e394bb8aac221c0bf"} Jun 09 07:09:18.329870 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:18.329628 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" event={"ID":"423ea5f4-3141-4a99-8d73-7eccb20c7bdd","Type":"ContainerStarted","Data":"2f74eca07d848593f9cecd25263967af4a384e19fd1b25a4afba41e889fc514f"} Jun 09 07:09:19.337304 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:19.337216 2549 generic.go:356] "Generic (PLEG): container finished" podID="423ea5f4-3141-4a99-8d73-7eccb20c7bdd" containerID="49fb0119b59f4f05090da28cb7b52a90d16fef135105a2b5604ea9ad670f0fdf" exitCode=0 Jun 09 07:09:19.337690 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:19.337306 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" event={"ID":"423ea5f4-3141-4a99-8d73-7eccb20c7bdd","Type":"ContainerDied","Data":"49fb0119b59f4f05090da28cb7b52a90d16fef135105a2b5604ea9ad670f0fdf"} Jun 09 07:09:20.344780 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:20.344743 2549 generic.go:356] "Generic (PLEG): container finished" podID="423ea5f4-3141-4a99-8d73-7eccb20c7bdd" containerID="3dc1a8a732f5a81a9c8cb502e5fafba5d7279d7814cb1e254b776b3e0e286891" exitCode=0 Jun 09 07:09:20.345250 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:20.344830 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" event={"ID":"423ea5f4-3141-4a99-8d73-7eccb20c7bdd","Type":"ContainerDied","Data":"3dc1a8a732f5a81a9c8cb502e5fafba5d7279d7814cb1e254b776b3e0e286891"} Jun 09 07:09:21.487255 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:21.487229 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:21.558021 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:21.557980 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfsm5\" (UniqueName: \"kubernetes.io/projected/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-kube-api-access-gfsm5\") pod \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " Jun 09 07:09:21.558206 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:21.558128 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-util\") pod \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " Jun 09 07:09:21.558206 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:21.558166 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-bundle\") pod \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\" (UID: \"423ea5f4-3141-4a99-8d73-7eccb20c7bdd\") " Jun 09 07:09:21.558682 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:21.558641 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-bundle" (OuterVolumeSpecName: "bundle") pod "423ea5f4-3141-4a99-8d73-7eccb20c7bdd" (UID: "423ea5f4-3141-4a99-8d73-7eccb20c7bdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:09:21.560224 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:21.560198 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-kube-api-access-gfsm5" (OuterVolumeSpecName: "kube-api-access-gfsm5") pod "423ea5f4-3141-4a99-8d73-7eccb20c7bdd" (UID: "423ea5f4-3141-4a99-8d73-7eccb20c7bdd"). InnerVolumeSpecName "kube-api-access-gfsm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:09:21.564369 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:21.564343 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-util" (OuterVolumeSpecName: "util") pod "423ea5f4-3141-4a99-8d73-7eccb20c7bdd" (UID: "423ea5f4-3141-4a99-8d73-7eccb20c7bdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:09:21.659656 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:21.659621 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-util\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:09:21.659656 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:21.659655 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-bundle\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:09:21.659891 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:21.659665 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfsm5\" (UniqueName: \"kubernetes.io/projected/423ea5f4-3141-4a99-8d73-7eccb20c7bdd-kube-api-access-gfsm5\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:09:22.358094 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:22.358063 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" Jun 09 07:09:22.358276 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:22.358093 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748j2f69" event={"ID":"423ea5f4-3141-4a99-8d73-7eccb20c7bdd","Type":"ContainerDied","Data":"2f74eca07d848593f9cecd25263967af4a384e19fd1b25a4afba41e889fc514f"} Jun 09 07:09:22.358276 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:09:22.358167 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f74eca07d848593f9cecd25263967af4a384e19fd1b25a4afba41e889fc514f" Jun 09 07:10:13.617727 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.617691 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptrbf"] Jun 09 07:10:13.618191 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.618105 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423ea5f4-3141-4a99-8d73-7eccb20c7bdd" containerName="util" Jun 09 07:10:13.618191 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.618118 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="423ea5f4-3141-4a99-8d73-7eccb20c7bdd" containerName="util" Jun 09 07:10:13.618191 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.618131 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423ea5f4-3141-4a99-8d73-7eccb20c7bdd" containerName="pull" Jun 09 07:10:13.618191 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.618137 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="423ea5f4-3141-4a99-8d73-7eccb20c7bdd" containerName="pull" Jun 09 07:10:13.618191 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.618146 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423ea5f4-3141-4a99-8d73-7eccb20c7bdd" containerName="extract" Jun 09 07:10:13.618191 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.618155 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="423ea5f4-3141-4a99-8d73-7eccb20c7bdd" containerName="extract" Jun 09 07:10:13.618388 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.618243 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="423ea5f4-3141-4a99-8d73-7eccb20c7bdd" containerName="extract" Jun 09 07:10:13.621754 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.621724 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptrbf" Jun 09 07:10:13.629460 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.629431 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptrbf"] Jun 09 07:10:13.738781 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.738738 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzvbz\" (UniqueName: \"kubernetes.io/projected/e09be4b3-9f8f-448e-8775-0cc752407f5d-kube-api-access-pzvbz\") pod \"authorino-5d4b67c446-ptrbf\" (UID: \"e09be4b3-9f8f-448e-8775-0cc752407f5d\") " pod="kuadrant-system/authorino-5d4b67c446-ptrbf" Jun 09 07:10:13.840270 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.840222 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzvbz\" (UniqueName: \"kubernetes.io/projected/e09be4b3-9f8f-448e-8775-0cc752407f5d-kube-api-access-pzvbz\") pod \"authorino-5d4b67c446-ptrbf\" (UID: \"e09be4b3-9f8f-448e-8775-0cc752407f5d\") " pod="kuadrant-system/authorino-5d4b67c446-ptrbf" Jun 09 07:10:13.848780 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.848737 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzvbz\" (UniqueName: \"kubernetes.io/projected/e09be4b3-9f8f-448e-8775-0cc752407f5d-kube-api-access-pzvbz\") pod \"authorino-5d4b67c446-ptrbf\" (UID: \"e09be4b3-9f8f-448e-8775-0cc752407f5d\") " pod="kuadrant-system/authorino-5d4b67c446-ptrbf" Jun 09 07:10:13.851924 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.851894 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptrbf"] Jun 09 07:10:13.852188 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.852173 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptrbf" Jun 09 07:10:13.880288 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.880216 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bf7f5fd56-n76nj"] Jun 09 07:10:13.883872 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.883851 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" Jun 09 07:10:13.889278 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.889252 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bf7f5fd56-n76nj"] Jun 09 07:10:13.941467 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.941434 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4fg8\" (UniqueName: \"kubernetes.io/projected/5d36ac64-332b-4de5-8b76-5d23a108794d-kube-api-access-g4fg8\") pod \"authorino-7bf7f5fd56-n76nj\" (UID: \"5d36ac64-332b-4de5-8b76-5d23a108794d\") " pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" Jun 09 07:10:13.996630 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:13.996603 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptrbf"] Jun 09 07:10:13.999454 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:10:13.999423 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode09be4b3_9f8f_448e_8775_0cc752407f5d.slice/crio-232a99ecda5c39f108acaac915945bd03a70a766f583cac31a5d58a0da6c646c WatchSource:0}: Error finding container 232a99ecda5c39f108acaac915945bd03a70a766f583cac31a5d58a0da6c646c: Status 404 returned error can't find the container with id 232a99ecda5c39f108acaac915945bd03a70a766f583cac31a5d58a0da6c646c Jun 09 07:10:14.000725 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.000705 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 07:10:14.042655 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.042617 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4fg8\" (UniqueName: \"kubernetes.io/projected/5d36ac64-332b-4de5-8b76-5d23a108794d-kube-api-access-g4fg8\") pod \"authorino-7bf7f5fd56-n76nj\" (UID: \"5d36ac64-332b-4de5-8b76-5d23a108794d\") " pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" Jun 09 07:10:14.050622 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.050587 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4fg8\" (UniqueName: \"kubernetes.io/projected/5d36ac64-332b-4de5-8b76-5d23a108794d-kube-api-access-g4fg8\") pod \"authorino-7bf7f5fd56-n76nj\" (UID: \"5d36ac64-332b-4de5-8b76-5d23a108794d\") " pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" Jun 09 07:10:14.157020 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.156983 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bf7f5fd56-n76nj"] Jun 09 07:10:14.157305 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.157289 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" Jun 09 07:10:14.185934 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.185898 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74fc5dbd7b-vsblt"] Jun 09 07:10:14.189341 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.189318 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" Jun 09 07:10:14.191818 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.191773 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 07:10:14.196863 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.196822 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74fc5dbd7b-vsblt"] Jun 09 07:10:14.301996 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.301969 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bf7f5fd56-n76nj"] Jun 09 07:10:14.303736 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:10:14.303706 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d36ac64_332b_4de5_8b76_5d23a108794d.slice/crio-b277e5267cc965b4336a08b94aea07c60bd4c7f1ed6b21c4b1a2179102766e6f WatchSource:0}: Error finding container b277e5267cc965b4336a08b94aea07c60bd4c7f1ed6b21c4b1a2179102766e6f: Status 404 returned error can't find the container with id b277e5267cc965b4336a08b94aea07c60bd4c7f1ed6b21c4b1a2179102766e6f Jun 09 07:10:14.345811 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.345750 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d94fd97b-2708-41a4-b8c1-b628b958dc25-tls-cert\") pod \"authorino-74fc5dbd7b-vsblt\" (UID: \"d94fd97b-2708-41a4-b8c1-b628b958dc25\") " pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" Jun 09 07:10:14.345983 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.345824 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vhzv\" (UniqueName: \"kubernetes.io/projected/d94fd97b-2708-41a4-b8c1-b628b958dc25-kube-api-access-2vhzv\") pod \"authorino-74fc5dbd7b-vsblt\" (UID: \"d94fd97b-2708-41a4-b8c1-b628b958dc25\") " pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" Jun 09 07:10:14.446918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.446828 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d94fd97b-2708-41a4-b8c1-b628b958dc25-tls-cert\") pod \"authorino-74fc5dbd7b-vsblt\" (UID: \"d94fd97b-2708-41a4-b8c1-b628b958dc25\") " pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" Jun 09 07:10:14.446918 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.446886 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vhzv\" (UniqueName: \"kubernetes.io/projected/d94fd97b-2708-41a4-b8c1-b628b958dc25-kube-api-access-2vhzv\") pod \"authorino-74fc5dbd7b-vsblt\" (UID: \"d94fd97b-2708-41a4-b8c1-b628b958dc25\") " pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" Jun 09 07:10:14.449501 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.449472 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d94fd97b-2708-41a4-b8c1-b628b958dc25-tls-cert\") pod \"authorino-74fc5dbd7b-vsblt\" (UID: \"d94fd97b-2708-41a4-b8c1-b628b958dc25\") " pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" Jun 09 07:10:14.455550 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.455518 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vhzv\" (UniqueName: \"kubernetes.io/projected/d94fd97b-2708-41a4-b8c1-b628b958dc25-kube-api-access-2vhzv\") pod \"authorino-74fc5dbd7b-vsblt\" (UID: \"d94fd97b-2708-41a4-b8c1-b628b958dc25\") " pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" Jun 09 07:10:14.501167 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.501126 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" Jun 09 07:10:14.638249 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.638220 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74fc5dbd7b-vsblt"] Jun 09 07:10:14.639396 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:10:14.639366 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd94fd97b_2708_41a4_b8c1_b628b958dc25.slice/crio-cd9f21f703b2bcfa847badc57dce4011d541c1f7040a25c9cbd487249e11a89b WatchSource:0}: Error finding container cd9f21f703b2bcfa847badc57dce4011d541c1f7040a25c9cbd487249e11a89b: Status 404 returned error can't find the container with id cd9f21f703b2bcfa847badc57dce4011d541c1f7040a25c9cbd487249e11a89b Jun 09 07:10:14.657203 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.657136 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" event={"ID":"d94fd97b-2708-41a4-b8c1-b628b958dc25","Type":"ContainerStarted","Data":"cd9f21f703b2bcfa847badc57dce4011d541c1f7040a25c9cbd487249e11a89b"} Jun 09 07:10:14.658846 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.658819 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptrbf" event={"ID":"e09be4b3-9f8f-448e-8775-0cc752407f5d","Type":"ContainerStarted","Data":"6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb"} Jun 09 07:10:14.658949 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.658855 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptrbf" event={"ID":"e09be4b3-9f8f-448e-8775-0cc752407f5d","Type":"ContainerStarted","Data":"232a99ecda5c39f108acaac915945bd03a70a766f583cac31a5d58a0da6c646c"} Jun 09 07:10:14.658949 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.658895 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-ptrbf" podUID="e09be4b3-9f8f-448e-8775-0cc752407f5d" containerName="authorino" containerID="cri-o://6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb" gracePeriod=30 Jun 09 07:10:14.660173 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.660152 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" event={"ID":"5d36ac64-332b-4de5-8b76-5d23a108794d","Type":"ContainerStarted","Data":"b277e5267cc965b4336a08b94aea07c60bd4c7f1ed6b21c4b1a2179102766e6f"} Jun 09 07:10:14.673615 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.673565 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-ptrbf" podStartSLOduration=1.322406862 podStartE2EDuration="1.673548272s" totalImagesPullingTime="351.14141ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:10:14.671428775 +0000 UTC m=+701.646084321" watchObservedRunningTime="2026-06-09 07:10:14.673548272 +0000 UTC m=+701.648203816" Jun 09 07:10:14.916194 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:14.916166 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptrbf" Jun 09 07:10:15.053105 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.053078 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzvbz\" (UniqueName: \"kubernetes.io/projected/e09be4b3-9f8f-448e-8775-0cc752407f5d-kube-api-access-pzvbz\") pod \"e09be4b3-9f8f-448e-8775-0cc752407f5d\" (UID: \"e09be4b3-9f8f-448e-8775-0cc752407f5d\") " Jun 09 07:10:15.055348 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.055313 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e09be4b3-9f8f-448e-8775-0cc752407f5d-kube-api-access-pzvbz" (OuterVolumeSpecName: "kube-api-access-pzvbz") pod "e09be4b3-9f8f-448e-8775-0cc752407f5d" (UID: "e09be4b3-9f8f-448e-8775-0cc752407f5d"). InnerVolumeSpecName "kube-api-access-pzvbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:10:15.154837 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.154781 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzvbz\" (UniqueName: \"kubernetes.io/projected/e09be4b3-9f8f-448e-8775-0cc752407f5d-kube-api-access-pzvbz\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:10:15.667525 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.667485 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" event={"ID":"5d36ac64-332b-4de5-8b76-5d23a108794d","Type":"ContainerStarted","Data":"f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04"} Jun 09 07:10:15.667525 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.667511 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" podUID="5d36ac64-332b-4de5-8b76-5d23a108794d" containerName="authorino" containerID="cri-o://f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04" gracePeriod=30 Jun 09 07:10:15.669227 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.669201 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" event={"ID":"d94fd97b-2708-41a4-b8c1-b628b958dc25","Type":"ContainerStarted","Data":"f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35"} Jun 09 07:10:15.670654 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.670537 2549 generic.go:356] "Generic (PLEG): container finished" podID="e09be4b3-9f8f-448e-8775-0cc752407f5d" containerID="6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb" exitCode=0 Jun 09 07:10:15.670767 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.670665 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptrbf" event={"ID":"e09be4b3-9f8f-448e-8775-0cc752407f5d","Type":"ContainerDied","Data":"6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb"} Jun 09 07:10:15.670767 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.670681 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ptrbf" Jun 09 07:10:15.670767 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.670699 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ptrbf" event={"ID":"e09be4b3-9f8f-448e-8775-0cc752407f5d","Type":"ContainerDied","Data":"232a99ecda5c39f108acaac915945bd03a70a766f583cac31a5d58a0da6c646c"} Jun 09 07:10:15.670767 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.670717 2549 scope.go:117] "RemoveContainer" containerID="6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb" Jun 09 07:10:15.680142 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.680108 2549 scope.go:117] "RemoveContainer" containerID="6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb" Jun 09 07:10:15.680435 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:10:15.680412 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb\": container with ID starting with 6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb not found: ID does not exist" containerID="6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb" Jun 09 07:10:15.680535 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.680443 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb"} err="failed to get container status \"6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb\": rpc error: code = NotFound desc = could not find container \"6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb\": container with ID starting with 6dded5680ff074bae81f1c75fe7227c20cbc3a2127a89311059b29b74dccfacb not found: ID does not exist" Jun 09 07:10:15.683674 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.683625 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" podStartSLOduration=2.332413896 podStartE2EDuration="2.683610162s" totalImagesPullingTime="351.196266ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:10:15.683373832 +0000 UTC m=+702.658029379" watchObservedRunningTime="2026-06-09 07:10:15.683610162 +0000 UTC m=+702.658265707" Jun 09 07:10:15.697429 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.697402 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptrbf"] Jun 09 07:10:15.699611 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.699590 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ptrbf"] Jun 09 07:10:15.714688 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.714637 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" podStartSLOduration=1.3192963500000001 podStartE2EDuration="1.714621347s" totalImagesPullingTime="395.324997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:10:15.7137258 +0000 UTC m=+702.688381342" watchObservedRunningTime="2026-06-09 07:10:15.714621347 +0000 UTC m=+702.689276891" Jun 09 07:10:15.738625 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.738541 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-957pz"] Jun 09 07:10:15.738817 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:15.738751 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-957pz" podUID="8fc49882-c16b-4840-8a4d-0bade541d86d" containerName="authorino" containerID="cri-o://1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b" gracePeriod=30 Jun 09 07:10:16.018823 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.018779 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" Jun 09 07:10:16.020836 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.020818 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-957pz" Jun 09 07:10:16.163628 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.163589 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4fg8\" (UniqueName: \"kubernetes.io/projected/5d36ac64-332b-4de5-8b76-5d23a108794d-kube-api-access-g4fg8\") pod \"5d36ac64-332b-4de5-8b76-5d23a108794d\" (UID: \"5d36ac64-332b-4de5-8b76-5d23a108794d\") " Jun 09 07:10:16.163856 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.163689 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f6cw\" (UniqueName: \"kubernetes.io/projected/8fc49882-c16b-4840-8a4d-0bade541d86d-kube-api-access-9f6cw\") pod \"8fc49882-c16b-4840-8a4d-0bade541d86d\" (UID: \"8fc49882-c16b-4840-8a4d-0bade541d86d\") " Jun 09 07:10:16.165911 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.165866 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc49882-c16b-4840-8a4d-0bade541d86d-kube-api-access-9f6cw" (OuterVolumeSpecName: "kube-api-access-9f6cw") pod "8fc49882-c16b-4840-8a4d-0bade541d86d" (UID: "8fc49882-c16b-4840-8a4d-0bade541d86d"). InnerVolumeSpecName "kube-api-access-9f6cw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:10:16.166038 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.165887 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d36ac64-332b-4de5-8b76-5d23a108794d-kube-api-access-g4fg8" (OuterVolumeSpecName: "kube-api-access-g4fg8") pod "5d36ac64-332b-4de5-8b76-5d23a108794d" (UID: "5d36ac64-332b-4de5-8b76-5d23a108794d"). InnerVolumeSpecName "kube-api-access-g4fg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:10:16.264553 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.264467 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4fg8\" (UniqueName: \"kubernetes.io/projected/5d36ac64-332b-4de5-8b76-5d23a108794d-kube-api-access-g4fg8\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:10:16.264553 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.264500 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f6cw\" (UniqueName: \"kubernetes.io/projected/8fc49882-c16b-4840-8a4d-0bade541d86d-kube-api-access-9f6cw\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:10:16.681316 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.681264 2549 generic.go:356] "Generic (PLEG): container finished" podID="5d36ac64-332b-4de5-8b76-5d23a108794d" containerID="f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04" exitCode=0 Jun 09 07:10:16.681777 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.681372 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" Jun 09 07:10:16.681777 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.681436 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" event={"ID":"5d36ac64-332b-4de5-8b76-5d23a108794d","Type":"ContainerDied","Data":"f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04"} Jun 09 07:10:16.681777 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.681474 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bf7f5fd56-n76nj" event={"ID":"5d36ac64-332b-4de5-8b76-5d23a108794d","Type":"ContainerDied","Data":"b277e5267cc965b4336a08b94aea07c60bd4c7f1ed6b21c4b1a2179102766e6f"} Jun 09 07:10:16.681777 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.681497 2549 scope.go:117] "RemoveContainer" containerID="f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04" Jun 09 07:10:16.683877 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.683635 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-957pz" Jun 09 07:10:16.693496 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.693465 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-957pz" event={"ID":"8fc49882-c16b-4840-8a4d-0bade541d86d","Type":"ContainerDied","Data":"1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b"} Jun 09 07:10:16.693968 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.693939 2549 generic.go:356] "Generic (PLEG): container finished" podID="8fc49882-c16b-4840-8a4d-0bade541d86d" containerID="1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b" exitCode=0 Jun 09 07:10:16.694332 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.694310 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-957pz" event={"ID":"8fc49882-c16b-4840-8a4d-0bade541d86d","Type":"ContainerDied","Data":"eea19378bb3c16a06699b15c8292fcbd2baf19a3ace8826987fd1a2a96d9e7c4"} Jun 09 07:10:16.706304 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.706279 2549 scope.go:117] "RemoveContainer" containerID="f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04" Jun 09 07:10:16.706769 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:10:16.706725 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04\": container with ID starting with f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04 not found: ID does not exist" containerID="f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04" Jun 09 07:10:16.706897 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.706779 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04"} err="failed to get container status \"f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04\": rpc error: code = NotFound desc = could not find container \"f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04\": container with ID starting with f9564e31237490db01eef9cc44578628df2095bc5330ee3b5bbb6235d77c8e04 not found: ID does not exist" Jun 09 07:10:16.706897 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.706826 2549 scope.go:117] "RemoveContainer" containerID="1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b" Jun 09 07:10:16.715061 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.715034 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bf7f5fd56-n76nj"] Jun 09 07:10:16.718757 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.718732 2549 scope.go:117] "RemoveContainer" containerID="1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b" Jun 09 07:10:16.719134 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:10:16.719111 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b\": container with ID starting with 1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b not found: ID does not exist" containerID="1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b" Jun 09 07:10:16.719219 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.719143 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b"} err="failed to get container status \"1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b\": rpc error: code = NotFound desc = could not find container \"1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b\": container with ID starting with 1107a32da727880e4d331bf4591846585816f4a03a0050e78bae2ae59fa27d1b not found: ID does not exist" Jun 09 07:10:16.720996 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.720975 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bf7f5fd56-n76nj"] Jun 09 07:10:16.732245 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.732220 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-957pz"] Jun 09 07:10:16.736213 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:16.736188 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-957pz"] Jun 09 07:10:17.475834 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:17.475801 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d36ac64-332b-4de5-8b76-5d23a108794d" path="/var/lib/kubelet/pods/5d36ac64-332b-4de5-8b76-5d23a108794d/volumes" Jun 09 07:10:17.476136 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:17.476123 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fc49882-c16b-4840-8a4d-0bade541d86d" path="/var/lib/kubelet/pods/8fc49882-c16b-4840-8a4d-0bade541d86d/volumes" Jun 09 07:10:17.476399 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:10:17.476388 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e09be4b3-9f8f-448e-8775-0cc752407f5d" path="/var/lib/kubelet/pods/e09be4b3-9f8f-448e-8775-0cc752407f5d/volumes" Jun 09 07:11:02.959219 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:02.959184 2549 generic.go:356] "Generic (PLEG): container finished" podID="12ce253a-3d07-447b-afb6-8c5332d0a63c" containerID="f7eaa15439f65d0260079696b01041ff0503da091c59ce98317fa8860bb2e3be" exitCode=0 Jun 09 07:11:02.959219 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:02.959228 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" event={"ID":"12ce253a-3d07-447b-afb6-8c5332d0a63c","Type":"ContainerDied","Data":"f7eaa15439f65d0260079696b01041ff0503da091c59ce98317fa8860bb2e3be"} Jun 09 07:11:02.959869 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:02.959748 2549 scope.go:117] "RemoveContainer" containerID="f7eaa15439f65d0260079696b01041ff0503da091c59ce98317fa8860bb2e3be" Jun 09 07:11:02.960858 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:02.960823 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 07:11:02.960952 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:02.960899 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 07:11:02.960952 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:02.960933 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 07:11:03.969989 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:03.969947 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" event={"ID":"12ce253a-3d07-447b-afb6-8c5332d0a63c","Type":"ContainerStarted","Data":"127b816cb5a494fcc2bdb2b27e23fde8b7efc38344e42eff5131f0a114f8e5de"} Jun 09 07:11:04.295916 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:04.295817 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:11:04.296125 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:04.296099 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-mtb6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 09 07:11:04.296173 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:04.296156 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" podUID="12ce253a-3d07-447b-afb6-8c5332d0a63c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 09 07:11:05.295965 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:05.295928 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-mtb6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 09 07:11:05.296354 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:05.295995 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" podUID="12ce253a-3d07-447b-afb6-8c5332d0a63c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 09 07:11:06.296283 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:06.296238 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-mtb6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 09 07:11:06.296832 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:06.296305 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" podUID="12ce253a-3d07-447b-afb6-8c5332d0a63c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 09 07:11:07.296045 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:07.296005 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-mtb6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 09 07:11:07.296263 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:07.296076 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" podUID="12ce253a-3d07-447b-afb6-8c5332d0a63c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 09 07:11:08.300715 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:08.300680 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:11:08.301183 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:08.301127 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:11:08.301860 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:08.301842 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-mtb6d" Jun 09 07:11:43.274409 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.274324 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84bb5fc5f4-mq8ns"] Jun 09 07:11:43.274965 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.274882 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d36ac64-332b-4de5-8b76-5d23a108794d" containerName="authorino" Jun 09 07:11:43.274965 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.274902 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d36ac64-332b-4de5-8b76-5d23a108794d" containerName="authorino" Jun 09 07:11:43.274965 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.274922 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09be4b3-9f8f-448e-8775-0cc752407f5d" containerName="authorino" Jun 09 07:11:43.274965 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.274932 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09be4b3-9f8f-448e-8775-0cc752407f5d" containerName="authorino" Jun 09 07:11:43.274965 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.274957 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc49882-c16b-4840-8a4d-0bade541d86d" containerName="authorino" Jun 09 07:11:43.274965 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.274965 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc49882-c16b-4840-8a4d-0bade541d86d" containerName="authorino" Jun 09 07:11:43.275176 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.275036 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fc49882-c16b-4840-8a4d-0bade541d86d" containerName="authorino" Jun 09 07:11:43.275176 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.275046 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d36ac64-332b-4de5-8b76-5d23a108794d" containerName="authorino" Jun 09 07:11:43.275176 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.275054 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e09be4b3-9f8f-448e-8775-0cc752407f5d" containerName="authorino" Jun 09 07:11:43.278098 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.278081 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" Jun 09 07:11:43.280923 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.280897 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 07:11:43.285086 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.285063 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84bb5fc5f4-mq8ns"] Jun 09 07:11:43.372962 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.372924 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d98981ec-8b3a-4e10-b643-7b7e7f9fa57b-oidc-ca\") pod \"authorino-84bb5fc5f4-mq8ns\" (UID: \"d98981ec-8b3a-4e10-b643-7b7e7f9fa57b\") " pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" Jun 09 07:11:43.372962 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.372963 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzv25\" (UniqueName: \"kubernetes.io/projected/d98981ec-8b3a-4e10-b643-7b7e7f9fa57b-kube-api-access-tzv25\") pod \"authorino-84bb5fc5f4-mq8ns\" (UID: \"d98981ec-8b3a-4e10-b643-7b7e7f9fa57b\") " pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" Jun 09 07:11:43.373208 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.373004 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d98981ec-8b3a-4e10-b643-7b7e7f9fa57b-tls-cert\") pod \"authorino-84bb5fc5f4-mq8ns\" (UID: \"d98981ec-8b3a-4e10-b643-7b7e7f9fa57b\") " pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" Jun 09 07:11:43.473534 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.473501 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d98981ec-8b3a-4e10-b643-7b7e7f9fa57b-oidc-ca\") pod \"authorino-84bb5fc5f4-mq8ns\" (UID: \"d98981ec-8b3a-4e10-b643-7b7e7f9fa57b\") " pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" Jun 09 07:11:43.473534 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.473535 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzv25\" (UniqueName: \"kubernetes.io/projected/d98981ec-8b3a-4e10-b643-7b7e7f9fa57b-kube-api-access-tzv25\") pod \"authorino-84bb5fc5f4-mq8ns\" (UID: \"d98981ec-8b3a-4e10-b643-7b7e7f9fa57b\") " pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" Jun 09 07:11:43.473829 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.473564 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d98981ec-8b3a-4e10-b643-7b7e7f9fa57b-tls-cert\") pod \"authorino-84bb5fc5f4-mq8ns\" (UID: \"d98981ec-8b3a-4e10-b643-7b7e7f9fa57b\") " pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" Jun 09 07:11:43.474242 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.474217 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d98981ec-8b3a-4e10-b643-7b7e7f9fa57b-oidc-ca\") pod \"authorino-84bb5fc5f4-mq8ns\" (UID: \"d98981ec-8b3a-4e10-b643-7b7e7f9fa57b\") " pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" Jun 09 07:11:43.476037 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.476012 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d98981ec-8b3a-4e10-b643-7b7e7f9fa57b-tls-cert\") pod \"authorino-84bb5fc5f4-mq8ns\" (UID: \"d98981ec-8b3a-4e10-b643-7b7e7f9fa57b\") " pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" Jun 09 07:11:43.481664 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.481639 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzv25\" (UniqueName: \"kubernetes.io/projected/d98981ec-8b3a-4e10-b643-7b7e7f9fa57b-kube-api-access-tzv25\") pod \"authorino-84bb5fc5f4-mq8ns\" (UID: \"d98981ec-8b3a-4e10-b643-7b7e7f9fa57b\") " pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" Jun 09 07:11:43.588951 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.588856 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" Jun 09 07:11:43.728598 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:43.728567 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84bb5fc5f4-mq8ns"] Jun 09 07:11:43.730482 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:11:43.730448 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd98981ec_8b3a_4e10_b643_7b7e7f9fa57b.slice/crio-0c8f409dfb8ab6fdc7816609d37a0226874e356a0083f9fe9159b4d66f8233a1 WatchSource:0}: Error finding container 0c8f409dfb8ab6fdc7816609d37a0226874e356a0083f9fe9159b4d66f8233a1: Status 404 returned error can't find the container with id 0c8f409dfb8ab6fdc7816609d37a0226874e356a0083f9fe9159b4d66f8233a1 Jun 09 07:11:44.194697 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:44.194667 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" event={"ID":"d98981ec-8b3a-4e10-b643-7b7e7f9fa57b","Type":"ContainerStarted","Data":"0c8f409dfb8ab6fdc7816609d37a0226874e356a0083f9fe9159b4d66f8233a1"} Jun 09 07:11:45.201684 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:45.201651 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" event={"ID":"d98981ec-8b3a-4e10-b643-7b7e7f9fa57b","Type":"ContainerStarted","Data":"2550d45d5daf5acb99cf5ce230483b885cc68d36798297f2682ce25918790478"} Jun 09 07:11:45.218286 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:45.218221 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84bb5fc5f4-mq8ns" podStartSLOduration=1.776932025 podStartE2EDuration="2.218203402s" totalImagesPullingTime="441.271377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:11:45.216778074 +0000 UTC m=+792.191433615" watchObservedRunningTime="2026-06-09 07:11:45.218203402 +0000 UTC m=+792.192858948" Jun 09 07:11:45.244532 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:45.244493 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74fc5dbd7b-vsblt"] Jun 09 07:11:45.244772 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:45.244733 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" podUID="d94fd97b-2708-41a4-b8c1-b628b958dc25" containerName="authorino" containerID="cri-o://f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35" gracePeriod=30 Jun 09 07:11:45.515726 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:45.515693 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" Jun 09 07:11:45.593025 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:45.592991 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vhzv\" (UniqueName: \"kubernetes.io/projected/d94fd97b-2708-41a4-b8c1-b628b958dc25-kube-api-access-2vhzv\") pod \"d94fd97b-2708-41a4-b8c1-b628b958dc25\" (UID: \"d94fd97b-2708-41a4-b8c1-b628b958dc25\") " Jun 09 07:11:45.593233 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:45.593065 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d94fd97b-2708-41a4-b8c1-b628b958dc25-tls-cert\") pod \"d94fd97b-2708-41a4-b8c1-b628b958dc25\" (UID: \"d94fd97b-2708-41a4-b8c1-b628b958dc25\") " Jun 09 07:11:45.595220 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:45.595193 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d94fd97b-2708-41a4-b8c1-b628b958dc25-kube-api-access-2vhzv" (OuterVolumeSpecName: "kube-api-access-2vhzv") pod "d94fd97b-2708-41a4-b8c1-b628b958dc25" (UID: "d94fd97b-2708-41a4-b8c1-b628b958dc25"). InnerVolumeSpecName "kube-api-access-2vhzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:11:45.603939 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:45.603903 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d94fd97b-2708-41a4-b8c1-b628b958dc25-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d94fd97b-2708-41a4-b8c1-b628b958dc25" (UID: "d94fd97b-2708-41a4-b8c1-b628b958dc25"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:11:45.694506 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:45.694472 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vhzv\" (UniqueName: \"kubernetes.io/projected/d94fd97b-2708-41a4-b8c1-b628b958dc25-kube-api-access-2vhzv\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:11:45.694506 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:45.694501 2549 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d94fd97b-2708-41a4-b8c1-b628b958dc25-tls-cert\") on node \"ip-10-0-139-166.ec2.internal\" DevicePath \"\"" Jun 09 07:11:46.208536 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:46.208502 2549 generic.go:356] "Generic (PLEG): container finished" podID="d94fd97b-2708-41a4-b8c1-b628b958dc25" containerID="f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35" exitCode=0 Jun 09 07:11:46.209003 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:46.208547 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" Jun 09 07:11:46.209003 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:46.208543 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" event={"ID":"d94fd97b-2708-41a4-b8c1-b628b958dc25","Type":"ContainerDied","Data":"f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35"} Jun 09 07:11:46.209003 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:46.208662 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fc5dbd7b-vsblt" event={"ID":"d94fd97b-2708-41a4-b8c1-b628b958dc25","Type":"ContainerDied","Data":"cd9f21f703b2bcfa847badc57dce4011d541c1f7040a25c9cbd487249e11a89b"} Jun 09 07:11:46.209003 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:46.208683 2549 scope.go:117] "RemoveContainer" containerID="f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35" Jun 09 07:11:46.218651 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:46.218630 2549 scope.go:117] "RemoveContainer" containerID="f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35" Jun 09 07:11:46.218963 ip-10-0-139-166 kubenswrapper[2549]: E0609 07:11:46.218934 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35\": container with ID starting with f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35 not found: ID does not exist" containerID="f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35" Jun 09 07:11:46.219024 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:46.218963 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35"} err="failed to get container status \"f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35\": rpc error: code = NotFound desc = could not find container \"f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35\": container with ID starting with f3dadf9eb5edcf990a16f58b74cb9cf9bc81900e624940afe001d927be774a35 not found: ID does not exist" Jun 09 07:11:46.230001 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:46.229972 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74fc5dbd7b-vsblt"] Jun 09 07:11:46.233439 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:46.233413 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74fc5dbd7b-vsblt"] Jun 09 07:11:47.473728 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:47.473692 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d94fd97b-2708-41a4-b8c1-b628b958dc25" path="/var/lib/kubelet/pods/d94fd97b-2708-41a4-b8c1-b628b958dc25/volumes" Jun 09 07:11:54.101815 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.101755 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8"] Jun 09 07:11:54.102402 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.102237 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94fd97b-2708-41a4-b8c1-b628b958dc25" containerName="authorino" Jun 09 07:11:54.102402 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.102251 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94fd97b-2708-41a4-b8c1-b628b958dc25" containerName="authorino" Jun 09 07:11:54.102402 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.102334 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d94fd97b-2708-41a4-b8c1-b628b958dc25" containerName="authorino" Jun 09 07:11:54.107424 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.107396 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.110004 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.109978 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 07:11:54.110141 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.110016 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 07:11:54.111118 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.111098 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f84rz\"" Jun 09 07:11:54.111245 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.111132 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 07:11:54.116690 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.116663 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8"] Jun 09 07:11:54.273804 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.273757 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.274013 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.273829 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.274013 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.273879 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc82f91-31b5-4bf6-8ead-73cc837cf104-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.274013 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.273903 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.274013 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.273936 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.274013 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.273959 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hjvh\" (UniqueName: \"kubernetes.io/projected/fdc82f91-31b5-4bf6-8ead-73cc837cf104-kube-api-access-4hjvh\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.374732 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.374617 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc82f91-31b5-4bf6-8ead-73cc837cf104-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.374732 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.374680 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.374732 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.374707 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.374732 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.374723 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hjvh\" (UniqueName: \"kubernetes.io/projected/fdc82f91-31b5-4bf6-8ead-73cc837cf104-kube-api-access-4hjvh\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.375104 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.374902 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.375104 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.374980 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.375334 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.375313 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.375404 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.375332 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.375404 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.375392 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.377201 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.377168 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdc82f91-31b5-4bf6-8ead-73cc837cf104-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.377403 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.377384 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdc82f91-31b5-4bf6-8ead-73cc837cf104-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.383147 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.383127 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hjvh\" (UniqueName: \"kubernetes.io/projected/fdc82f91-31b5-4bf6-8ead-73cc837cf104-kube-api-access-4hjvh\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8\" (UID: \"fdc82f91-31b5-4bf6-8ead-73cc837cf104\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.418748 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.418708 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:11:54.563203 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:54.563166 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8"] Jun 09 07:11:54.564411 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:11:54.564385 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc82f91_31b5_4bf6_8ead_73cc837cf104.slice/crio-1e4d97b9ec78b245bf0c1a7492906c1d31e2f781be65f992783f7c60863cf6bd WatchSource:0}: Error finding container 1e4d97b9ec78b245bf0c1a7492906c1d31e2f781be65f992783f7c60863cf6bd: Status 404 returned error can't find the container with id 1e4d97b9ec78b245bf0c1a7492906c1d31e2f781be65f992783f7c60863cf6bd Jun 09 07:11:55.266098 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:11:55.266043 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" event={"ID":"fdc82f91-31b5-4bf6-8ead-73cc837cf104","Type":"ContainerStarted","Data":"1e4d97b9ec78b245bf0c1a7492906c1d31e2f781be65f992783f7c60863cf6bd"} Jun 09 07:12:00.300755 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:00.300705 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" event={"ID":"fdc82f91-31b5-4bf6-8ead-73cc837cf104","Type":"ContainerStarted","Data":"a55af19cde0abb3c77509bf4d8c749d8c1c82e74c9e973ea8268e2150e58b8b5"} Jun 09 07:12:01.307539 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:01.307503 2549 generic.go:356] "Generic (PLEG): container finished" podID="fdc82f91-31b5-4bf6-8ead-73cc837cf104" containerID="a55af19cde0abb3c77509bf4d8c749d8c1c82e74c9e973ea8268e2150e58b8b5" exitCode=0 Jun 09 07:12:01.307952 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:01.307567 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" event={"ID":"fdc82f91-31b5-4bf6-8ead-73cc837cf104","Type":"ContainerDied","Data":"a55af19cde0abb3c77509bf4d8c749d8c1c82e74c9e973ea8268e2150e58b8b5"} Jun 09 07:12:03.321927 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:03.321891 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" event={"ID":"fdc82f91-31b5-4bf6-8ead-73cc837cf104","Type":"ContainerStarted","Data":"084eef3e8c230bdc88e4f06751ac00284e198434479fa4038e7081e0a40dbdda"} Jun 09 07:12:03.341042 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:03.340959 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" podStartSLOduration=1.7967308260000001 podStartE2EDuration="9.340942439s" totalImagesPullingTime="6.193444498s" totalInitContainerRuntime="1.350767115s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:11:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:12:03.339117128 +0000 UTC m=+810.313772698" watchObservedRunningTime="2026-06-09 07:12:03.340942439 +0000 UTC m=+810.315597983" Jun 09 07:12:04.419604 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:04.419559 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:12:04.420049 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:04.419639 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:12:04.432060 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:04.432029 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:12:05.344449 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:05.344418 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8" Jun 09 07:12:10.581061 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.581024 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv"] Jun 09 07:12:10.594194 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.594161 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.597078 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.597040 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 07:12:10.598416 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.598390 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv"] Jun 09 07:12:10.627234 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.627198 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqghg\" (UniqueName: \"kubernetes.io/projected/537a20ca-6c85-4992-b08a-dac0ec8afeee-kube-api-access-vqghg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.627407 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.627243 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.627407 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.627334 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/537a20ca-6c85-4992-b08a-dac0ec8afeee-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.627407 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.627362 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.627407 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.627386 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.627549 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.627436 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.728861 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.728819 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/537a20ca-6c85-4992-b08a-dac0ec8afeee-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.728861 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.728869 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.729133 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.728901 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.729133 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.728926 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.729133 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.729029 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqghg\" (UniqueName: \"kubernetes.io/projected/537a20ca-6c85-4992-b08a-dac0ec8afeee-kube-api-access-vqghg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.729133 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.729075 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.729403 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.729377 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.729541 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.729420 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.729541 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.729479 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.731173 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.731151 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/537a20ca-6c85-4992-b08a-dac0ec8afeee-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.731340 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.731318 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/537a20ca-6c85-4992-b08a-dac0ec8afeee-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.736231 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.736209 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqghg\" (UniqueName: \"kubernetes.io/projected/537a20ca-6c85-4992-b08a-dac0ec8afeee-kube-api-access-vqghg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lrmqv\" (UID: \"537a20ca-6c85-4992-b08a-dac0ec8afeee\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:10.906755 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:10.906724 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:11.050823 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:11.050779 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv"] Jun 09 07:12:11.052559 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:12:11.052530 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537a20ca_6c85_4992_b08a_dac0ec8afeee.slice/crio-c2b50535a23345a8f958d2f886af134341db94f5f3c011c0bf0c48245188a159 WatchSource:0}: Error finding container c2b50535a23345a8f958d2f886af134341db94f5f3c011c0bf0c48245188a159: Status 404 returned error can't find the container with id c2b50535a23345a8f958d2f886af134341db94f5f3c011c0bf0c48245188a159 Jun 09 07:12:11.370010 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:11.369912 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" event={"ID":"537a20ca-6c85-4992-b08a-dac0ec8afeee","Type":"ContainerStarted","Data":"37a2281fb20da9e70cda3b297b2605feaad5557393a2921a7f534933009d7ca4"} Jun 09 07:12:11.370010 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:11.369974 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" event={"ID":"537a20ca-6c85-4992-b08a-dac0ec8afeee","Type":"ContainerStarted","Data":"c2b50535a23345a8f958d2f886af134341db94f5f3c011c0bf0c48245188a159"} Jun 09 07:12:13.383298 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:13.383263 2549 generic.go:356] "Generic (PLEG): container finished" podID="537a20ca-6c85-4992-b08a-dac0ec8afeee" containerID="37a2281fb20da9e70cda3b297b2605feaad5557393a2921a7f534933009d7ca4" exitCode=0 Jun 09 07:12:13.383710 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:13.383337 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" event={"ID":"537a20ca-6c85-4992-b08a-dac0ec8afeee","Type":"ContainerDied","Data":"37a2281fb20da9e70cda3b297b2605feaad5557393a2921a7f534933009d7ca4"} Jun 09 07:12:14.390518 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:14.390484 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" event={"ID":"537a20ca-6c85-4992-b08a-dac0ec8afeee","Type":"ContainerStarted","Data":"7a3ae2aeaabad68d4deeb9e5d3349700810ee6ff3c0a2777515d5d502e50e7dc"} Jun 09 07:12:14.410378 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:14.410310 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" podStartSLOduration=2.914467261 podStartE2EDuration="4.410286096s" totalImagesPullingTime="223.142558ms" totalInitContainerRuntime="1.272676277s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:12:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:12:14.408576608 +0000 UTC m=+821.383232153" watchObservedRunningTime="2026-06-09 07:12:14.410286096 +0000 UTC m=+821.384941641" Jun 09 07:12:20.907529 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:20.907476 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:20.908044 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:20.907565 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:20.920495 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:20.920469 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:21.446964 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.446927 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lrmqv" Jun 09 07:12:21.568171 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.568136 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq"] Jun 09 07:12:21.574273 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.574245 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.576724 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.576697 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 09 07:12:21.584183 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.584154 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq"] Jun 09 07:12:21.638063 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.638032 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.638063 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.638067 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.638283 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.638087 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1a6efe-cadd-4a26-805e-893cd87d8b16-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.638283 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.638205 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.638283 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.638233 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.638283 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.638258 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxvvx\" (UniqueName: \"kubernetes.io/projected/4e1a6efe-cadd-4a26-805e-893cd87d8b16-kube-api-access-lxvvx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.739321 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.739218 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.739321 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.739265 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.739321 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.739294 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxvvx\" (UniqueName: \"kubernetes.io/projected/4e1a6efe-cadd-4a26-805e-893cd87d8b16-kube-api-access-lxvvx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.739610 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.739356 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.739610 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.739373 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.739610 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.739495 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1a6efe-cadd-4a26-805e-893cd87d8b16-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.739770 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.739736 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.739935 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.739820 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.739935 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.739898 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.741565 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.741540 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e1a6efe-cadd-4a26-805e-893cd87d8b16-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.741944 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.741923 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1a6efe-cadd-4a26-805e-893cd87d8b16-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.747173 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.747151 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxvvx\" (UniqueName: \"kubernetes.io/projected/4e1a6efe-cadd-4a26-805e-893cd87d8b16-kube-api-access-lxvvx\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq\" (UID: \"4e1a6efe-cadd-4a26-805e-893cd87d8b16\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:21.886223 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:21.886176 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:22.039271 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:22.039239 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq"] Jun 09 07:12:22.041312 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:12:22.041281 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1a6efe_cadd_4a26_805e_893cd87d8b16.slice/crio-0ee699481eafef1d309f72b5a2ebc7e87874e74b378d44b993a20167c204929c WatchSource:0}: Error finding container 0ee699481eafef1d309f72b5a2ebc7e87874e74b378d44b993a20167c204929c: Status 404 returned error can't find the container with id 0ee699481eafef1d309f72b5a2ebc7e87874e74b378d44b993a20167c204929c Jun 09 07:12:22.444164 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:22.444125 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" event={"ID":"4e1a6efe-cadd-4a26-805e-893cd87d8b16","Type":"ContainerStarted","Data":"8cbde45ae938ceb282f9084730e87f9f485a98f70106c2097e789a7c1aeb5b3d"} Jun 09 07:12:22.444350 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:22.444181 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" event={"ID":"4e1a6efe-cadd-4a26-805e-893cd87d8b16","Type":"ContainerStarted","Data":"0ee699481eafef1d309f72b5a2ebc7e87874e74b378d44b993a20167c204929c"} Jun 09 07:12:23.451034 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:23.450987 2549 generic.go:356] "Generic (PLEG): container finished" podID="4e1a6efe-cadd-4a26-805e-893cd87d8b16" containerID="8cbde45ae938ceb282f9084730e87f9f485a98f70106c2097e789a7c1aeb5b3d" exitCode=0 Jun 09 07:12:23.451491 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:23.451074 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" event={"ID":"4e1a6efe-cadd-4a26-805e-893cd87d8b16","Type":"ContainerDied","Data":"8cbde45ae938ceb282f9084730e87f9f485a98f70106c2097e789a7c1aeb5b3d"} Jun 09 07:12:24.459332 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:24.459299 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" event={"ID":"4e1a6efe-cadd-4a26-805e-893cd87d8b16","Type":"ContainerStarted","Data":"c8b5fb8e1b5dc0722c4ddccf24b7ce26718375b3e1f4b0131e29ba44a185c97e"} Jun 09 07:12:24.479712 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:24.479650 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" podStartSLOduration=1.944568593 podStartE2EDuration="3.479632345s" totalImagesPullingTime="234.471976ms" totalInitContainerRuntime="1.300591776s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:12:24.476696939 +0000 UTC m=+831.451352485" watchObservedRunningTime="2026-06-09 07:12:24.479632345 +0000 UTC m=+831.454287888" Jun 09 07:12:31.886768 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:31.886726 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:31.887360 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:31.886842 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:31.900143 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:31.900108 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:12:32.517631 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:12:32.517606 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq" Jun 09 07:16:49.643444 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:49.643413 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84bb5fc5f4-mq8ns_d98981ec-8b3a-4e10-b643-7b7e7f9fa57b/authorino/0.log" Jun 09 07:16:54.237811 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:54.237766 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-797c685dfd-fjqbk_03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080/nginx/0.log" Jun 09 07:16:55.155639 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:55.155611 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579b94c545-8qhkb_78d7d9b1-2ace-4ef0-8fa1-a520bf059d62/copy-manifests/0.log" Jun 09 07:16:55.173755 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:55.173722 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579b94c545-8qhkb_78d7d9b1-2ace-4ef0-8fa1-a520bf059d62/manager/0.log" Jun 09 07:16:56.301143 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.301112 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9_48fc4cb9-49ca-4889-9375-1feaaaad1ea4/util/0.log" Jun 09 07:16:56.307207 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.307180 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9_48fc4cb9-49ca-4889-9375-1feaaaad1ea4/pull/0.log" Jun 09 07:16:56.313045 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.313022 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9_48fc4cb9-49ca-4889-9375-1feaaaad1ea4/extract/0.log" Jun 09 07:16:56.423594 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.423568 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw_8c0485c5-8e01-4d9c-994f-32cd10793e3a/util/0.log" Jun 09 07:16:56.429739 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.429694 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw_8c0485c5-8e01-4d9c-994f-32cd10793e3a/pull/0.log" Jun 09 07:16:56.435198 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.435170 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw_8c0485c5-8e01-4d9c-994f-32cd10793e3a/extract/0.log" Jun 09 07:16:56.542560 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.542529 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc_3f92eb4f-245b-46ab-a11e-833a4e1646dc/pull/0.log" Jun 09 07:16:56.548910 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.548876 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc_3f92eb4f-245b-46ab-a11e-833a4e1646dc/extract/0.log" Jun 09 07:16:56.554666 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.554587 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc_3f92eb4f-245b-46ab-a11e-833a4e1646dc/util/0.log" Jun 09 07:16:56.663715 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.663684 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6_c14a8f47-a4c9-4063-bac5-5393baf484d7/util/0.log" Jun 09 07:16:56.670421 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.670389 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6_c14a8f47-a4c9-4063-bac5-5393baf484d7/pull/0.log" Jun 09 07:16:56.676734 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.676708 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6_c14a8f47-a4c9-4063-bac5-5393baf484d7/extract/0.log" Jun 09 07:16:56.788526 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.788479 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84bb5fc5f4-mq8ns_d98981ec-8b3a-4e10-b643-7b7e7f9fa57b/authorino/0.log" Jun 09 07:16:56.903400 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:56.903369 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-sn7bj_55e39ff3-dde5-432d-b979-2115a8050f34/manager/0.log" Jun 09 07:16:57.121958 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:57.121930 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gq6xk_9a33c1ad-239a-4123-ae64-8257b269946a/kuadrant-console-plugin/0.log" Jun 09 07:16:57.240409 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:57.240326 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mnttc_547ddf52-50e4-4b91-9432-2efd530c0cae/registry-server/0.log" Jun 09 07:16:57.598861 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:57.598760 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g5h6j_3960b8e4-f167-4a22-9119-a1e954f8d8b3/manager/0.log" Jun 09 07:16:57.942905 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:57.942875 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kg8df_abbd5c72-5ff3-4ba4-a9d9-681253c274a8/istio-proxy/0.log" Jun 09 07:16:58.399535 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:58.399507 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtb6d_12ce253a-3d07-447b-afb6-8c5332d0a63c/istio-proxy/1.log" Jun 09 07:16:59.058320 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:59.058286 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8_fdc82f91-31b5-4bf6-8ead-73cc837cf104/storage-initializer/0.log" Jun 09 07:16:59.065428 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:59.065393 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-7zhj8_fdc82f91-31b5-4bf6-8ead-73cc837cf104/main/0.log" Jun 09 07:16:59.181309 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:59.181282 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-lrmqv_537a20ca-6c85-4992-b08a-dac0ec8afeee/storage-initializer/0.log" Jun 09 07:16:59.189007 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:59.188978 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-lrmqv_537a20ca-6c85-4992-b08a-dac0ec8afeee/main/0.log" Jun 09 07:16:59.295717 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:59.295690 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq_4e1a6efe-cadd-4a26-805e-893cd87d8b16/main/0.log" Jun 09 07:16:59.302365 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:16:59.302338 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-5fndq_4e1a6efe-cadd-4a26-805e-893cd87d8b16/storage-initializer/0.log" Jun 09 07:17:03.769020 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.768987 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mz9tj/must-gather-kf6kn"] Jun 09 07:17:03.773249 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.773223 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mz9tj/must-gather-kf6kn" Jun 09 07:17:03.775743 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.775715 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mz9tj\"/\"kube-root-ca.crt\"" Jun 09 07:17:03.775912 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.775716 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mz9tj\"/\"default-dockercfg-97djq\"" Jun 09 07:17:03.775912 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.775853 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mz9tj\"/\"openshift-service-ca.crt\"" Jun 09 07:17:03.791742 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.791706 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mz9tj/must-gather-kf6kn"] Jun 09 07:17:03.815555 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.815520 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e177e7ac-1ccf-4f62-ae11-07ee5e217291-must-gather-output\") pod \"must-gather-kf6kn\" (UID: \"e177e7ac-1ccf-4f62-ae11-07ee5e217291\") " pod="openshift-must-gather-mz9tj/must-gather-kf6kn" Jun 09 07:17:03.815727 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.815560 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zvqf\" (UniqueName: \"kubernetes.io/projected/e177e7ac-1ccf-4f62-ae11-07ee5e217291-kube-api-access-9zvqf\") pod \"must-gather-kf6kn\" (UID: \"e177e7ac-1ccf-4f62-ae11-07ee5e217291\") " pod="openshift-must-gather-mz9tj/must-gather-kf6kn" Jun 09 07:17:03.916737 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.916693 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e177e7ac-1ccf-4f62-ae11-07ee5e217291-must-gather-output\") pod \"must-gather-kf6kn\" (UID: \"e177e7ac-1ccf-4f62-ae11-07ee5e217291\") " pod="openshift-must-gather-mz9tj/must-gather-kf6kn" Jun 09 07:17:03.916965 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.916745 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zvqf\" (UniqueName: \"kubernetes.io/projected/e177e7ac-1ccf-4f62-ae11-07ee5e217291-kube-api-access-9zvqf\") pod \"must-gather-kf6kn\" (UID: \"e177e7ac-1ccf-4f62-ae11-07ee5e217291\") " pod="openshift-must-gather-mz9tj/must-gather-kf6kn" Jun 09 07:17:03.917096 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.917074 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e177e7ac-1ccf-4f62-ae11-07ee5e217291-must-gather-output\") pod \"must-gather-kf6kn\" (UID: \"e177e7ac-1ccf-4f62-ae11-07ee5e217291\") " pod="openshift-must-gather-mz9tj/must-gather-kf6kn" Jun 09 07:17:03.924610 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:03.924579 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zvqf\" (UniqueName: \"kubernetes.io/projected/e177e7ac-1ccf-4f62-ae11-07ee5e217291-kube-api-access-9zvqf\") pod \"must-gather-kf6kn\" (UID: \"e177e7ac-1ccf-4f62-ae11-07ee5e217291\") " pod="openshift-must-gather-mz9tj/must-gather-kf6kn" Jun 09 07:17:04.085055 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:04.084968 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mz9tj/must-gather-kf6kn" Jun 09 07:17:04.224693 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:04.224662 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mz9tj/must-gather-kf6kn"] Jun 09 07:17:04.225697 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:17:04.225672 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode177e7ac_1ccf_4f62_ae11_07ee5e217291.slice/crio-59af74ca79b20c428b44e7db19169158d15e5b8fe6bb9501530babb2658f1aba WatchSource:0}: Error finding container 59af74ca79b20c428b44e7db19169158d15e5b8fe6bb9501530babb2658f1aba: Status 404 returned error can't find the container with id 59af74ca79b20c428b44e7db19169158d15e5b8fe6bb9501530babb2658f1aba Jun 09 07:17:04.227771 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:04.227752 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 07:17:05.083231 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:05.083195 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mz9tj/must-gather-kf6kn" event={"ID":"e177e7ac-1ccf-4f62-ae11-07ee5e217291","Type":"ContainerStarted","Data":"59af74ca79b20c428b44e7db19169158d15e5b8fe6bb9501530babb2658f1aba"} Jun 09 07:17:06.097485 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:06.097421 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mz9tj/must-gather-kf6kn" event={"ID":"e177e7ac-1ccf-4f62-ae11-07ee5e217291","Type":"ContainerStarted","Data":"8e67af2d6312ba0838d2f1aaec3b0ec0c70af65ece911db19ae202228fa90985"} Jun 09 07:17:06.097485 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:06.097477 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mz9tj/must-gather-kf6kn" event={"ID":"e177e7ac-1ccf-4f62-ae11-07ee5e217291","Type":"ContainerStarted","Data":"e732dfe4b7f9023930c3821cfffdc917e2e96ba3ffe01929cb991d4f017bfca9"} Jun 09 07:17:06.115699 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:06.115636 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mz9tj/must-gather-kf6kn" podStartSLOduration=2.045022399 podStartE2EDuration="3.115619249s" totalImagesPullingTime="1.07059685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:17:06.11282668 +0000 UTC m=+1113.087482226" watchObservedRunningTime="2026-06-09 07:17:06.115619249 +0000 UTC m=+1113.090274831" Jun 09 07:17:06.894332 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:06.894298 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6plnd_ea3e7624-ebcf-4493-9398-81c50f78c960/global-pull-secret-syncer/0.log" Jun 09 07:17:07.082236 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:07.082199 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wmjqv_551d572c-896f-4dd2-a0ac-b23ae45b5e9f/konnectivity-agent/0.log" Jun 09 07:17:07.151372 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:07.151342 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-166.ec2.internal_8d847be753db4224a797cf6deaab03dc/haproxy/0.log" Jun 09 07:17:11.902069 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:11.902024 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9_48fc4cb9-49ca-4889-9375-1feaaaad1ea4/extract/0.log" Jun 09 07:17:11.926382 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:11.926347 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9_48fc4cb9-49ca-4889-9375-1feaaaad1ea4/util/0.log" Jun 09 07:17:11.950584 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:11.950542 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj6h9_48fc4cb9-49ca-4889-9375-1feaaaad1ea4/pull/0.log" Jun 09 07:17:11.977345 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:11.977310 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw_8c0485c5-8e01-4d9c-994f-32cd10793e3a/extract/0.log" Jun 09 07:17:12.001493 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.001461 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw_8c0485c5-8e01-4d9c-994f-32cd10793e3a/util/0.log" Jun 09 07:17:12.022732 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.022695 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rd9gw_8c0485c5-8e01-4d9c-994f-32cd10793e3a/pull/0.log" Jun 09 07:17:12.053760 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.053715 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc_3f92eb4f-245b-46ab-a11e-833a4e1646dc/extract/0.log" Jun 09 07:17:12.087501 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.087465 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc_3f92eb4f-245b-46ab-a11e-833a4e1646dc/util/0.log" Jun 09 07:17:12.104668 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.104629 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z54dc_3f92eb4f-245b-46ab-a11e-833a4e1646dc/pull/0.log" Jun 09 07:17:12.132977 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.132936 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6_c14a8f47-a4c9-4063-bac5-5393baf484d7/extract/0.log" Jun 09 07:17:12.154978 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.154893 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6_c14a8f47-a4c9-4063-bac5-5393baf484d7/util/0.log" Jun 09 07:17:12.181973 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.181939 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klrg6_c14a8f47-a4c9-4063-bac5-5393baf484d7/pull/0.log" Jun 09 07:17:12.218154 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.218120 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-84bb5fc5f4-mq8ns_d98981ec-8b3a-4e10-b643-7b7e7f9fa57b/authorino/0.log" Jun 09 07:17:12.266234 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.266197 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-sn7bj_55e39ff3-dde5-432d-b979-2115a8050f34/manager/0.log" Jun 09 07:17:12.316079 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.316045 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gq6xk_9a33c1ad-239a-4123-ae64-8257b269946a/kuadrant-console-plugin/0.log" Jun 09 07:17:12.359920 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.359881 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mnttc_547ddf52-50e4-4b91-9432-2efd530c0cae/registry-server/0.log" Jun 09 07:17:12.480482 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:12.480383 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-g5h6j_3960b8e4-f167-4a22-9119-a1e954f8d8b3/manager/0.log" Jun 09 07:17:14.084210 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.084173 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af916cda-6a97-4f71-bb38-8496080973a5/alertmanager/0.log" Jun 09 07:17:14.116924 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.116599 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af916cda-6a97-4f71-bb38-8496080973a5/config-reloader/0.log" Jun 09 07:17:14.137091 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.137062 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af916cda-6a97-4f71-bb38-8496080973a5/kube-rbac-proxy-web/0.log" Jun 09 07:17:14.165387 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.165353 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af916cda-6a97-4f71-bb38-8496080973a5/kube-rbac-proxy/0.log" Jun 09 07:17:14.235679 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.235651 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af916cda-6a97-4f71-bb38-8496080973a5/kube-rbac-proxy-metric/0.log" Jun 09 07:17:14.282642 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.282612 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af916cda-6a97-4f71-bb38-8496080973a5/prom-label-proxy/0.log" Jun 09 07:17:14.317373 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.317341 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_af916cda-6a97-4f71-bb38-8496080973a5/init-config-reloader/0.log" Jun 09 07:17:14.352326 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.352238 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-nb6tm_74f83c3b-7e60-4a98-99c5-2566ad7e8134/cluster-monitoring-operator/0.log" Jun 09 07:17:14.387924 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.387888 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-cfvwh_9705be75-1b0e-4938-924c-2eda579c28aa/kube-state-metrics/0.log" Jun 09 07:17:14.409459 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.409427 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-cfvwh_9705be75-1b0e-4938-924c-2eda579c28aa/kube-rbac-proxy-main/0.log" Jun 09 07:17:14.431472 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.431439 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-cfvwh_9705be75-1b0e-4938-924c-2eda579c28aa/kube-rbac-proxy-self/0.log" Jun 09 07:17:14.708141 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.708110 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfchc_a850d51d-2a72-410f-b923-969ef31006ce/node-exporter/0.log" Jun 09 07:17:14.733885 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.733854 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfchc_a850d51d-2a72-410f-b923-969ef31006ce/kube-rbac-proxy/0.log" Jun 09 07:17:14.766995 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:14.766963 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfchc_a850d51d-2a72-410f-b923-969ef31006ce/init-textfile/0.log" Jun 09 07:17:15.254727 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:15.254695 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/thanos-query/0.log" Jun 09 07:17:15.276044 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:15.276010 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/kube-rbac-proxy-web/0.log" Jun 09 07:17:15.299403 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:15.299372 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/kube-rbac-proxy/0.log" Jun 09 07:17:15.320756 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:15.320714 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/prom-label-proxy/0.log" Jun 09 07:17:15.343263 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:15.343217 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/kube-rbac-proxy-rules/0.log" Jun 09 07:17:15.367058 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:15.367025 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dff4c7658-6vbxc_bec2a29c-b02c-4c1b-ad9d-ac117ff18c5c/kube-rbac-proxy-metrics/0.log" Jun 09 07:17:17.690519 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.690476 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6"] Jun 09 07:17:17.696330 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.696293 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.704423 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.704390 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6"] Jun 09 07:17:17.764267 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.764227 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-podres\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.764473 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.764341 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-sys\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.764473 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.764391 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-proc\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.764473 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.764415 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-lib-modules\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.764473 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.764447 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtlp4\" (UniqueName: \"kubernetes.io/projected/e365d4e6-94ea-4374-919b-5118e6169032-kube-api-access-vtlp4\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.866035 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.865990 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-podres\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.866235 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.866082 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-sys\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.866235 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.866138 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-proc\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.866235 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.866163 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-lib-modules\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.866235 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.866194 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtlp4\" (UniqueName: \"kubernetes.io/projected/e365d4e6-94ea-4374-919b-5118e6169032-kube-api-access-vtlp4\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.866585 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.866563 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-sys\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.866697 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.866564 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-proc\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.866781 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.866648 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-podres\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.866901 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.866740 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e365d4e6-94ea-4374-919b-5118e6169032-lib-modules\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:17.874699 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:17.874667 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtlp4\" (UniqueName: \"kubernetes.io/projected/e365d4e6-94ea-4374-919b-5118e6169032-kube-api-access-vtlp4\") pod \"perf-node-gather-daemonset-k89w6\" (UID: \"e365d4e6-94ea-4374-919b-5118e6169032\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:18.014112 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:18.014009 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:18.216390 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:18.216344 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6"] Jun 09 07:17:18.216632 ip-10-0-139-166 kubenswrapper[2549]: W0609 07:17:18.216592 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode365d4e6_94ea_4374_919b_5118e6169032.slice/crio-753a40650a94a1f566b16dc533d611a80727f1ce1f93d1e93d0041cc009e0b5a WatchSource:0}: Error finding container 753a40650a94a1f566b16dc533d611a80727f1ce1f93d1e93d0041cc009e0b5a: Status 404 returned error can't find the container with id 753a40650a94a1f566b16dc533d611a80727f1ce1f93d1e93d0041cc009e0b5a Jun 09 07:17:18.697203 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:18.697165 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-wvq5s_06451910-e51a-4b1e-a22c-21f8ba4c1997/volume-data-source-validator/0.log" Jun 09 07:17:19.212827 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:19.212763 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" event={"ID":"e365d4e6-94ea-4374-919b-5118e6169032","Type":"ContainerStarted","Data":"d51cb11c720f6099168539ad2225059c3f420f97babcbb07da9636353f322732"} Jun 09 07:17:19.213048 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:19.212900 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" event={"ID":"e365d4e6-94ea-4374-919b-5118e6169032","Type":"ContainerStarted","Data":"753a40650a94a1f566b16dc533d611a80727f1ce1f93d1e93d0041cc009e0b5a"} Jun 09 07:17:19.213048 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:19.212971 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:19.230465 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:19.230395 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" podStartSLOduration=2.230375272 podStartE2EDuration="2.230375272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:17:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:17:19.229807339 +0000 UTC m=+1126.204462887" watchObservedRunningTime="2026-06-09 07:17:19.230375272 +0000 UTC m=+1126.205030818" Jun 09 07:17:19.904128 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:19.904078 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mzkvs_27d1e129-2183-4926-8818-8e57fb66b135/dns/0.log" Jun 09 07:17:19.924154 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:19.924118 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mzkvs_27d1e129-2183-4926-8818-8e57fb66b135/kube-rbac-proxy/0.log" Jun 09 07:17:19.996833 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:19.996804 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qrvxd_9980c63f-e2a5-40ff-a193-80276600e53e/dns-node-resolver/0.log" Jun 09 07:17:20.611668 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:20.611612 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ck9kl_ce4336dd-2dbb-4c2d-bd1c-ae95ca47aa57/node-ca/0.log" Jun 09 07:17:21.587546 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:21.587513 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kg8df_abbd5c72-5ff3-4ba4-a9d9-681253c274a8/istio-proxy/0.log" Jun 09 07:17:21.731752 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:21.731716 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtb6d_12ce253a-3d07-447b-afb6-8c5332d0a63c/istio-proxy/1.log" Jun 09 07:17:21.732465 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:21.732437 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtb6d_12ce253a-3d07-447b-afb6-8c5332d0a63c/istio-proxy/0.log" Jun 09 07:17:22.422212 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:22.422180 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b7kqp_ab32aba1-b670-4d72-9bc1-ba4ad66f9bfa/serve-healthcheck-canary/0.log" Jun 09 07:17:22.951962 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:22.951922 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-6z6kw_093db7d2-34f9-4e0f-8654-9b89613f0777/insights-operator/0.log" Jun 09 07:17:22.956158 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:22.956115 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-6z6kw_093db7d2-34f9-4e0f-8654-9b89613f0777/insights-operator/1.log" Jun 09 07:17:23.110314 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:23.110278 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-thhfw_e0460ca1-c50b-4cbe-b28e-25a10e446678/kube-rbac-proxy/0.log" Jun 09 07:17:23.129560 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:23.129515 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-thhfw_e0460ca1-c50b-4cbe-b28e-25a10e446678/exporter/0.log" Jun 09 07:17:23.151277 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:23.151247 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-thhfw_e0460ca1-c50b-4cbe-b28e-25a10e446678/extractor/0.log" Jun 09 07:17:25.230969 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:25.230868 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-k89w6" Jun 09 07:17:25.357237 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:25.357205 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-797c685dfd-fjqbk_03e10bb1-aaf0-41ea-bdb1-e6fd36ee0080/nginx/0.log" Jun 09 07:17:25.666116 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:25.666068 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579b94c545-8qhkb_78d7d9b1-2ace-4ef0-8fa1-a520bf059d62/manager/0.log" Jun 09 07:17:25.682802 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:25.682770 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579b94c545-8qhkb_78d7d9b1-2ace-4ef0-8fa1-a520bf059d62/copy-manifests/0.log" Jun 09 07:17:27.594822 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:27.593612 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d96c9b794-g8jng_37177d7a-ee8b-44a8-8330-5b42be2fb37a/manager/0.log" Jun 09 07:17:32.632893 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:32.632853 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kg8df_abbd5c72-5ff3-4ba4-a9d9-681253c274a8/istio-proxy/0.log" Jun 09 07:17:32.751489 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:32.751455 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtb6d_12ce253a-3d07-447b-afb6-8c5332d0a63c/istio-proxy/0.log" Jun 09 07:17:32.752714 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:32.752667 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtb6d_12ce253a-3d07-447b-afb6-8c5332d0a63c/istio-proxy/1.log" Jun 09 07:17:32.919009 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:32.918981 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-hxr2t_585c6571-f48c-4217-b902-4727dc1422ce/migrator/0.log" Jun 09 07:17:32.940803 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:32.940762 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-hxr2t_585c6571-f48c-4217-b902-4727dc1422ce/graceful-termination/0.log" Jun 09 07:17:34.039654 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:34.039622 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kg8df_abbd5c72-5ff3-4ba4-a9d9-681253c274a8/istio-proxy/0.log" Jun 09 07:17:34.145409 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:34.145348 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtb6d_12ce253a-3d07-447b-afb6-8c5332d0a63c/istio-proxy/1.log" Jun 09 07:17:34.146243 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:34.146214 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-mtb6d_12ce253a-3d07-447b-afb6-8c5332d0a63c/istio-proxy/0.log" Jun 09 07:17:35.090519 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:35.090493 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ktxwt_8257064f-cf68-45e7-b2b9-840f81301f5f/kube-multus-additional-cni-plugins/0.log" Jun 09 07:17:35.110094 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:35.110067 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ktxwt_8257064f-cf68-45e7-b2b9-840f81301f5f/egress-router-binary-copy/0.log" Jun 09 07:17:35.129926 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:35.129895 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ktxwt_8257064f-cf68-45e7-b2b9-840f81301f5f/cni-plugins/0.log" Jun 09 07:17:35.149647 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:35.149616 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ktxwt_8257064f-cf68-45e7-b2b9-840f81301f5f/bond-cni-plugin/0.log" Jun 09 07:17:35.171022 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:35.170945 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ktxwt_8257064f-cf68-45e7-b2b9-840f81301f5f/routeoverride-cni/0.log" Jun 09 07:17:35.192375 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:35.192342 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ktxwt_8257064f-cf68-45e7-b2b9-840f81301f5f/whereabouts-cni-bincopy/0.log" Jun 09 07:17:35.213520 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:35.213493 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ktxwt_8257064f-cf68-45e7-b2b9-840f81301f5f/whereabouts-cni/0.log" Jun 09 07:17:35.316892 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:35.316855 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t4ll6_bf3a564d-0449-43b8-a226-b2430d255604/kube-multus/0.log" Jun 09 07:17:35.338454 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:35.338421 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5gj2q_6ff5d471-42f5-46ff-84d5-e276685218dc/network-metrics-daemon/0.log" Jun 09 07:17:35.361513 ip-10-0-139-166 kubenswrapper[2549]: I0609 07:17:35.361475 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5gj2q_6ff5d471-42f5-46ff-84d5-e276685218dc/kube-rbac-proxy/0.log"