Jun 14 14:52:46.512261 ip-10-0-133-52 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 14 14:52:46.512272 ip-10-0-133-52 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 14 14:52:46.512279 ip-10-0-133-52 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 14 14:52:46.512490 ip-10-0-133-52 systemd[1]: Failed to start Kubernetes Kubelet. Jun 14 14:52:56.399275 ip-10-0-133-52 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 14 14:52:56.399290 ip-10-0-133-52 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0a6f1e796c204df5b27dd0b3b7c530e9 -- Jun 14 14:55:02.231869 ip-10-0-133-52 systemd[1]: Starting Kubernetes Kubelet... Jun 14 14:55:02.643955 ip-10-0-133-52 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:55:02.643955 ip-10-0-133-52 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 14:55:02.643955 ip-10-0-133-52 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:55:02.643955 ip-10-0-133-52 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 14:55:02.643955 ip-10-0-133-52 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 14:55:02.644651 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.644011 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 14:55:02.650087 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650067 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:02.650087 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650088 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650093 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650097 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650099 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650102 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650105 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650108 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650110 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650113 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650121 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650123 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650126 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650128 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650131 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650134 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650137 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650139 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650142 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650145 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650148 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:02.650166 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650150 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650153 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650156 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650158 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650161 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650163 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650165 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650168 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650171 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650174 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650177 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650179 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650182 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650184 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650186 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650189 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650194 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650198 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650201 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650204 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:02.650686 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650206 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650209 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650213 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650216 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650218 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650221 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650223 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650225 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650228 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650230 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650232 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650235 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650238 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650240 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650244 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650246 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650249 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650251 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650253 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650256 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650258 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:02.651354 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650261 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650263 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650266 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650268 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650271 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650273 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650275 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650278 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650280 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650283 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650285 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650288 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650290 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650292 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650296 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650298 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650301 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650305 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650308 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:02.652271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650310 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650313 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650316 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650318 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650321 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650323 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650326 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650329 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650331 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650333 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650336 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650340 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650343 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650347 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650350 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650352 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650355 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.650357 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.651988 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:02.652774 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652011 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652016 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652026 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652031 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652036 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652041 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652045 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652050 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652054 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652059 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652063 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652068 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652072 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652077 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652081 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652092 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652096 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652102 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652113 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:02.653259 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652121 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652127 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652131 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652135 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652140 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652144 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652148 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652158 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652163 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652168 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652172 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652177 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652214 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652230 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652235 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652239 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652242 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652248 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652253 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652258 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:02.653773 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652263 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652266 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652269 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652272 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652279 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652282 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652285 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652289 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652293 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652423 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652430 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652433 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652436 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652439 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652442 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652445 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652447 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652452 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652455 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652458 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:02.654311 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652460 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652463 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652466 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652468 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652472 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652476 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652479 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652481 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652484 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652486 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652489 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652491 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652494 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652496 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652499 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652501 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652505 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652509 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652512 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:02.654937 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652514 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652517 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652519 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652522 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652524 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652526 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652529 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652531 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652534 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652536 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652538 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652541 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652543 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652546 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652548 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652551 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652553 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652556 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652575 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652579 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:02.655415 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652968 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652973 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652975 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652978 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652980 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652983 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652986 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652988 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652991 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652993 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652996 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.652999 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653001 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653004 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653006 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653008 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653019 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653022 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653024 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653027 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:02.655922 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653030 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653032 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653034 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653037 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653039 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653042 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653044 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653047 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653049 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653052 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653055 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653057 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653060 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653062 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653065 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653069 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653072 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653075 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653077 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653080 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:02.656418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653082 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653085 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653087 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653089 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653092 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653094 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653097 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653101 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653104 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653107 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653110 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653113 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653116 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653118 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653121 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653123 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653125 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653128 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653130 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653133 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:02.656950 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653135 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653138 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653141 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653144 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653146 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653149 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653152 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653154 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653157 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653159 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653161 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653164 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653166 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653168 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653170 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653173 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653175 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653177 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653180 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653182 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:02.657452 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653184 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653186 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653189 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653192 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653194 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653196 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653201 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653204 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653209 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653211 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653214 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653216 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653219 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653221 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653224 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653226 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653230 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653233 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653235 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:02.657974 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653305 2572 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653312 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653330 2572 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653334 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653338 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653341 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653345 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653349 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653352 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653355 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653358 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653361 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653364 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653367 2572 flags.go:64] FLAG: --cgroup-root="" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653369 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653372 2572 flags.go:64] FLAG: --client-ca-file="" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653375 2572 flags.go:64] FLAG: --cloud-provider="external" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653378 2572 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653382 2572 flags.go:64] FLAG: --cluster-domain="" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653387 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653389 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653394 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653397 2572 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653400 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 14:55:02.658444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653403 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653406 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653409 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653411 2572 flags.go:64] FLAG: --contention-profiling="false" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653414 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653417 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653420 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653422 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653426 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653429 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653431 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653434 2572 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653437 2572 flags.go:64] FLAG: --enable-server="true" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653440 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653444 2572 flags.go:64] FLAG: --event-burst="100" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653447 2572 flags.go:64] FLAG: --event-qps="50" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653450 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653452 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653455 2572 flags.go:64] FLAG: --eviction-hard="" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653459 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653462 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653464 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653467 2572 flags.go:64] FLAG: --eviction-soft="" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653470 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653472 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 14:55:02.659077 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653476 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653479 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653483 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653485 2572 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653489 2572 flags.go:64] FLAG: --feature-gates="" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653492 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653495 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653498 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653501 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653504 2572 flags.go:64] FLAG: --healthz-port="10248" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653507 2572 flags.go:64] FLAG: --help="false" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653509 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-133-52.ec2.internal" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653512 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653515 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653517 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653520 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653523 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653527 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653529 2572 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653532 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653534 2572 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653538 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653540 2572 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653543 2572 flags.go:64] FLAG: --kube-reserved="" Jun 14 14:55:02.659780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653546 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653548 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653551 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653553 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653556 2572 flags.go:64] FLAG: --lock-file="" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653575 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653580 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653584 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653596 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653599 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653603 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653606 2572 flags.go:64] FLAG: --logging-format="text" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653610 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653613 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653616 2572 flags.go:64] FLAG: --manifest-url="" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653618 2572 flags.go:64] FLAG: --manifest-url-header="" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653622 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653625 2572 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653630 2572 flags.go:64] FLAG: --max-pods="110" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653632 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653635 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653638 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653640 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653643 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653646 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 14:55:02.660442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653648 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653655 2572 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653657 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653660 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653663 2572 flags.go:64] FLAG: --pod-cidr="" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653666 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653671 2572 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653673 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653676 2572 flags.go:64] FLAG: --pods-per-core="0" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653679 2572 flags.go:64] FLAG: --port="10250" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653682 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653685 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f32a0ac29b3c0397" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653687 2572 flags.go:64] FLAG: --qos-reserved="" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653690 2572 flags.go:64] FLAG: --read-only-port="10255" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653693 2572 flags.go:64] FLAG: --register-node="true" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653696 2572 flags.go:64] FLAG: --register-with-taints="" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653699 2572 flags.go:64] FLAG: --registry-burst="10" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653703 2572 flags.go:64] FLAG: --registry-qps="5" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653706 2572 flags.go:64] FLAG: --reserved-cpus="" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653709 2572 flags.go:64] FLAG: --reserved-memory="" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653713 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653716 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653719 2572 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653721 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653724 2572 flags.go:64] FLAG: --runonce="false" Jun 14 14:55:02.661112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653726 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653730 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653732 2572 flags.go:64] FLAG: --seccomp-default="false" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653735 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653737 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653740 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653743 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653746 2572 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653749 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653751 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653754 2572 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653757 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653759 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653762 2572 flags.go:64] FLAG: --system-cgroups="" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653765 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653769 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653772 2572 flags.go:64] FLAG: --tls-cert-file="" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653775 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653778 2572 flags.go:64] FLAG: --tls-min-version="" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653781 2572 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653784 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653786 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653789 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653792 2572 flags.go:64] FLAG: --v="2" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653797 2572 flags.go:64] FLAG: --version="false" Jun 14 14:55:02.661767 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653801 2572 flags.go:64] FLAG: --vmodule="" Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653805 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.653809 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653917 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653921 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653924 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653927 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653930 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653933 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653935 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653938 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653941 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653943 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653945 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653948 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653950 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653953 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653955 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653957 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653959 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:02.662388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653962 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653964 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653967 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653969 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653971 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653973 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653976 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653978 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653980 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653983 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653985 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653990 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653992 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.653996 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654002 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654005 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654009 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654012 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654015 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:02.662912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654017 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654020 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654022 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654025 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654029 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654032 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654035 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654037 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654040 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654043 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654045 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654048 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654050 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654052 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654055 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654057 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654060 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654062 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654065 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:02.663388 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654067 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654069 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654072 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654074 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654077 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654080 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654083 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654085 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654089 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654092 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654094 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654096 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654099 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654101 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654103 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654106 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654108 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654110 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654113 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654115 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:02.663912 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654118 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654120 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654123 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654125 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654128 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654130 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654133 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654135 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654138 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654140 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654143 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654145 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654147 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654150 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654152 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654155 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654157 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654161 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654163 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654165 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:02.664421 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654170 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654173 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654175 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.654177 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.654772 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.661673 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.661689 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.661702 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.661708 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661762 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661767 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661770 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661773 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661776 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661779 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:02.664940 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661782 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661785 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661788 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661790 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661793 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661795 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661797 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661800 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661803 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661805 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661808 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661810 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661812 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661815 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661817 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661820 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661822 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661825 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661827 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:02.665334 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661830 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661834 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661836 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661839 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661843 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661846 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661849 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661852 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661854 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661856 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661859 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661861 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661864 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661866 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661868 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661870 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661873 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661875 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661878 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661881 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:02.665853 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661883 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661886 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661889 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661891 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661894 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661896 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661899 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661901 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661903 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661906 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661908 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661911 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661913 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661915 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661918 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661921 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661925 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661932 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661935 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:02.666355 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661937 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661940 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661943 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661945 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661948 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661950 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661953 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661955 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661958 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661960 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661962 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661965 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661967 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661970 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661972 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661975 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661978 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661980 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661983 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661985 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:02.666944 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661987 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661990 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661992 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661994 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661997 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.661999 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662001 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662004 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662006 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662010 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662014 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662017 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662020 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662023 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:02.667502 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662025 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.662031 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662141 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662146 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662148 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662151 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662153 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662156 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662158 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662161 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662163 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662165 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662168 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662171 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 14:55:02.667876 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662174 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662176 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662179 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662181 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662185 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662188 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662191 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662194 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662197 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662200 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662202 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662205 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662208 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662210 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662212 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662215 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662221 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662223 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662225 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 14:55:02.668244 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662228 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662231 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662233 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662236 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662238 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662240 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662243 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662245 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662247 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662250 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662252 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662254 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662257 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662259 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662261 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662264 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662266 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662268 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662271 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662273 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 14:55:02.668743 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662275 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662277 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662280 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662282 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662285 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662288 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662290 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662292 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662295 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662297 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662305 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662307 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662310 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662312 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662314 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662317 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662319 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662321 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662323 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662326 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 14:55:02.669243 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662328 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662330 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662332 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662335 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662337 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662339 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662342 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662344 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662346 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662349 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662351 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662353 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662356 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662358 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662360 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662363 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662366 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662369 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662372 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 14:55:02.669810 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662375 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662378 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662380 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662383 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662386 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662388 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662390 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662393 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:02.662396 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.662401 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.662521 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.665420 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.666971 2572 server.go:1019] "Starting client certificate rotation" Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.667065 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:55:02.670271 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.667106 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 14:55:02.670663 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.669403 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:55:02.671599 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.671584 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 14:55:02.685867 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.685846 2572 log.go:25] "Validated CRI v1 runtime API" Jun 14 14:55:02.689481 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.689468 2572 log.go:25] "Validated CRI v1 image API" Jun 14 14:55:02.692748 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.692727 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 14:55:02.696796 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.696767 2572 fs.go:135] Filesystem UUIDs: map[4ef607b1-df46-4a62-a87c-4506fbb51587:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e368ddab-4c31-40fa-a76f-59dc30edf2f3:/dev/nvme0n1p3] Jun 14 14:55:02.696868 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.696795 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 14:55:02.698893 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.698876 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:55:02.702766 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.702655 2572 manager.go:216] Machine: {Timestamp:2026-06-14 14:55:02.700747934 +0000 UTC m=+0.351941293 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3174141 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec216455928285ccf38751580ad8a422 SystemUUID:ec216455-9282-85cc-f387-51580ad8a422 BootID:0a6f1e79-6c20-4df5-b27d-d0b3b7c530e9 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:42:7e:a7:60:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:42:7e:a7:60:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:0b:10:80:af:07 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 14:55:02.702766 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.702762 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 14:55:02.702884 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.702841 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 14:55:02.706730 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.706702 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 14:55:02.706895 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.706733 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-52.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 14:55:02.707724 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.707714 2572 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 14:55:02.707762 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.707727 2572 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 14:55:02.707762 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.707734 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:55:02.708421 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.708411 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 14:55:02.709918 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.709908 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 14:55:02.712956 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.712945 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:55:02.713076 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.713066 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 14:55:02.713117 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.713097 2572 kubelet.go:486] "Attempting to sync node with API server" Jun 14 14:55:02.713117 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.713115 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 14:55:02.713185 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.713126 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 14:55:02.713185 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.713136 2572 kubelet.go:398] "Adding apiserver pod source" Jun 14 14:55:02.713185 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.713147 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 14:55:02.713535 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.713521 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:55:02.713633 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.713543 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 14:55:02.716112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.716099 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 14:55:02.717743 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.717728 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 14:55:02.717794 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.717760 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 14:55:02.717904 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.717894 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 14:55:02.717936 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.717910 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 14:55:02.717936 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.717916 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 14:55:02.717936 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.717922 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 14:55:02.717936 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.717930 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 14:55:02.717936 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.717935 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 14:55:02.718958 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.718949 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 14:55:02.718958 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.718957 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 14:55:02.719024 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.718964 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 14:55:02.719024 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.718969 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 14:55:02.719024 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.718980 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 14:55:02.719024 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.718988 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 14:55:02.720658 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.720648 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 14:55:02.720658 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.720659 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 14:55:02.721578 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.721534 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pzdvd" Jun 14 14:55:02.724099 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.724085 2572 server.go:1268] "Started kubelet" Jun 14 14:55:02.724209 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.724164 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 14:55:02.724261 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.724233 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 14:55:02.724315 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.724289 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 14:55:02.725032 ip-10-0-133-52 systemd[1]: Started Kubernetes Kubelet. Jun 14 14:55:02.725715 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.725629 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pzdvd" Jun 14 14:55:02.728425 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.728402 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 14:55:02.729001 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.728984 2572 server.go:310] "Adding debug handlers to kubelet server" Jun 14 14:55:02.729085 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.729021 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 14:55:02.729124 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.729088 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-52.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 14:55:02.729290 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.729267 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 14:55:02.732311 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.732286 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 14:55:02.735615 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.735391 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 14:55:02.735944 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.735395 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 14:55:02.736036 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.736003 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-52.ec2.internal\" not found" Jun 14 14:55:02.736524 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.736505 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 14:55:02.736524 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.736523 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 14:55:02.736667 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.736631 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 14:55:02.736667 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.736635 2572 reconstruct.go:97] "Volume reconstruction finished" Jun 14 14:55:02.736667 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.736643 2572 reconciler.go:29] "Reconciler: start to sync state" Jun 14 14:55:02.736826 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.736810 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 14:55:02.736874 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.736828 2572 factory.go:55] Registering systemd factory Jun 14 14:55:02.736874 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.736838 2572 factory.go:223] Registration of the systemd container factory successfully Jun 14 14:55:02.737126 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.737113 2572 factory.go:153] Registering CRI-O factory Jun 14 14:55:02.737206 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.737128 2572 factory.go:223] Registration of the crio container factory successfully Jun 14 14:55:02.737206 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.737149 2572 factory.go:103] Registering Raw factory Jun 14 14:55:02.737206 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.737164 2572 manager.go:1196] Started watching for new ooms in manager Jun 14 14:55:02.737489 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.737476 2572 manager.go:349] Starting recovery of all containers Jun 14 14:55:02.738149 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.738129 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:02.740453 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.740428 2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-52.ec2.internal\" not found" node="ip-10-0-133-52.ec2.internal" Jun 14 14:55:02.746389 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.746369 2572 manager.go:354] Recovery completed Jun 14 14:55:02.750269 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.750255 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:02.752231 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.752214 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:02.752314 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.752248 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:02.752314 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.752264 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:02.752764 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.752752 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 14:55:02.752764 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.752763 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 14:55:02.752853 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.752779 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 14 14:55:02.752853 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.752811 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:02.753508 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.753491 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:02.753591 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.753523 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:02.753591 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.753534 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:02.754046 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.754034 2572 policy_none.go:49] "None policy: Start" Jun 14 14:55:02.754081 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.754058 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 14:55:02.754081 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.754069 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 14:55:02.755095 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.755085 2572 policy_none.go:47] "Start" Jun 14 14:55:02.797176 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.797159 2572 manager.go:337] "Starting Device Plugin manager" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.797194 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.797203 2572 server.go:87] "Starting device plugin registration server" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.797454 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.797467 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.797576 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.797824 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.797834 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.798197 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.798238 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-52.ec2.internal\" not found" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.799180 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.800447 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.800489 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.800511 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.800554 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 14:55:02.804597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.802464 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:02.897865 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.897788 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:02.898888 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.898871 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:02.898961 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.898912 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:02.898961 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.898925 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:02.898961 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.898948 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-52.ec2.internal" Jun 14 14:55:02.901024 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.900999 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-52.ec2.internal"] Jun 14 14:55:02.901078 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.901069 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:02.902445 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.902423 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:02.902497 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.902454 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:02.902497 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.902469 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:02.904068 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.904057 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:02.904212 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.904200 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" Jun 14 14:55:02.904246 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.904231 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:02.904801 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.904785 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:02.904847 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.904802 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:02.904847 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.904811 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:02.904847 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.904826 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:02.904847 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.904839 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:02.904954 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.904827 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:02.906020 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.906001 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-52.ec2.internal" Jun 14 14:55:02.906020 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.906025 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 14:55:02.907886 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.907869 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientMemory" Jun 14 14:55:02.907977 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.907896 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 14:55:02.907977 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.907911 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeHasSufficientPID" Jun 14 14:55:02.908293 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.908278 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-52.ec2.internal" Jun 14 14:55:02.908397 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.908384 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-52.ec2.internal\": node \"ip-10-0-133-52.ec2.internal\" not found" Jun 14 14:55:02.921174 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.921152 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-52.ec2.internal\" not found" Jun 14 14:55:02.930207 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.930184 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-52.ec2.internal\" not found" node="ip-10-0-133-52.ec2.internal" Jun 14 14:55:02.934237 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:02.934222 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-52.ec2.internal\" not found" node="ip-10-0-133-52.ec2.internal" Jun 14 14:55:02.938393 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.938366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/630fd728252483618807b2f982470dbd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal\" (UID: \"630fd728252483618807b2f982470dbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" Jun 14 14:55:02.938480 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.938407 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630fd728252483618807b2f982470dbd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal\" (UID: \"630fd728252483618807b2f982470dbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" Jun 14 14:55:02.938480 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:02.938431 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e20e21bef33d0fe9c39c7011fd989107-config\") pod \"kube-apiserver-proxy-ip-10-0-133-52.ec2.internal\" (UID: \"e20e21bef33d0fe9c39c7011fd989107\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-52.ec2.internal" Jun 14 14:55:03.022222 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.022174 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-52.ec2.internal\" not found" Jun 14 14:55:03.039423 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.039393 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/630fd728252483618807b2f982470dbd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal\" (UID: \"630fd728252483618807b2f982470dbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" Jun 14 14:55:03.039541 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.039430 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630fd728252483618807b2f982470dbd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal\" (UID: \"630fd728252483618807b2f982470dbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" Jun 14 14:55:03.039541 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.039448 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e20e21bef33d0fe9c39c7011fd989107-config\") pod \"kube-apiserver-proxy-ip-10-0-133-52.ec2.internal\" (UID: \"e20e21bef33d0fe9c39c7011fd989107\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-52.ec2.internal" Jun 14 14:55:03.039541 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.039489 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630fd728252483618807b2f982470dbd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal\" (UID: \"630fd728252483618807b2f982470dbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" Jun 14 14:55:03.039541 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.039492 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/630fd728252483618807b2f982470dbd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal\" (UID: \"630fd728252483618807b2f982470dbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" Jun 14 14:55:03.039691 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.039543 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e20e21bef33d0fe9c39c7011fd989107-config\") pod \"kube-apiserver-proxy-ip-10-0-133-52.ec2.internal\" (UID: \"e20e21bef33d0fe9c39c7011fd989107\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-52.ec2.internal" Jun 14 14:55:03.122976 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.122944 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-52.ec2.internal\" not found" Jun 14 14:55:03.223833 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.223758 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-52.ec2.internal\" not found" Jun 14 14:55:03.232921 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.232899 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" Jun 14 14:55:03.237131 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.237111 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-52.ec2.internal" Jun 14 14:55:03.324384 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.324337 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-52.ec2.internal\" not found" Jun 14 14:55:03.424914 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.424887 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-52.ec2.internal\" not found" Jun 14 14:55:03.525446 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.525371 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-52.ec2.internal\" not found" Jun 14 14:55:03.625955 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.625927 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-52.ec2.internal\" not found" Jun 14 14:55:03.636378 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.636353 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:03.666443 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.666410 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 14:55:03.667120 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.666578 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:55:03.667120 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.666593 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:55:03.667120 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.666604 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 14:55:03.677528 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.677510 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:03.683165 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:03.683127 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630fd728252483618807b2f982470dbd.slice/crio-3ad7de9f1c53cbc3477287f682a8127f34cd32d5332c9a53778b35d49dba8517 WatchSource:0}: Error finding container 3ad7de9f1c53cbc3477287f682a8127f34cd32d5332c9a53778b35d49dba8517: Status 404 returned error can't find the container with id 3ad7de9f1c53cbc3477287f682a8127f34cd32d5332c9a53778b35d49dba8517 Jun 14 14:55:03.683504 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:03.683488 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20e21bef33d0fe9c39c7011fd989107.slice/crio-5cc286c82307ed0d124ef175f2d46904a78a6220e5b4bbfab426151c1d6e113d WatchSource:0}: Error finding container 5cc286c82307ed0d124ef175f2d46904a78a6220e5b4bbfab426151c1d6e113d: Status 404 returned error can't find the container with id 5cc286c82307ed0d124ef175f2d46904a78a6220e5b4bbfab426151c1d6e113d Jun 14 14:55:03.688965 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.688951 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 14:55:03.713580 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.713549 2572 apiserver.go:52] "Watching apiserver" Jun 14 14:55:03.722410 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.722386 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 14:55:03.722737 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.722714 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-268sq","kube-system/konnectivity-agent-xjtcd","openshift-dns/node-resolver-ff8ft","openshift-multus/multus-7q4bp","openshift-multus/network-metrics-daemon-2dkvj","openshift-network-diagnostics/network-check-target-8dqpj","openshift-network-operator/iptables-alerter-9bbbd","openshift-ovn-kubernetes/ovnkube-node-vrfxm","kube-system/global-pull-secret-syncer-k4qgj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb","openshift-cluster-node-tuning-operator/tuned-8wqlf","openshift-image-registry/node-ca-mlskw"] Jun 14 14:55:03.724986 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.724968 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.726189 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.726174 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:03.726258 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.726237 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:03.727278 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.727260 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:03.727360 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.727341 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:03.727436 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.727424 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 14:55:03.727487 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.727453 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 14:55:03.727553 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.727530 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 14:55:03.727663 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.727591 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zgnw7\"" Jun 14 14:55:03.727663 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.727626 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 14:55:03.727663 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.727628 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 14:55:03.728346 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.728317 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9bbbd" Jun 14 14:55:03.729814 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.729799 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.730384 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.730364 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rjjt4\"" Jun 14 14:55:03.730472 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.730395 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 14:55:03.730537 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.730479 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 14:55:03.730614 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.730522 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 14:50:02 +0000 UTC" deadline="2027-12-15 22:09:12.517952601 +0000 UTC" Jun 14 14:55:03.730614 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.730596 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13183h14m8.787360178s" Jun 14 14:55:03.730706 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.730619 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:55:03.731639 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.731625 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.732311 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.732292 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 14:55:03.732511 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.732491 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 14:55:03.732511 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.732502 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 14:55:03.732511 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.732508 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 14:55:03.732752 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.732734 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lhsg6\"" Jun 14 14:55:03.732811 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.732791 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 14:55:03.732811 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.732794 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 14:55:03.733006 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.732990 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.733792 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.733775 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 14:55:03.733792 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.733784 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 14:55:03.734038 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.734011 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-prw7m\"" Jun 14 14:55:03.734123 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.734066 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 14:55:03.734123 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.734076 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mlskw" Jun 14 14:55:03.735124 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.735106 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:55:03.735239 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.735198 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 14:55:03.735239 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.735206 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dgkxr\"" Jun 14 14:55:03.735406 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.735390 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:03.736045 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.736030 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 14:55:03.736129 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.736060 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 14:55:03.736225 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.736211 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 14:55:03.736342 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.736262 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" Jun 14 14:55:03.737069 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.736746 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ff8ft" Jun 14 14:55:03.737069 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.736766 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xg7xj\"" Jun 14 14:55:03.737069 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.736785 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 14:55:03.738027 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.737987 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gnd96\"" Jun 14 14:55:03.738235 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.738210 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 14:55:03.739651 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.738380 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.739651 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.738383 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 14:55:03.739651 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.739235 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 14:55:03.739651 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.739296 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 14:55:03.739651 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.739497 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9dxjr\"" Jun 14 14:55:03.740652 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.740632 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:03.740772 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.740752 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:03.741886 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.740955 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 14:55:03.741886 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.741764 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mrsst\"" Jun 14 14:55:03.743519 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743503 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-run-systemd\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.743621 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743525 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-var-lib-openvswitch\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.743621 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7965caed-3f5d-4864-a069-ca3f44b2b6f8-ovnkube-config\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.743621 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56ea1beb-5880-4c72-bfb2-b57784851c0f-serviceca\") pod \"node-ca-mlskw\" (UID: \"56ea1beb-5880-4c72-bfb2-b57784851c0f\") " pod="openshift-image-registry/node-ca-mlskw" Jun 14 14:55:03.743742 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743626 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.743742 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743639 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-run-ovn\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.743742 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743660 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-log-socket\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.743742 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743680 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-lib-modules\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.743742 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743740 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-run-netns\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.743946 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743762 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-system-cni-dir\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.743946 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743787 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w28zs\" (UniqueName: \"kubernetes.io/projected/c83856f0-6aa9-42a6-befe-661a4f483135-kube-api-access-w28zs\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.743946 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7965caed-3f5d-4864-a069-ca3f44b2b6f8-ovnkube-script-lib\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.743946 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743817 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-sys-fs\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.743946 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743872 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zlf8\" (UniqueName: \"kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8\") pod \"network-check-target-8dqpj\" (UID: \"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06\") " pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:03.743946 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743896 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-node-log\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.743946 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.743946 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743936 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pbz7\" (UniqueName: \"kubernetes.io/projected/7965caed-3f5d-4864-a069-ca3f44b2b6f8-kube-api-access-2pbz7\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.744203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.743972 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-os-release\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.744203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-run-k8s-cni-cncf-io\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.744203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjh4t\" (UniqueName: \"kubernetes.io/projected/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-kube-api-access-fjh4t\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:03.744203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744053 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-run-netns\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.744203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744066 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-kubernetes\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.744203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744078 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2hz2\" (UniqueName: \"kubernetes.io/projected/56ea1beb-5880-4c72-bfb2-b57784851c0f-kube-api-access-z2hz2\") pod \"node-ca-mlskw\" (UID: \"56ea1beb-5880-4c72-bfb2-b57784851c0f\") " pod="openshift-image-registry/node-ca-mlskw" Jun 14 14:55:03.744203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-socket-dir-parent\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.744203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-run-multus-certs\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.744203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744118 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-etc-kubernetes\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.744203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744146 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c83856f0-6aa9-42a6-befe-661a4f483135-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.744203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744185 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c4d19df-2cb2-4ee0-a0fc-22179333e718-iptables-alerter-script\") pod \"iptables-alerter-9bbbd\" (UID: \"4c4d19df-2cb2-4ee0-a0fc-22179333e718\") " pod="openshift-network-operator/iptables-alerter-9bbbd" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744220 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/55ffa0e4-b658-4c7f-b31e-a30360bf405a-konnectivity-ca\") pod \"konnectivity-agent-xjtcd\" (UID: \"55ffa0e4-b658-4c7f-b31e-a30360bf405a\") " pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rbn6\" (UniqueName: \"kubernetes.io/projected/261cff16-3b72-49bc-8d5c-0f0adc1f6b41-kube-api-access-6rbn6\") pod \"node-resolver-ff8ft\" (UID: \"261cff16-3b72-49bc-8d5c-0f0adc1f6b41\") " pod="openshift-dns/node-resolver-ff8ft" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744255 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-cni-binary-copy\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-systemd-units\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-cni-bin\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-cni-netd\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-var-lib-kubelet\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744355 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-os-release\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744367 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56ea1beb-5880-4c72-bfb2-b57784851c0f-host\") pod \"node-ca-mlskw\" (UID: \"56ea1beb-5880-4c72-bfb2-b57784851c0f\") " pod="openshift-image-registry/node-ca-mlskw" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744381 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-var-lib-cni-multus\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744405 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-daemon-config\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-slash\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744431 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-sysconfig\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744444 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-sysctl-d\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4hqm\" (UniqueName: \"kubernetes.io/projected/180c72a4-1603-4092-8ac5-a717e9480cbf-kube-api-access-v4hqm\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.744547 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744469 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-cnibin\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744483 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7965caed-3f5d-4864-a069-ca3f44b2b6f8-env-overrides\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744500 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-systemd\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-run\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744544 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-sys\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-var-lib-cni-bin\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744600 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-tuning-conf-dir\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744615 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msd6l\" (UniqueName: \"kubernetes.io/projected/4c4d19df-2cb2-4ee0-a0fc-22179333e718-kube-api-access-msd6l\") pod \"iptables-alerter-9bbbd\" (UID: \"4c4d19df-2cb2-4ee0-a0fc-22179333e718\") " pod="openshift-network-operator/iptables-alerter-9bbbd" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744628 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-etc-selinux\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744650 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sr4r\" (UniqueName: \"kubernetes.io/projected/f34a6cee-ff26-4c0b-aaaa-106068b1f968-kube-api-access-9sr4r\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744679 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-cni-dir\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744697 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-hostroot\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744712 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-conf-dir\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744732 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-run-openvswitch\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744748 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-host\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744766 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-tuned\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.745019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744778 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-system-cni-dir\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744795 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c83856f0-6aa9-42a6-befe-661a4f483135-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744821 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-sysctl-conf\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744850 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-socket-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744863 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-device-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744876 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/55ffa0e4-b658-4c7f-b31e-a30360bf405a-agent-certs\") pod \"konnectivity-agent-xjtcd\" (UID: \"55ffa0e4-b658-4c7f-b31e-a30360bf405a\") " pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744917 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-var-lib-kubelet\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744951 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7965caed-3f5d-4864-a069-ca3f44b2b6f8-ovn-node-metrics-cert\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-registration-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.744999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/261cff16-3b72-49bc-8d5c-0f0adc1f6b41-hosts-file\") pod \"node-resolver-ff8ft\" (UID: \"261cff16-3b72-49bc-8d5c-0f0adc1f6b41\") " pod="openshift-dns/node-resolver-ff8ft" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.745026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftltj\" (UniqueName: \"kubernetes.io/projected/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-kube-api-access-ftltj\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.745048 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-cnibin\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.745069 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c4d19df-2cb2-4ee0-a0fc-22179333e718-host-slash\") pod \"iptables-alerter-9bbbd\" (UID: \"4c4d19df-2cb2-4ee0-a0fc-22179333e718\") " pod="openshift-network-operator/iptables-alerter-9bbbd" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.745090 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-etc-openvswitch\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.745113 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-modprobe-d\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.745133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/180c72a4-1603-4092-8ac5-a717e9480cbf-tmp\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.745429 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.745154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261cff16-3b72-49bc-8d5c-0f0adc1f6b41-tmp-dir\") pod \"node-resolver-ff8ft\" (UID: \"261cff16-3b72-49bc-8d5c-0f0adc1f6b41\") " pod="openshift-dns/node-resolver-ff8ft" Jun 14 14:55:03.745891 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.745189 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c83856f0-6aa9-42a6-befe-661a4f483135-cni-binary-copy\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.745891 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.745211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:03.745891 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.745233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-kubelet\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.748507 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.748489 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:55:03.748594 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.748557 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-52.ec2.internal" Jun 14 14:55:03.749933 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.749912 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal"] Jun 14 14:55:03.751436 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.751417 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 14:55:03.757422 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.757405 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 14:55:03.757504 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.757481 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-52.ec2.internal"] Jun 14 14:55:03.767102 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.767085 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pnv5k" Jun 14 14:55:03.774583 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.774552 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pnv5k" Jun 14 14:55:03.803542 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.803497 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-52.ec2.internal" event={"ID":"e20e21bef33d0fe9c39c7011fd989107","Type":"ContainerStarted","Data":"5cc286c82307ed0d124ef175f2d46904a78a6220e5b4bbfab426151c1d6e113d"} Jun 14 14:55:03.804542 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.804521 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" event={"ID":"630fd728252483618807b2f982470dbd","Type":"ContainerStarted","Data":"3ad7de9f1c53cbc3477287f682a8127f34cd32d5332c9a53778b35d49dba8517"} Jun 14 14:55:03.837449 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.837424 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 14:55:03.845425 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845397 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-systemd-units\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.845425 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-cni-bin\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.845624 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845438 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-cni-netd\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.845624 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-var-lib-kubelet\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.845624 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.845624 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845507 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-cni-bin\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.845624 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845519 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-systemd-units\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.845624 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845538 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-var-lib-kubelet\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.845624 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-os-release\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.845624 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845552 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-cni-netd\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.845624 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56ea1beb-5880-4c72-bfb2-b57784851c0f-host\") pod \"node-ca-mlskw\" (UID: \"56ea1beb-5880-4c72-bfb2-b57784851c0f\") " pod="openshift-image-registry/node-ca-mlskw" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845629 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-var-lib-cni-multus\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845648 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-os-release\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845674 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56ea1beb-5880-4c72-bfb2-b57784851c0f-host\") pod \"node-ca-mlskw\" (UID: \"56ea1beb-5880-4c72-bfb2-b57784851c0f\") " pod="openshift-image-registry/node-ca-mlskw" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845702 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-var-lib-cni-multus\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845737 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-daemon-config\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845767 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-kubelet-config\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-slash\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845831 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-sysconfig\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845854 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-sysctl-d\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4hqm\" (UniqueName: \"kubernetes.io/projected/180c72a4-1603-4092-8ac5-a717e9480cbf-kube-api-access-v4hqm\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845910 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-sysconfig\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845920 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-slash\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.845946 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-cnibin\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.846026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846017 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-sysctl-d\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846036 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7965caed-3f5d-4864-a069-ca3f44b2b6f8-env-overrides\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846042 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-cnibin\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846068 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-systemd\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-run\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-sys\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846160 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-systemd\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846164 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-run\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846178 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-sys\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846196 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-var-lib-cni-bin\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846222 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-var-lib-cni-bin\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846247 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-tuning-conf-dir\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msd6l\" (UniqueName: \"kubernetes.io/projected/4c4d19df-2cb2-4ee0-a0fc-22179333e718-kube-api-access-msd6l\") pod \"iptables-alerter-9bbbd\" (UID: \"4c4d19df-2cb2-4ee0-a0fc-22179333e718\") " pod="openshift-network-operator/iptables-alerter-9bbbd" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-etc-selinux\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sr4r\" (UniqueName: \"kubernetes.io/projected/f34a6cee-ff26-4c0b-aaaa-106068b1f968-kube-api-access-9sr4r\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846359 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-cni-dir\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846396 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-tuning-conf-dir\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846420 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-etc-selinux\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.846630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-hostroot\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846520 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-cni-dir\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846581 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-conf-dir\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846590 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-hostroot\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846612 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-run-openvswitch\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846643 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-host\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846642 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7965caed-3f5d-4864-a069-ca3f44b2b6f8-env-overrides\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846648 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-run-openvswitch\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846674 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-conf-dir\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846686 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-host\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846717 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-tuned\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846787 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-system-cni-dir\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846804 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-daemon-config\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846815 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c83856f0-6aa9-42a6-befe-661a4f483135-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846873 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-system-cni-dir\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-sysctl-conf\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846909 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-socket-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846924 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-device-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.847249 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/55ffa0e4-b658-4c7f-b31e-a30360bf405a-agent-certs\") pod \"konnectivity-agent-xjtcd\" (UID: \"55ffa0e4-b658-4c7f-b31e-a30360bf405a\") " pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.846989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-var-lib-kubelet\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847024 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-sysctl-conf\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847059 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-socket-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847072 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7965caed-3f5d-4864-a069-ca3f44b2b6f8-ovn-node-metrics-cert\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847076 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-var-lib-kubelet\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847052 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-device-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-registration-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847145 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/261cff16-3b72-49bc-8d5c-0f0adc1f6b41-hosts-file\") pod \"node-resolver-ff8ft\" (UID: \"261cff16-3b72-49bc-8d5c-0f0adc1f6b41\") " pod="openshift-dns/node-resolver-ff8ft" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847206 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-registration-dir\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847251 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/261cff16-3b72-49bc-8d5c-0f0adc1f6b41-hosts-file\") pod \"node-resolver-ff8ft\" (UID: \"261cff16-3b72-49bc-8d5c-0f0adc1f6b41\") " pod="openshift-dns/node-resolver-ff8ft" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftltj\" (UniqueName: \"kubernetes.io/projected/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-kube-api-access-ftltj\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847303 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-cnibin\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847327 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c4d19df-2cb2-4ee0-a0fc-22179333e718-host-slash\") pod \"iptables-alerter-9bbbd\" (UID: \"4c4d19df-2cb2-4ee0-a0fc-22179333e718\") " pod="openshift-network-operator/iptables-alerter-9bbbd" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847349 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-etc-openvswitch\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847361 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-cnibin\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847373 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-modprobe-d\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.848088 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847383 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c4d19df-2cb2-4ee0-a0fc-22179333e718-host-slash\") pod \"iptables-alerter-9bbbd\" (UID: \"4c4d19df-2cb2-4ee0-a0fc-22179333e718\") " pod="openshift-network-operator/iptables-alerter-9bbbd" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847397 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/180c72a4-1603-4092-8ac5-a717e9480cbf-tmp\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847417 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-etc-openvswitch\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847436 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261cff16-3b72-49bc-8d5c-0f0adc1f6b41-tmp-dir\") pod \"node-resolver-ff8ft\" (UID: \"261cff16-3b72-49bc-8d5c-0f0adc1f6b41\") " pod="openshift-dns/node-resolver-ff8ft" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847496 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-modprobe-d\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847504 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c83856f0-6aa9-42a6-befe-661a4f483135-cni-binary-copy\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847605 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847649 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-kubelet\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-run-systemd\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-var-lib-openvswitch\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847741 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7965caed-3f5d-4864-a069-ca3f44b2b6f8-ovnkube-config\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847761 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261cff16-3b72-49bc-8d5c-0f0adc1f6b41-tmp-dir\") pod \"node-resolver-ff8ft\" (UID: \"261cff16-3b72-49bc-8d5c-0f0adc1f6b41\") " pod="openshift-dns/node-resolver-ff8ft" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.847848 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847877 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c83856f0-6aa9-42a6-befe-661a4f483135-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847890 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-run-systemd\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847944 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-kubelet\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847947 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-var-lib-openvswitch\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56ea1beb-5880-4c72-bfb2-b57784851c0f-serviceca\") pod \"node-ca-mlskw\" (UID: \"56ea1beb-5880-4c72-bfb2-b57784851c0f\") " pod="openshift-image-registry/node-ca-mlskw" Jun 14 14:55:03.848926 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.847990 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848019 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-run-ovn\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848044 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-log-socket\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.848071 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs podName:4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:04.348038393 +0000 UTC m=+1.999231769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs") pod "network-metrics-daemon-2dkvj" (UID: "4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848089 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-log-socket\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848176 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-lib-modules\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848097 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-lib-modules\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848298 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-run-netns\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848307 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-run-ovn\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848253 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c83856f0-6aa9-42a6-befe-661a4f483135-cni-binary-copy\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848335 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848268 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848361 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-run-netns\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848371 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-system-cni-dir\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848350 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56ea1beb-5880-4c72-bfb2-b57784851c0f-serviceca\") pod \"node-ca-mlskw\" (UID: \"56ea1beb-5880-4c72-bfb2-b57784851c0f\") " pod="openshift-image-registry/node-ca-mlskw" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848399 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w28zs\" (UniqueName: \"kubernetes.io/projected/c83856f0-6aa9-42a6-befe-661a4f483135-kube-api-access-w28zs\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.849763 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7965caed-3f5d-4864-a069-ca3f44b2b6f8-ovnkube-script-lib\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848452 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-sys-fs\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848455 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c83856f0-6aa9-42a6-befe-661a4f483135-system-cni-dir\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848481 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-dbus\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848673 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlf8\" (UniqueName: \"kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8\") pod \"network-check-target-8dqpj\" (UID: \"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06\") " pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848701 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-node-log\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848718 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f34a6cee-ff26-4c0b-aaaa-106068b1f968-sys-fs\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848730 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848777 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-node-log\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pbz7\" (UniqueName: \"kubernetes.io/projected/7965caed-3f5d-4864-a069-ca3f44b2b6f8-kube-api-access-2pbz7\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848918 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-os-release\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848942 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-run-k8s-cni-cncf-io\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.848992 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-os-release\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849104 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjh4t\" (UniqueName: \"kubernetes.io/projected/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-kube-api-access-fjh4t\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849136 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-run-netns\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849162 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7965caed-3f5d-4864-a069-ca3f44b2b6f8-ovnkube-config\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.850459 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-run-k8s-cni-cncf-io\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849166 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-kubernetes\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849206 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7965caed-3f5d-4864-a069-ca3f44b2b6f8-host-run-netns\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849225 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-kubernetes\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849226 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2hz2\" (UniqueName: \"kubernetes.io/projected/56ea1beb-5880-4c72-bfb2-b57784851c0f-kube-api-access-z2hz2\") pod \"node-ca-mlskw\" (UID: \"56ea1beb-5880-4c72-bfb2-b57784851c0f\") " pod="openshift-image-registry/node-ca-mlskw" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-socket-dir-parent\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849289 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-run-multus-certs\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-etc-kubernetes\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849341 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c83856f0-6aa9-42a6-befe-661a4f483135-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849366 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c4d19df-2cb2-4ee0-a0fc-22179333e718-iptables-alerter-script\") pod \"iptables-alerter-9bbbd\" (UID: \"4c4d19df-2cb2-4ee0-a0fc-22179333e718\") " pod="openshift-network-operator/iptables-alerter-9bbbd" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849390 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/55ffa0e4-b658-4c7f-b31e-a30360bf405a-konnectivity-ca\") pod \"konnectivity-agent-xjtcd\" (UID: \"55ffa0e4-b658-4c7f-b31e-a30360bf405a\") " pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849382 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7965caed-3f5d-4864-a069-ca3f44b2b6f8-ovnkube-script-lib\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849431 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-etc-kubernetes\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849448 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-multus-socket-dir-parent\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849500 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-host-run-multus-certs\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rbn6\" (UniqueName: \"kubernetes.io/projected/261cff16-3b72-49bc-8d5c-0f0adc1f6b41-kube-api-access-6rbn6\") pod \"node-resolver-ff8ft\" (UID: \"261cff16-3b72-49bc-8d5c-0f0adc1f6b41\") " pod="openshift-dns/node-resolver-ff8ft" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849549 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-cni-binary-copy\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.851026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.849920 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c83856f0-6aa9-42a6-befe-661a4f483135-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.851457 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.850065 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c4d19df-2cb2-4ee0-a0fc-22179333e718-iptables-alerter-script\") pod \"iptables-alerter-9bbbd\" (UID: \"4c4d19df-2cb2-4ee0-a0fc-22179333e718\") " pod="openshift-network-operator/iptables-alerter-9bbbd" Jun 14 14:55:03.851457 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.850093 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-cni-binary-copy\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.851457 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.850276 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/55ffa0e4-b658-4c7f-b31e-a30360bf405a-konnectivity-ca\") pod \"konnectivity-agent-xjtcd\" (UID: \"55ffa0e4-b658-4c7f-b31e-a30360bf405a\") " pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:03.851457 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.850716 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7965caed-3f5d-4864-a069-ca3f44b2b6f8-ovn-node-metrics-cert\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.851457 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.850742 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/180c72a4-1603-4092-8ac5-a717e9480cbf-tmp\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.851457 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.850921 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/55ffa0e4-b658-4c7f-b31e-a30360bf405a-agent-certs\") pod \"konnectivity-agent-xjtcd\" (UID: \"55ffa0e4-b658-4c7f-b31e-a30360bf405a\") " pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:03.851674 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.851486 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/180c72a4-1603-4092-8ac5-a717e9480cbf-etc-tuned\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.857558 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.857532 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4hqm\" (UniqueName: \"kubernetes.io/projected/180c72a4-1603-4092-8ac5-a717e9480cbf-kube-api-access-v4hqm\") pod \"tuned-8wqlf\" (UID: \"180c72a4-1603-4092-8ac5-a717e9480cbf\") " pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:03.859239 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.858988 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:03.859239 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.859015 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:03.859239 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.859029 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zlf8 for pod openshift-network-diagnostics/network-check-target-8dqpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:03.859239 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.859088 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8 podName:216cdb6a-b2ed-4a9c-b51a-a1fef923dc06 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:04.359070472 +0000 UTC m=+2.010263834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6zlf8" (UniqueName: "kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8") pod "network-check-target-8dqpj" (UID: "216cdb6a-b2ed-4a9c-b51a-a1fef923dc06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:03.859932 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.859875 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sr4r\" (UniqueName: \"kubernetes.io/projected/f34a6cee-ff26-4c0b-aaaa-106068b1f968-kube-api-access-9sr4r\") pod \"aws-ebs-csi-driver-node-xs5vb\" (UID: \"f34a6cee-ff26-4c0b-aaaa-106068b1f968\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:03.861196 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.861163 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pbz7\" (UniqueName: \"kubernetes.io/projected/7965caed-3f5d-4864-a069-ca3f44b2b6f8-kube-api-access-2pbz7\") pod \"ovnkube-node-vrfxm\" (UID: \"7965caed-3f5d-4864-a069-ca3f44b2b6f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:03.861278 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.861262 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rbn6\" (UniqueName: \"kubernetes.io/projected/261cff16-3b72-49bc-8d5c-0f0adc1f6b41-kube-api-access-6rbn6\") pod \"node-resolver-ff8ft\" (UID: \"261cff16-3b72-49bc-8d5c-0f0adc1f6b41\") " pod="openshift-dns/node-resolver-ff8ft" Jun 14 14:55:03.861437 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.861422 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftltj\" (UniqueName: \"kubernetes.io/projected/8080956e-d14e-4a3b-84b1-9c7b5fbe9323-kube-api-access-ftltj\") pod \"multus-7q4bp\" (UID: \"8080956e-d14e-4a3b-84b1-9c7b5fbe9323\") " pod="openshift-multus/multus-7q4bp" Jun 14 14:55:03.861602 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.861581 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2hz2\" (UniqueName: \"kubernetes.io/projected/56ea1beb-5880-4c72-bfb2-b57784851c0f-kube-api-access-z2hz2\") pod \"node-ca-mlskw\" (UID: \"56ea1beb-5880-4c72-bfb2-b57784851c0f\") " pod="openshift-image-registry/node-ca-mlskw" Jun 14 14:55:03.861841 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.861827 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w28zs\" (UniqueName: \"kubernetes.io/projected/c83856f0-6aa9-42a6-befe-661a4f483135-kube-api-access-w28zs\") pod \"multus-additional-cni-plugins-268sq\" (UID: \"c83856f0-6aa9-42a6-befe-661a4f483135\") " pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:03.862189 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.862162 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msd6l\" (UniqueName: \"kubernetes.io/projected/4c4d19df-2cb2-4ee0-a0fc-22179333e718-kube-api-access-msd6l\") pod \"iptables-alerter-9bbbd\" (UID: \"4c4d19df-2cb2-4ee0-a0fc-22179333e718\") " pod="openshift-network-operator/iptables-alerter-9bbbd" Jun 14 14:55:03.862256 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.862167 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjh4t\" (UniqueName: \"kubernetes.io/projected/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-kube-api-access-fjh4t\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:03.950055 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.950027 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:03.950055 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.950057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-dbus\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:03.950232 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.950093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-kubelet-config\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:03.950232 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.950165 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-kubelet-config\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:03.950232 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.950176 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:03.950232 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:03.950207 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-dbus\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:03.950232 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:03.950233 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret podName:a96cd2e4-53eb-48b5-b3f7-b903b797c60c nodeName:}" failed. No retries permitted until 2026-06-14 14:55:04.450219444 +0000 UTC m=+2.101412805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret") pod "global-pull-secret-syncer-k4qgj" (UID: "a96cd2e4-53eb-48b5-b3f7-b903b797c60c") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:04.036703 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.036629 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-268sq" Jun 14 14:55:04.045498 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:04.045473 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83856f0_6aa9_42a6_befe_661a4f483135.slice/crio-80da3d081527b9e95dd2a7c29fdecccebda6066ced41508100f99d8342980bd2 WatchSource:0}: Error finding container 80da3d081527b9e95dd2a7c29fdecccebda6066ced41508100f99d8342980bd2: Status 404 returned error can't find the container with id 80da3d081527b9e95dd2a7c29fdecccebda6066ced41508100f99d8342980bd2 Jun 14 14:55:04.046383 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.046250 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9bbbd" Jun 14 14:55:04.052370 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.052343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:04.055526 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.055503 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" Jun 14 14:55:04.055848 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:04.055818 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4d19df_2cb2_4ee0_a0fc_22179333e718.slice/crio-33695041cb35f3fcdf8ff2012c509e8f5fe7ebccb3af9962525609070c1ec0c4 WatchSource:0}: Error finding container 33695041cb35f3fcdf8ff2012c509e8f5fe7ebccb3af9962525609070c1ec0c4: Status 404 returned error can't find the container with id 33695041cb35f3fcdf8ff2012c509e8f5fe7ebccb3af9962525609070c1ec0c4 Jun 14 14:55:04.060969 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.060948 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" Jun 14 14:55:04.065518 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.065497 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mlskw" Jun 14 14:55:04.065844 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:04.065821 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34a6cee_ff26_4c0b_aaaa_106068b1f968.slice/crio-4d859c44f88dc3bd701a72289b221d6cf0dad4df87ab72474ef41a1700eadcfd WatchSource:0}: Error finding container 4d859c44f88dc3bd701a72289b221d6cf0dad4df87ab72474ef41a1700eadcfd: Status 404 returned error can't find the container with id 4d859c44f88dc3bd701a72289b221d6cf0dad4df87ab72474ef41a1700eadcfd Jun 14 14:55:04.066230 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:04.066061 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7965caed_3f5d_4864_a069_ca3f44b2b6f8.slice/crio-d70fd4e0d68930edaa5b85cd289997bb99a77809b8730ae6b22279d21f099f1f WatchSource:0}: Error finding container d70fd4e0d68930edaa5b85cd289997bb99a77809b8730ae6b22279d21f099f1f: Status 404 returned error can't find the container with id d70fd4e0d68930edaa5b85cd289997bb99a77809b8730ae6b22279d21f099f1f Jun 14 14:55:04.071622 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.070785 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:04.078081 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.075761 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ff8ft" Jun 14 14:55:04.080969 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.080949 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7q4bp" Jun 14 14:55:04.082127 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:04.082094 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ea1beb_5880_4c72_bfb2_b57784851c0f.slice/crio-52d5d1414263a723e8d3b3718ea1969e2737e3f6950feea99f09d81e511e174e WatchSource:0}: Error finding container 52d5d1414263a723e8d3b3718ea1969e2737e3f6950feea99f09d81e511e174e: Status 404 returned error can't find the container with id 52d5d1414263a723e8d3b3718ea1969e2737e3f6950feea99f09d81e511e174e Jun 14 14:55:04.094242 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:04.094205 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8080956e_d14e_4a3b_84b1_9c7b5fbe9323.slice/crio-1909e7f6272404005ee64fecce3206ca481170f5d4796437ffb9d27528050da9 WatchSource:0}: Error finding container 1909e7f6272404005ee64fecce3206ca481170f5d4796437ffb9d27528050da9: Status 404 returned error can't find the container with id 1909e7f6272404005ee64fecce3206ca481170f5d4796437ffb9d27528050da9 Jun 14 14:55:04.102235 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:04.102212 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261cff16_3b72_49bc_8d5c_0f0adc1f6b41.slice/crio-75841f336033a434b6624b050377b72c5868edeb2b7507ac884f253c1ec1aff9 WatchSource:0}: Error finding container 75841f336033a434b6624b050377b72c5868edeb2b7507ac884f253c1ec1aff9: Status 404 returned error can't find the container with id 75841f336033a434b6624b050377b72c5868edeb2b7507ac884f253c1ec1aff9 Jun 14 14:55:04.354303 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.354231 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:04.354462 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:04.354364 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:04.354462 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:04.354425 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs podName:4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:05.354408941 +0000 UTC m=+3.005602295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs") pod "network-metrics-daemon-2dkvj" (UID: "4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:04.454870 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.454833 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:04.455034 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.454884 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlf8\" (UniqueName: \"kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8\") pod \"network-check-target-8dqpj\" (UID: \"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06\") " pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:04.455085 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:04.455035 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:04.455085 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:04.455055 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:04.455085 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:04.455067 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zlf8 for pod openshift-network-diagnostics/network-check-target-8dqpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:04.455171 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:04.455125 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8 podName:216cdb6a-b2ed-4a9c-b51a-a1fef923dc06 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:05.455104506 +0000 UTC m=+3.106297853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zlf8" (UniqueName: "kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8") pod "network-check-target-8dqpj" (UID: "216cdb6a-b2ed-4a9c-b51a-a1fef923dc06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:04.455171 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:04.455154 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:04.455233 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:04.455191 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret podName:a96cd2e4-53eb-48b5-b3f7-b903b797c60c nodeName:}" failed. No retries permitted until 2026-06-14 14:55:05.455179738 +0000 UTC m=+3.106373098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret") pod "global-pull-secret-syncer-k4qgj" (UID: "a96cd2e4-53eb-48b5-b3f7-b903b797c60c") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:04.478920 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.478888 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:04.508472 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.508338 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:04.777495 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.777357 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:50:03 +0000 UTC" deadline="2027-11-29 12:40:18.880882168 +0000 UTC" Jun 14 14:55:04.777495 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.777393 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12789h45m14.103494479s" Jun 14 14:55:04.825836 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.825739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7q4bp" event={"ID":"8080956e-d14e-4a3b-84b1-9c7b5fbe9323","Type":"ContainerStarted","Data":"1909e7f6272404005ee64fecce3206ca481170f5d4796437ffb9d27528050da9"} Jun 14 14:55:04.846328 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.846237 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ff8ft" event={"ID":"261cff16-3b72-49bc-8d5c-0f0adc1f6b41","Type":"ContainerStarted","Data":"75841f336033a434b6624b050377b72c5868edeb2b7507ac884f253c1ec1aff9"} Jun 14 14:55:04.855884 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.855850 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjtcd" event={"ID":"55ffa0e4-b658-4c7f-b31e-a30360bf405a","Type":"ContainerStarted","Data":"91e319a0e9422cea4ed570f8f3bcb175ad9b13a59d24160ab06e6528e2a68c13"} Jun 14 14:55:04.858155 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.858125 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9bbbd" event={"ID":"4c4d19df-2cb2-4ee0-a0fc-22179333e718","Type":"ContainerStarted","Data":"33695041cb35f3fcdf8ff2012c509e8f5fe7ebccb3af9962525609070c1ec0c4"} Jun 14 14:55:04.860384 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.860356 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mlskw" event={"ID":"56ea1beb-5880-4c72-bfb2-b57784851c0f","Type":"ContainerStarted","Data":"52d5d1414263a723e8d3b3718ea1969e2737e3f6950feea99f09d81e511e174e"} Jun 14 14:55:04.863449 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.863380 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" event={"ID":"180c72a4-1603-4092-8ac5-a717e9480cbf","Type":"ContainerStarted","Data":"caaeffbec994083b0a19f0356a579114d430ef333c64fdc70a2ed0641c85786e"} Jun 14 14:55:04.874246 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.874206 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" event={"ID":"f34a6cee-ff26-4c0b-aaaa-106068b1f968","Type":"ContainerStarted","Data":"4d859c44f88dc3bd701a72289b221d6cf0dad4df87ab72474ef41a1700eadcfd"} Jun 14 14:55:04.881825 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.881715 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" event={"ID":"7965caed-3f5d-4864-a069-ca3f44b2b6f8","Type":"ContainerStarted","Data":"d70fd4e0d68930edaa5b85cd289997bb99a77809b8730ae6b22279d21f099f1f"} Jun 14 14:55:04.890330 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:04.890302 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-268sq" event={"ID":"c83856f0-6aa9-42a6-befe-661a4f483135","Type":"ContainerStarted","Data":"80da3d081527b9e95dd2a7c29fdecccebda6066ced41508100f99d8342980bd2"} Jun 14 14:55:05.363029 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:05.362968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:05.363250 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:05.363200 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:05.363250 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:05.363266 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs podName:4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:07.363247486 +0000 UTC m=+5.014440845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs") pod "network-metrics-daemon-2dkvj" (UID: "4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:05.463970 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:05.463932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:05.464149 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:05.463985 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlf8\" (UniqueName: \"kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8\") pod \"network-check-target-8dqpj\" (UID: \"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06\") " pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:05.464149 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:05.464122 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:05.464261 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:05.464142 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:05.464261 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:05.464165 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zlf8 for pod openshift-network-diagnostics/network-check-target-8dqpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:05.464261 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:05.464229 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8 podName:216cdb6a-b2ed-4a9c-b51a-a1fef923dc06 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:07.464210142 +0000 UTC m=+5.115403503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zlf8" (UniqueName: "kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8") pod "network-check-target-8dqpj" (UID: "216cdb6a-b2ed-4a9c-b51a-a1fef923dc06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:05.464675 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:05.464657 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:05.464757 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:05.464714 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret podName:a96cd2e4-53eb-48b5-b3f7-b903b797c60c nodeName:}" failed. No retries permitted until 2026-06-14 14:55:07.464698495 +0000 UTC m=+5.115891855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret") pod "global-pull-secret-syncer-k4qgj" (UID: "a96cd2e4-53eb-48b5-b3f7-b903b797c60c") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:05.778052 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:05.777848 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 14:50:03 +0000 UTC" deadline="2028-01-13 01:05:34.389141355 +0000 UTC" Jun 14 14:55:05.778052 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:05.777910 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13858h10m28.611236456s" Jun 14 14:55:05.801814 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:05.801776 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:05.801994 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:05.801925 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:05.802060 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:05.801987 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:05.802198 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:05.802178 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:05.802305 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:05.802284 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:05.802376 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:05.802176 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:05.865915 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:05.865883 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 14:55:07.379023 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:07.378905 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:07.379435 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:07.379116 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:07.379435 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:07.379186 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs podName:4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:11.379166704 +0000 UTC m=+9.030360064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs") pod "network-metrics-daemon-2dkvj" (UID: "4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:07.480364 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:07.480026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:07.480364 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:07.480079 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlf8\" (UniqueName: \"kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8\") pod \"network-check-target-8dqpj\" (UID: \"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06\") " pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:07.480364 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:07.480191 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:07.480364 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:07.480234 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:07.480364 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:07.480254 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:07.480364 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:07.480264 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret podName:a96cd2e4-53eb-48b5-b3f7-b903b797c60c nodeName:}" failed. No retries permitted until 2026-06-14 14:55:11.480245444 +0000 UTC m=+9.131438804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret") pod "global-pull-secret-syncer-k4qgj" (UID: "a96cd2e4-53eb-48b5-b3f7-b903b797c60c") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:07.480364 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:07.480267 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zlf8 for pod openshift-network-diagnostics/network-check-target-8dqpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:07.480364 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:07.480322 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8 podName:216cdb6a-b2ed-4a9c-b51a-a1fef923dc06 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:11.480305566 +0000 UTC m=+9.131498924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zlf8" (UniqueName: "kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8") pod "network-check-target-8dqpj" (UID: "216cdb6a-b2ed-4a9c-b51a-a1fef923dc06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:07.801666 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:07.801590 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:07.801810 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:07.801734 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:07.801810 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:07.801758 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:07.801810 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:07.801777 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:07.801916 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:07.801890 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:07.802045 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:07.801999 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:09.800862 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:09.800828 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:09.801253 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:09.800921 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:09.801253 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:09.800933 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:09.801253 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:09.800948 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:09.801253 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:09.801027 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:09.801253 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:09.801103 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:11.414698 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:11.414659 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:11.415144 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:11.414853 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:11.415144 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:11.414918 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs podName:4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:19.414899069 +0000 UTC m=+17.066092427 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs") pod "network-metrics-daemon-2dkvj" (UID: "4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:11.515348 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:11.515308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:11.515529 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:11.515362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlf8\" (UniqueName: \"kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8\") pod \"network-check-target-8dqpj\" (UID: \"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06\") " pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:11.515529 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:11.515522 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:11.515691 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:11.515542 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:11.515691 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:11.515556 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zlf8 for pod openshift-network-diagnostics/network-check-target-8dqpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:11.515691 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:11.515632 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8 podName:216cdb6a-b2ed-4a9c-b51a-a1fef923dc06 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:19.515613155 +0000 UTC m=+17.166806505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zlf8" (UniqueName: "kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8") pod "network-check-target-8dqpj" (UID: "216cdb6a-b2ed-4a9c-b51a-a1fef923dc06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:11.516101 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:11.516030 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:11.516101 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:11.516074 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret podName:a96cd2e4-53eb-48b5-b3f7-b903b797c60c nodeName:}" failed. No retries permitted until 2026-06-14 14:55:19.516061369 +0000 UTC m=+17.167254723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret") pod "global-pull-secret-syncer-k4qgj" (UID: "a96cd2e4-53eb-48b5-b3f7-b903b797c60c") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:11.800817 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:11.800737 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:11.800967 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:11.800862 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:11.801254 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:11.801235 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:11.801352 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:11.801330 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:11.801409 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:11.801387 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:11.801479 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:11.801461 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:13.800983 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:13.800943 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:13.801440 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:13.800951 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:13.801440 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:13.801084 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:13.801440 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:13.800964 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:13.801440 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:13.801160 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:13.801440 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:13.801240 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:15.801455 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:15.801385 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:15.801893 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:15.801546 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:15.801893 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:15.801613 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:15.801893 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:15.801624 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:15.801893 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:15.801753 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:15.801893 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:15.801832 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:17.801641 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:17.801606 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:17.802085 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:17.801647 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:17.802085 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:17.801647 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:17.802085 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:17.801717 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:17.802085 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:17.801843 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:17.802085 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:17.801919 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:19.470434 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:19.469857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:19.470434 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:19.470011 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:19.470434 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:19.470078 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs podName:4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:35.470057291 +0000 UTC m=+33.121250644 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs") pod "network-metrics-daemon-2dkvj" (UID: "4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:19.571275 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:19.571236 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:19.571451 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:19.571286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlf8\" (UniqueName: \"kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8\") pod \"network-check-target-8dqpj\" (UID: \"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06\") " pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:19.571451 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:19.571402 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:19.571451 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:19.571417 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:19.571451 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:19.571436 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:19.571451 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:19.571448 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zlf8 for pod openshift-network-diagnostics/network-check-target-8dqpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:19.571678 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:19.571479 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret podName:a96cd2e4-53eb-48b5-b3f7-b903b797c60c nodeName:}" failed. No retries permitted until 2026-06-14 14:55:35.571458568 +0000 UTC m=+33.222651918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret") pod "global-pull-secret-syncer-k4qgj" (UID: "a96cd2e4-53eb-48b5-b3f7-b903b797c60c") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:19.571678 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:19.571504 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8 podName:216cdb6a-b2ed-4a9c-b51a-a1fef923dc06 nodeName:}" failed. No retries permitted until 2026-06-14 14:55:35.571489573 +0000 UTC m=+33.222682933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zlf8" (UniqueName: "kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8") pod "network-check-target-8dqpj" (UID: "216cdb6a-b2ed-4a9c-b51a-a1fef923dc06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:19.801538 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:19.801059 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:19.801538 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:19.801093 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:19.801538 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:19.801187 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:19.801538 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:19.801270 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:19.801538 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:19.801327 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:19.801538 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:19.801459 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:21.800971 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:21.800939 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:21.801557 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:21.800980 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:21.801557 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:21.800984 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:21.801557 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:21.801066 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:21.801557 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:21.801217 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:21.801557 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:21.801293 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:23.801370 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:23.801222 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:23.801741 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:23.801244 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:23.801741 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:23.801469 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:23.801741 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:23.801248 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:23.801741 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:23.801515 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:23.801741 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:23.801611 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:23.942277 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:23.942239 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-52.ec2.internal" event={"ID":"e20e21bef33d0fe9c39c7011fd989107","Type":"ContainerStarted","Data":"61ccd2844f6b7e490d5574fa6274de41d3e83b27c9b59f19560f5745ca59da4e"} Jun 14 14:55:23.944188 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:23.944162 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7q4bp" event={"ID":"8080956e-d14e-4a3b-84b1-9c7b5fbe9323","Type":"ContainerStarted","Data":"294b5eeff09eef8fb4a0675502eb160f15d27f20f46acdf6a4e3f5de95dcc053"} Jun 14 14:55:23.946032 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:23.946005 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" event={"ID":"180c72a4-1603-4092-8ac5-a717e9480cbf","Type":"ContainerStarted","Data":"836b9679143937eb8d4a0aed7047f7f2786d6462deba9d71f22fa20330297640"} Jun 14 14:55:23.948099 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:23.948065 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" event={"ID":"7965caed-3f5d-4864-a069-ca3f44b2b6f8","Type":"ContainerStarted","Data":"e9570227f2b26105f740c6e995c2e11c9b92fb0a1ed118a0d833c02fb39c9401"} Jun 14 14:55:23.955262 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:23.955222 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-52.ec2.internal" podStartSLOduration=20.955210537 podStartE2EDuration="20.955210537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:23.954810117 +0000 UTC m=+21.606003484" watchObservedRunningTime="2026-06-14 14:55:23.955210537 +0000 UTC m=+21.606403905" Jun 14 14:55:23.971745 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:23.971707 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7q4bp" podStartSLOduration=1.495517485 podStartE2EDuration="20.971695067s" totalImagesPullingTime="19.476177582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:23.971431131 +0000 UTC m=+21.622624490" watchObservedRunningTime="2026-06-14 14:55:23.971695067 +0000 UTC m=+21.622888434" Jun 14 14:55:23.987191 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:23.987133 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8wqlf" podStartSLOduration=2.526092093 podStartE2EDuration="21.987114097s" totalImagesPullingTime="19.461022004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:23.986428511 +0000 UTC m=+21.637621878" watchObservedRunningTime="2026-06-14 14:55:23.987114097 +0000 UTC m=+21.638307466" Jun 14 14:55:24.953083 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.952871 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 14:55:24.953831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.953330 2572 generic.go:356] "Generic (PLEG): container finished" podID="7965caed-3f5d-4864-a069-ca3f44b2b6f8" containerID="d2a6c30f85e5c9192995571e32ce595ebb407cce7f6c7f64fdc7bf23539de1be" exitCode=1 Jun 14 14:55:24.953831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.953397 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" event={"ID":"7965caed-3f5d-4864-a069-ca3f44b2b6f8","Type":"ContainerStarted","Data":"d80a36e4d79514fc2b6612b60f083661175bf2916851f9bd4db90d81d13ab2db"} Jun 14 14:55:24.953831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.953471 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" event={"ID":"7965caed-3f5d-4864-a069-ca3f44b2b6f8","Type":"ContainerStarted","Data":"74d8a035d0da6f07f86d5631826e7976a657dc01412d9b332e51027ccbd64899"} Jun 14 14:55:24.953831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.953510 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" event={"ID":"7965caed-3f5d-4864-a069-ca3f44b2b6f8","Type":"ContainerStarted","Data":"452af1add69d5bfc937115aa2955972a0932bf4a91b3c79093c8a95a83dd846d"} Jun 14 14:55:24.953831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.953548 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" event={"ID":"7965caed-3f5d-4864-a069-ca3f44b2b6f8","Type":"ContainerStarted","Data":"632a27a112e32aead6fdd9404d61114c4c8e47d5f5c1b928d062f28f7a17a4ac"} Jun 14 14:55:24.953831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.953637 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" event={"ID":"7965caed-3f5d-4864-a069-ca3f44b2b6f8","Type":"ContainerDied","Data":"d2a6c30f85e5c9192995571e32ce595ebb407cce7f6c7f64fdc7bf23539de1be"} Jun 14 14:55:24.954807 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.954778 2572 generic.go:356] "Generic (PLEG): container finished" podID="c83856f0-6aa9-42a6-befe-661a4f483135" containerID="a548bb88e37de5e70e86090259290ccb16be71875b56c83f58396c200c46e485" exitCode=0 Jun 14 14:55:24.954807 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.954804 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-268sq" event={"ID":"c83856f0-6aa9-42a6-befe-661a4f483135","Type":"ContainerDied","Data":"a548bb88e37de5e70e86090259290ccb16be71875b56c83f58396c200c46e485"} Jun 14 14:55:24.956360 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.956276 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ff8ft" event={"ID":"261cff16-3b72-49bc-8d5c-0f0adc1f6b41","Type":"ContainerStarted","Data":"e239e02213147526a56cf607b16b95782ea0c844f5b5a2f6965bbd208a811f4e"} Jun 14 14:55:24.957676 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.957650 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjtcd" event={"ID":"55ffa0e4-b658-4c7f-b31e-a30360bf405a","Type":"ContainerStarted","Data":"6ddecfc4b4961d58a81852a95514df399c8cb1ef40e488b51009d04696d0603c"} Jun 14 14:55:24.958964 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.958945 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9bbbd" event={"ID":"4c4d19df-2cb2-4ee0-a0fc-22179333e718","Type":"ContainerStarted","Data":"e3aae960b720a22767b6298770abe7ae3d3ea668566b6c6db630d43b55863a70"} Jun 14 14:55:24.960413 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.960390 2572 generic.go:356] "Generic (PLEG): container finished" podID="630fd728252483618807b2f982470dbd" containerID="f245e4d5725ef483fe1859cdca9a0293b47af9d27acdf66a0cdcfafa3b075922" exitCode=0 Jun 14 14:55:24.960493 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.960459 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" event={"ID":"630fd728252483618807b2f982470dbd","Type":"ContainerDied","Data":"f245e4d5725ef483fe1859cdca9a0293b47af9d27acdf66a0cdcfafa3b075922"} Jun 14 14:55:24.960552 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.960497 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:24.961118 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.961099 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:24.961930 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.961911 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mlskw" event={"ID":"56ea1beb-5880-4c72-bfb2-b57784851c0f","Type":"ContainerStarted","Data":"a796a9c84945d79f5038375544fcfc0f05ad19f3a49ee4a33919eebee0a0294a"} Jun 14 14:55:24.963286 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.963227 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" event={"ID":"f34a6cee-ff26-4c0b-aaaa-106068b1f968","Type":"ContainerStarted","Data":"196fef7733cb8a0757b224041c0ed7c33ea7aebdba3d49d193d6f3c43f9a6269"} Jun 14 14:55:24.991029 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:24.990993 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mlskw" podStartSLOduration=3.564374269 podStartE2EDuration="22.990980406s" totalImagesPullingTime="19.426606137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:24.990851182 +0000 UTC m=+22.642044551" watchObservedRunningTime="2026-06-14 14:55:24.990980406 +0000 UTC m=+22.642173775" Jun 14 14:55:25.026017 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.025976 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xjtcd" podStartSLOduration=2.595860925 podStartE2EDuration="22.025961654s" totalImagesPullingTime="19.430100729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:25.007434007 +0000 UTC m=+22.658627374" watchObservedRunningTime="2026-06-14 14:55:25.025961654 +0000 UTC m=+22.677155025" Jun 14 14:55:25.058185 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.058139 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ff8ft" podStartSLOduration=2.64570973 podStartE2EDuration="22.058125987s" totalImagesPullingTime="19.412416257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:25.027643993 +0000 UTC m=+22.678837361" watchObservedRunningTime="2026-06-14 14:55:25.058125987 +0000 UTC m=+22.709319363" Jun 14 14:55:25.077719 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.077672 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9bbbd" podStartSLOduration=3.616550401 podStartE2EDuration="23.077652708s" totalImagesPullingTime="19.461102307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:25.07714191 +0000 UTC m=+22.728335283" watchObservedRunningTime="2026-06-14 14:55:25.077652708 +0000 UTC m=+22.728846078" Jun 14 14:55:25.801674 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.801645 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:25.801674 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.801667 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:25.801891 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.801667 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:25.801891 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:25.801741 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:25.801891 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:25.801844 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:25.802049 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:25.801920 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:25.846968 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.846938 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 14:55:25.966971 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.966884 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" event={"ID":"630fd728252483618807b2f982470dbd","Type":"ContainerStarted","Data":"75912f95e36b9d1428f0bca489fd3efcdb3b6532af90bd10e3d13ac10553406e"} Jun 14 14:55:25.968551 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.968527 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" event={"ID":"f34a6cee-ff26-4c0b-aaaa-106068b1f968","Type":"ContainerStarted","Data":"1044a5a6c060609ce01c88957b13e11494c34896462a90ed26eed0663847ad1a"} Jun 14 14:55:25.968829 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.968805 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:25.969174 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.969160 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xjtcd" Jun 14 14:55:25.980196 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:25.980159 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-52.ec2.internal" podStartSLOduration=22.980147467 podStartE2EDuration="22.980147467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:25.979738164 +0000 UTC m=+23.630931531" watchObservedRunningTime="2026-06-14 14:55:25.980147467 +0000 UTC m=+23.631340835" Jun 14 14:55:26.812546 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:26.812211 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T14:55:25.846956182Z","UUID":"ddbcb7d8-5458-4932-8a35-73999bb59dd5","Handler":null,"Name":"","Endpoint":""} Jun 14 14:55:26.813761 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:26.813740 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 14:55:26.813905 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:26.813782 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 14:55:26.974606 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:26.974553 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 14:55:26.975031 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:26.975014 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" event={"ID":"7965caed-3f5d-4864-a069-ca3f44b2b6f8","Type":"ContainerStarted","Data":"217213eae6409576e048d0475433f0da68f14179c0c6f6fcb3967381c63d1a77"} Jun 14 14:55:27.800740 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:27.800711 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:27.800894 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:27.800711 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:27.800894 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:27.800836 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:27.800894 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:27.800874 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:27.800894 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:27.800711 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:27.801043 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:27.800930 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:27.979551 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:27.979502 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" event={"ID":"f34a6cee-ff26-4c0b-aaaa-106068b1f968","Type":"ContainerStarted","Data":"d260b596e931e5c840d195ddf6e2b40085447b50b0b7e134931d28449bb6d1c6"} Jun 14 14:55:27.997103 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:27.997061 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xs5vb" podStartSLOduration=4.269750594 podStartE2EDuration="25.997044127s" totalImagesPullingTime="21.727293533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:27.99605718 +0000 UTC m=+25.647250550" watchObservedRunningTime="2026-06-14 14:55:27.997044127 +0000 UTC m=+25.648237499" Jun 14 14:55:29.801863 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:29.801708 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:29.802312 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:29.801762 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:29.802312 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:29.801930 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:29.802312 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:29.802007 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:29.802312 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:29.801767 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:29.802312 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:29.802084 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:29.986580 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:29.986501 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 14:55:29.986912 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:29.986882 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" event={"ID":"7965caed-3f5d-4864-a069-ca3f44b2b6f8","Type":"ContainerStarted","Data":"aa94af4ac348e77fe102619669529a088dfc816bb46dd98076cd7e40aee9de41"} Jun 14 14:55:29.987158 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:29.987139 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:29.987343 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:29.987323 2572 scope.go:117] "RemoveContainer" containerID="d2a6c30f85e5c9192995571e32ce595ebb407cce7f6c7f64fdc7bf23539de1be" Jun 14 14:55:29.988985 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:29.988953 2572 generic.go:356] "Generic (PLEG): container finished" podID="c83856f0-6aa9-42a6-befe-661a4f483135" containerID="396d64de7e25d23ba9e526927cc2da457a50945f7e80f6e003f0d60ab5913e11" exitCode=0 Jun 14 14:55:29.989083 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:29.988991 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-268sq" event={"ID":"c83856f0-6aa9-42a6-befe-661a4f483135","Type":"ContainerDied","Data":"396d64de7e25d23ba9e526927cc2da457a50945f7e80f6e003f0d60ab5913e11"} Jun 14 14:55:30.003213 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:30.003191 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:30.994409 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:30.994385 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 14:55:30.995011 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:30.994735 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" event={"ID":"7965caed-3f5d-4864-a069-ca3f44b2b6f8","Type":"ContainerStarted","Data":"e26a97f2cca04b4f85bcb20e40d1558c98d0b03c87cd0552b4f61994b6fbc1f3"} Jun 14 14:55:30.995011 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:30.994899 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:30.995120 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:30.995037 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:31.009801 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:31.009778 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:55:31.021851 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:31.021806 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" podStartSLOduration=9.316657292 podStartE2EDuration="29.021791197s" totalImagesPullingTime="19.705133905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:31.020331738 +0000 UTC m=+28.671525102" watchObservedRunningTime="2026-06-14 14:55:31.021791197 +0000 UTC m=+28.672984566" Jun 14 14:55:31.434741 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:31.434524 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k4qgj"] Jun 14 14:55:31.435035 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:31.434864 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:31.435035 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:31.434977 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:31.435153 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:31.435094 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2dkvj"] Jun 14 14:55:31.435224 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:31.435210 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:31.435362 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:31.435342 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:31.435737 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:31.435716 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8dqpj"] Jun 14 14:55:31.435833 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:31.435785 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:31.435873 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:31.435847 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:32.001558 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:32.001522 2572 generic.go:356] "Generic (PLEG): container finished" podID="c83856f0-6aa9-42a6-befe-661a4f483135" containerID="7d64da09bcbe6c8a1539f46a4b3133c5e1d2b1996220c700f731e3d8398c03bf" exitCode=0 Jun 14 14:55:32.001983 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:32.001606 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-268sq" event={"ID":"c83856f0-6aa9-42a6-befe-661a4f483135","Type":"ContainerDied","Data":"7d64da09bcbe6c8a1539f46a4b3133c5e1d2b1996220c700f731e3d8398c03bf"} Jun 14 14:55:32.803967 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:32.803932 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:32.804126 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:32.803979 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:32.804126 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:32.803939 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:32.804126 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:32.804055 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:32.804288 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:32.804148 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:32.804288 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:32.804226 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:34.007869 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:34.007783 2572 generic.go:356] "Generic (PLEG): container finished" podID="c83856f0-6aa9-42a6-befe-661a4f483135" containerID="958ad64dd18fca887329d7aebd959531150c3f78402d6b60668a7e5897f841ca" exitCode=0 Jun 14 14:55:34.007869 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:34.007827 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-268sq" event={"ID":"c83856f0-6aa9-42a6-befe-661a4f483135","Type":"ContainerDied","Data":"958ad64dd18fca887329d7aebd959531150c3f78402d6b60668a7e5897f841ca"} Jun 14 14:55:34.801498 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:34.801463 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:34.801703 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:34.801465 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:34.801703 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:34.801612 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4qgj" podUID="a96cd2e4-53eb-48b5-b3f7-b903b797c60c" Jun 14 14:55:34.801703 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:34.801618 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:34.801863 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:34.801715 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:55:34.801863 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:34.801804 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8dqpj" podUID="216cdb6a-b2ed-4a9c-b51a-a1fef923dc06" Jun 14 14:55:35.492951 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:35.492916 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:35.493407 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:35.493108 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:35.493407 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:35.493184 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs podName:4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:07.493163604 +0000 UTC m=+65.144356968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs") pod "network-metrics-daemon-2dkvj" (UID: "4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 14:55:35.593774 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:35.593748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlf8\" (UniqueName: \"kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8\") pod \"network-check-target-8dqpj\" (UID: \"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06\") " pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:35.593944 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:35.593836 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:35.593944 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:35.593924 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:35.593944 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:35.593929 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 14:55:35.594096 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:35.593951 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 14:55:35.594096 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:35.593963 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zlf8 for pod openshift-network-diagnostics/network-check-target-8dqpj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:35.594096 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:35.593975 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret podName:a96cd2e4-53eb-48b5-b3f7-b903b797c60c nodeName:}" failed. No retries permitted until 2026-06-14 14:56:07.59396131 +0000 UTC m=+65.245154657 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret") pod "global-pull-secret-syncer-k4qgj" (UID: "a96cd2e4-53eb-48b5-b3f7-b903b797c60c") : object "kube-system"/"original-pull-secret" not registered Jun 14 14:55:35.594096 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:35.594012 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8 podName:216cdb6a-b2ed-4a9c-b51a-a1fef923dc06 nodeName:}" failed. No retries permitted until 2026-06-14 14:56:07.593996596 +0000 UTC m=+65.245189952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zlf8" (UniqueName: "kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8") pod "network-check-target-8dqpj" (UID: "216cdb6a-b2ed-4a9c-b51a-a1fef923dc06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 14:55:36.687946 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.687704 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-52.ec2.internal" event="NodeReady" Jun 14 14:55:36.688322 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.688075 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 14:55:36.728338 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.728301 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s8tjb"] Jun 14 14:55:36.754335 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.754300 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w9slm"] Jun 14 14:55:36.754485 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.754440 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:36.757579 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.757543 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 14:55:36.757685 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.757585 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 14:55:36.757938 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.757798 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4p4qh\"" Jun 14 14:55:36.768261 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.768234 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s8tjb"] Jun 14 14:55:36.768366 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.768279 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w9slm"] Jun 14 14:55:36.768366 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.768356 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w9slm" Jun 14 14:55:36.770899 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.770875 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 14:55:36.771403 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.771380 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 14:55:36.771506 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.771440 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8bswm\"" Jun 14 14:55:36.771554 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.771381 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 14:55:36.801426 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.801364 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:55:36.801426 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.801380 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:55:36.801621 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.801369 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:55:36.804242 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.804226 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:55:36.804520 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.804506 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4zq9\"" Jun 14 14:55:36.804724 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.804698 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:55:36.804794 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.804736 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:55:36.804859 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.804794 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zrcbh\"" Jun 14 14:55:36.804914 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.804901 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:55:36.902935 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.902899 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20409142-101a-45b7-81e9-70f3a62939ab-config-volume\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:36.903112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.902983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:36.903112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.903014 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjvhh\" (UniqueName: \"kubernetes.io/projected/7f47767f-8df8-4ab4-aefb-7333d61ddf0f-kube-api-access-fjvhh\") pod \"ingress-canary-w9slm\" (UID: \"7f47767f-8df8-4ab4-aefb-7333d61ddf0f\") " pod="openshift-ingress-canary/ingress-canary-w9slm" Jun 14 14:55:36.903112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.903050 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20409142-101a-45b7-81e9-70f3a62939ab-tmp-dir\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:36.903112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.903071 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlbcf\" (UniqueName: \"kubernetes.io/projected/20409142-101a-45b7-81e9-70f3a62939ab-kube-api-access-zlbcf\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:36.903112 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:36.903094 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f47767f-8df8-4ab4-aefb-7333d61ddf0f-cert\") pod \"ingress-canary-w9slm\" (UID: \"7f47767f-8df8-4ab4-aefb-7333d61ddf0f\") " pod="openshift-ingress-canary/ingress-canary-w9slm" Jun 14 14:55:37.004361 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.004243 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20409142-101a-45b7-81e9-70f3a62939ab-tmp-dir\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:37.004361 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.004293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlbcf\" (UniqueName: \"kubernetes.io/projected/20409142-101a-45b7-81e9-70f3a62939ab-kube-api-access-zlbcf\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:37.004361 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.004321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f47767f-8df8-4ab4-aefb-7333d61ddf0f-cert\") pod \"ingress-canary-w9slm\" (UID: \"7f47767f-8df8-4ab4-aefb-7333d61ddf0f\") " pod="openshift-ingress-canary/ingress-canary-w9slm" Jun 14 14:55:37.004609 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.004536 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20409142-101a-45b7-81e9-70f3a62939ab-config-volume\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:37.004652 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.004618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:37.004685 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.004652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjvhh\" (UniqueName: \"kubernetes.io/projected/7f47767f-8df8-4ab4-aefb-7333d61ddf0f-kube-api-access-fjvhh\") pod \"ingress-canary-w9slm\" (UID: \"7f47767f-8df8-4ab4-aefb-7333d61ddf0f\") " pod="openshift-ingress-canary/ingress-canary-w9slm" Jun 14 14:55:37.004685 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.004652 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20409142-101a-45b7-81e9-70f3a62939ab-tmp-dir\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:37.004778 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:37.004763 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:37.004827 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:37.004820 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls podName:20409142-101a-45b7-81e9-70f3a62939ab nodeName:}" failed. No retries permitted until 2026-06-14 14:55:37.504807146 +0000 UTC m=+35.156000493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls") pod "dns-default-s8tjb" (UID: "20409142-101a-45b7-81e9-70f3a62939ab") : secret "dns-default-metrics-tls" not found Jun 14 14:55:37.005252 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.005230 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20409142-101a-45b7-81e9-70f3a62939ab-config-volume\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:37.010243 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.010212 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f47767f-8df8-4ab4-aefb-7333d61ddf0f-cert\") pod \"ingress-canary-w9slm\" (UID: \"7f47767f-8df8-4ab4-aefb-7333d61ddf0f\") " pod="openshift-ingress-canary/ingress-canary-w9slm" Jun 14 14:55:37.015243 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.015219 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlbcf\" (UniqueName: \"kubernetes.io/projected/20409142-101a-45b7-81e9-70f3a62939ab-kube-api-access-zlbcf\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:37.015328 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.015260 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjvhh\" (UniqueName: \"kubernetes.io/projected/7f47767f-8df8-4ab4-aefb-7333d61ddf0f-kube-api-access-fjvhh\") pod \"ingress-canary-w9slm\" (UID: \"7f47767f-8df8-4ab4-aefb-7333d61ddf0f\") " pod="openshift-ingress-canary/ingress-canary-w9slm" Jun 14 14:55:37.077850 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.077813 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w9slm" Jun 14 14:55:37.507172 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:37.507140 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:37.507335 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:37.507282 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:37.507393 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:37.507354 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls podName:20409142-101a-45b7-81e9-70f3a62939ab nodeName:}" failed. No retries permitted until 2026-06-14 14:55:38.507335809 +0000 UTC m=+36.158529179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls") pod "dns-default-s8tjb" (UID: "20409142-101a-45b7-81e9-70f3a62939ab") : secret "dns-default-metrics-tls" not found Jun 14 14:55:38.117904 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:38.117872 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w9slm"] Jun 14 14:55:38.181529 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:55:38.181500 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f47767f_8df8_4ab4_aefb_7333d61ddf0f.slice/crio-3cbf609c8547a179001f9b4925c3f7158271379718275883eef53a56998af5cb WatchSource:0}: Error finding container 3cbf609c8547a179001f9b4925c3f7158271379718275883eef53a56998af5cb: Status 404 returned error can't find the container with id 3cbf609c8547a179001f9b4925c3f7158271379718275883eef53a56998af5cb Jun 14 14:55:38.516297 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:38.516214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:38.516440 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:38.516315 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:38.516440 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:38.516367 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls podName:20409142-101a-45b7-81e9-70f3a62939ab nodeName:}" failed. No retries permitted until 2026-06-14 14:55:40.516354155 +0000 UTC m=+38.167547501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls") pod "dns-default-s8tjb" (UID: "20409142-101a-45b7-81e9-70f3a62939ab") : secret "dns-default-metrics-tls" not found Jun 14 14:55:39.025054 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:39.025019 2572 generic.go:356] "Generic (PLEG): container finished" podID="c83856f0-6aa9-42a6-befe-661a4f483135" containerID="f6d382a4b58de9bc34c212156f1284aff432fa8de0a8f4c2685062c7e2ca6804" exitCode=0 Jun 14 14:55:39.025235 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:39.025084 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-268sq" event={"ID":"c83856f0-6aa9-42a6-befe-661a4f483135","Type":"ContainerDied","Data":"f6d382a4b58de9bc34c212156f1284aff432fa8de0a8f4c2685062c7e2ca6804"} Jun 14 14:55:39.026769 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:39.026744 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w9slm" event={"ID":"7f47767f-8df8-4ab4-aefb-7333d61ddf0f","Type":"ContainerStarted","Data":"3cbf609c8547a179001f9b4925c3f7158271379718275883eef53a56998af5cb"} Jun 14 14:55:40.031597 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:40.031406 2572 generic.go:356] "Generic (PLEG): container finished" podID="c83856f0-6aa9-42a6-befe-661a4f483135" containerID="49de4386b45a0ed94b671a597d0a9afff742b69665bbdfc16ec55aed30d84566" exitCode=0 Jun 14 14:55:40.031976 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:40.031485 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-268sq" event={"ID":"c83856f0-6aa9-42a6-befe-661a4f483135","Type":"ContainerDied","Data":"49de4386b45a0ed94b671a597d0a9afff742b69665bbdfc16ec55aed30d84566"} Jun 14 14:55:40.531117 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:40.531083 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:40.531306 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:40.531198 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:40.531306 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:40.531260 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls podName:20409142-101a-45b7-81e9-70f3a62939ab nodeName:}" failed. No retries permitted until 2026-06-14 14:55:44.531239417 +0000 UTC m=+42.182432785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls") pod "dns-default-s8tjb" (UID: "20409142-101a-45b7-81e9-70f3a62939ab") : secret "dns-default-metrics-tls" not found Jun 14 14:55:41.037439 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:41.037404 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-268sq" event={"ID":"c83856f0-6aa9-42a6-befe-661a4f483135","Type":"ContainerStarted","Data":"2d7dead35f5f74a13d43e76d9cd515ea9d822f9ae3269da7c02e58e2f3bd99e2"} Jun 14 14:55:41.038696 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:41.038674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w9slm" event={"ID":"7f47767f-8df8-4ab4-aefb-7333d61ddf0f","Type":"ContainerStarted","Data":"b3e55c35ffe4073e59b6191c5853af31a883d86b18e1936688b6e5877c9cc9a6"} Jun 14 14:55:41.059632 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:41.059584 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-268sq" podStartSLOduration=8.684773831 podStartE2EDuration="39.059551254s" totalImagesPullingTime="30.374777423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:41.058709265 +0000 UTC m=+38.709902633" watchObservedRunningTime="2026-06-14 14:55:41.059551254 +0000 UTC m=+38.710744652" Jun 14 14:55:41.073203 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:41.073158 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w9slm" podStartSLOduration=3.062269744 podStartE2EDuration="5.073144056s" totalImagesPullingTime="2.010874312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:55:41.072350909 +0000 UTC m=+38.723544276" watchObservedRunningTime="2026-06-14 14:55:41.073144056 +0000 UTC m=+38.724337422" Jun 14 14:55:44.558944 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:44.558894 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:44.559332 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:44.559053 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:44.559332 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:44.559116 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls podName:20409142-101a-45b7-81e9-70f3a62939ab nodeName:}" failed. No retries permitted until 2026-06-14 14:55:52.559098435 +0000 UTC m=+50.210291783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls") pod "dns-default-s8tjb" (UID: "20409142-101a-45b7-81e9-70f3a62939ab") : secret "dns-default-metrics-tls" not found Jun 14 14:55:52.615503 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:55:52.615469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:55:52.616044 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:52.615648 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:55:52.616044 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:55:52.615721 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls podName:20409142-101a-45b7-81e9-70f3a62939ab nodeName:}" failed. No retries permitted until 2026-06-14 14:56:08.615704847 +0000 UTC m=+66.266898193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls") pod "dns-default-s8tjb" (UID: "20409142-101a-45b7-81e9-70f3a62939ab") : secret "dns-default-metrics-tls" not found Jun 14 14:56:03.015024 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:03.014989 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vrfxm" Jun 14 14:56:07.516981 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.516941 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:56:07.519711 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.519691 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 14:56:07.527652 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:56:07.527621 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:56:07.527748 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:56:07.527698 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs podName:4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47 nodeName:}" failed. No retries permitted until 2026-06-14 14:57:11.527676242 +0000 UTC m=+129.178869589 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs") pod "network-metrics-daemon-2dkvj" (UID: "4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47") : secret "metrics-daemon-secret" not found Jun 14 14:56:07.617832 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.617793 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:56:07.617832 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.617833 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlf8\" (UniqueName: \"kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8\") pod \"network-check-target-8dqpj\" (UID: \"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06\") " pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:56:07.620435 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.620409 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 14:56:07.620553 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.620495 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 14:56:07.630575 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.630548 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 14:56:07.631998 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.631979 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a96cd2e4-53eb-48b5-b3f7-b903b797c60c-original-pull-secret\") pod \"global-pull-secret-syncer-k4qgj\" (UID: \"a96cd2e4-53eb-48b5-b3f7-b903b797c60c\") " pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:56:07.641920 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.641897 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zlf8\" (UniqueName: \"kubernetes.io/projected/216cdb6a-b2ed-4a9c-b51a-a1fef923dc06-kube-api-access-6zlf8\") pod \"network-check-target-8dqpj\" (UID: \"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06\") " pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:56:07.714380 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.714349 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4zq9\"" Jun 14 14:56:07.722614 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.722597 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:56:07.723825 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.723808 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4qgj" Jun 14 14:56:07.877816 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.877787 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k4qgj"] Jun 14 14:56:07.881811 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:07.881776 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8dqpj"] Jun 14 14:56:07.884674 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:56:07.884649 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216cdb6a_b2ed_4a9c_b51a_a1fef923dc06.slice/crio-03cbc1c10d9096f4302d714b31db5ca37663fedcd8353641bf9635e8837f21dd WatchSource:0}: Error finding container 03cbc1c10d9096f4302d714b31db5ca37663fedcd8353641bf9635e8837f21dd: Status 404 returned error can't find the container with id 03cbc1c10d9096f4302d714b31db5ca37663fedcd8353641bf9635e8837f21dd Jun 14 14:56:08.101096 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:08.101059 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8dqpj" event={"ID":"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06","Type":"ContainerStarted","Data":"03cbc1c10d9096f4302d714b31db5ca37663fedcd8353641bf9635e8837f21dd"} Jun 14 14:56:08.102140 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:08.102116 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k4qgj" event={"ID":"a96cd2e4-53eb-48b5-b3f7-b903b797c60c","Type":"ContainerStarted","Data":"49fc17479c56d5df94bb2bf4852e3009646f1de3f8c77b04b3f84e3bba65fb7f"} Jun 14 14:56:08.624185 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:08.624143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:56:08.624764 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:56:08.624332 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:56:08.624764 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:56:08.624402 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls podName:20409142-101a-45b7-81e9-70f3a62939ab nodeName:}" failed. No retries permitted until 2026-06-14 14:56:40.624380693 +0000 UTC m=+98.275574050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls") pod "dns-default-s8tjb" (UID: "20409142-101a-45b7-81e9-70f3a62939ab") : secret "dns-default-metrics-tls" not found Jun 14 14:56:13.117524 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:13.117486 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8dqpj" event={"ID":"216cdb6a-b2ed-4a9c-b51a-a1fef923dc06","Type":"ContainerStarted","Data":"0e3212cd1bb19c9a6cc54649480812d1c16f40926070aa6b61bc84bb6454ba51"} Jun 14 14:56:13.117939 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:13.117614 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:56:13.118924 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:13.118904 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k4qgj" event={"ID":"a96cd2e4-53eb-48b5-b3f7-b903b797c60c","Type":"ContainerStarted","Data":"c96096f9b9504fe09236a9915cd23e9c2dbb090d0a99e789e0e84f85cc96869f"} Jun 14 14:56:13.133169 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:13.133125 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8dqpj" podStartSLOduration=66.33039093 podStartE2EDuration="1m11.133109213s" totalImagesPullingTime="4.802718283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:56:13.131880263 +0000 UTC m=+70.783073632" watchObservedRunningTime="2026-06-14 14:56:13.133109213 +0000 UTC m=+70.784302562" Jun 14 14:56:13.145951 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:13.145904 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k4qgj" podStartSLOduration=65.327367398 podStartE2EDuration="1m10.145890317s" totalImagesPullingTime="4.818522919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:56:13.145673018 +0000 UTC m=+70.796866387" watchObservedRunningTime="2026-06-14 14:56:13.145890317 +0000 UTC m=+70.797083677" Jun 14 14:56:40.638624 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:40.638548 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:56:40.639121 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:56:40.638715 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:56:40.639121 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:56:40.638794 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls podName:20409142-101a-45b7-81e9-70f3a62939ab nodeName:}" failed. No retries permitted until 2026-06-14 14:57:44.63877544 +0000 UTC m=+162.289968805 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls") pod "dns-default-s8tjb" (UID: "20409142-101a-45b7-81e9-70f3a62939ab") : secret "dns-default-metrics-tls" not found Jun 14 14:56:44.124726 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:56:44.124695 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8dqpj" Jun 14 14:57:11.541269 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:57:11.541215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:57:11.541798 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:57:11.541343 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 14:57:11.541798 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:57:11.541409 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs podName:4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:13.541394438 +0000 UTC m=+251.192587785 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs") pod "network-metrics-daemon-2dkvj" (UID: "4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47") : secret "metrics-daemon-secret" not found Jun 14 14:57:39.766745 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:57:39.766709 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s8tjb" podUID="20409142-101a-45b7-81e9-70f3a62939ab" Jun 14 14:57:39.818095 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:57:39.818052 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2dkvj" podUID="4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47" Jun 14 14:57:40.317145 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:57:40.317114 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s8tjb" Jun 14 14:57:44.662337 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:57:44.662280 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:57:44.662777 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:57:44.662435 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 14:57:44.662777 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:57:44.662498 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls podName:20409142-101a-45b7-81e9-70f3a62939ab nodeName:}" failed. No retries permitted until 2026-06-14 14:59:46.662480274 +0000 UTC m=+284.313673623 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls") pod "dns-default-s8tjb" (UID: "20409142-101a-45b7-81e9-70f3a62939ab") : secret "dns-default-metrics-tls" not found Jun 14 14:57:52.802476 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:57:52.802398 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:58:54.061044 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.061002 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7"] Jun 14 14:58:54.062908 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.062892 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-8g46n"] Jun 14 14:58:54.063042 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.063023 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:58:54.064734 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.064711 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.072930 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.072914 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 14 14:58:54.073064 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.072932 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 14 14:58:54.076890 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.076871 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 14 14:58:54.083139 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.083117 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 14 14:58:54.083238 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.083139 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gwrn4\"" Jun 14 14:58:54.083238 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.083214 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-d6pmm\"" Jun 14 14:58:54.083328 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.083247 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 14 14:58:54.083448 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.083434 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:58:54.083485 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.083460 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 14 14:58:54.084041 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.084022 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56f859595b-bwxg8"] Jun 14 14:58:54.085828 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.085815 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.091735 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.091721 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 14 14:58:54.094167 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.094152 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vk6k7\"" Jun 14 14:58:54.095671 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.095657 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 14 14:58:54.096542 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.096450 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 14 14:58:54.097046 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.097025 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 14:58:54.097133 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.097065 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 14 14:58:54.097311 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.097291 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 14:58:54.101695 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.101670 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7"] Jun 14 14:58:54.102481 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.102465 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 14 14:58:54.114054 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.114031 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56f859595b-bwxg8"] Jun 14 14:58:54.116913 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.116894 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-8g46n"] Jun 14 14:58:54.127012 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.126992 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.127103 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.127020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52970f42-ef4e-4211-a90e-9180254d82b4-serving-cert\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.127103 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.127040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-stats-auth\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.127103 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.127064 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2s9h\" (UniqueName: \"kubernetes.io/projected/52970f42-ef4e-4211-a90e-9180254d82b4-kube-api-access-l2s9h\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.127202 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.127111 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/52970f42-ef4e-4211-a90e-9180254d82b4-trusted-ca\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.127202 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.127143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.127263 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.127205 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z9cg\" (UniqueName: \"kubernetes.io/projected/65558665-5b69-4003-b6d6-c90ced0698ab-kube-api-access-7z9cg\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.127263 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.127254 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52970f42-ef4e-4211-a90e-9180254d82b4-config\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.127322 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.127271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-mhsx7\" (UID: \"713f3368-9e3d-4734-bff8-764fb126fdae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:58:54.127322 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.127294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcjc8\" (UniqueName: \"kubernetes.io/projected/713f3368-9e3d-4734-bff8-764fb126fdae-kube-api-access-dcjc8\") pod \"cluster-samples-operator-9547488fd-mhsx7\" (UID: \"713f3368-9e3d-4734-bff8-764fb126fdae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:58:54.127322 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.127313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-default-certificate\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.136401 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.136381 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-xr776"] Jun 14 14:58:54.138435 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.138422 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-xr776" Jun 14 14:58:54.140685 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.140668 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-c7vnx\"" Jun 14 14:58:54.148335 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.148315 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-xr776"] Jun 14 14:58:54.228149 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228114 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.228149 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z9cg\" (UniqueName: \"kubernetes.io/projected/65558665-5b69-4003-b6d6-c90ced0698ab-kube-api-access-7z9cg\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.228398 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52970f42-ef4e-4211-a90e-9180254d82b4-config\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.228398 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228212 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-mhsx7\" (UID: \"713f3368-9e3d-4734-bff8-764fb126fdae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:58:54.228398 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228228 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcjc8\" (UniqueName: \"kubernetes.io/projected/713f3368-9e3d-4734-bff8-764fb126fdae-kube-api-access-dcjc8\") pod \"cluster-samples-operator-9547488fd-mhsx7\" (UID: \"713f3368-9e3d-4734-bff8-764fb126fdae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:58:54.228398 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228244 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-default-certificate\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.228398 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:54.228284 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 14:58:54.228398 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:54.228344 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs podName:65558665-5b69-4003-b6d6-c90ced0698ab nodeName:}" failed. No retries permitted until 2026-06-14 14:58:54.728328972 +0000 UTC m=+232.379522321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs") pod "router-default-56f859595b-bwxg8" (UID: "65558665-5b69-4003-b6d6-c90ced0698ab") : secret "router-metrics-certs-default" not found Jun 14 14:58:54.228398 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:54.228345 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 14:58:54.228398 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:54.228404 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls podName:713f3368-9e3d-4734-bff8-764fb126fdae nodeName:}" failed. No retries permitted until 2026-06-14 14:58:54.728386536 +0000 UTC m=+232.379579899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls") pod "cluster-samples-operator-9547488fd-mhsx7" (UID: "713f3368-9e3d-4734-bff8-764fb126fdae") : secret "samples-operator-tls" not found Jun 14 14:58:54.228831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228428 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sddn5\" (UniqueName: \"kubernetes.io/projected/32929c1f-717e-4932-b9f9-9fed7c721135-kube-api-access-sddn5\") pod \"network-check-source-6947749cfc-xr776\" (UID: \"32929c1f-717e-4932-b9f9-9fed7c721135\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-xr776" Jun 14 14:58:54.228831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.228831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52970f42-ef4e-4211-a90e-9180254d82b4-serving-cert\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.228831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-stats-auth\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.228831 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:54.228599 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle podName:65558665-5b69-4003-b6d6-c90ced0698ab nodeName:}" failed. No retries permitted until 2026-06-14 14:58:54.728582353 +0000 UTC m=+232.379775728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle") pod "router-default-56f859595b-bwxg8" (UID: "65558665-5b69-4003-b6d6-c90ced0698ab") : configmap references non-existent config key: service-ca.crt Jun 14 14:58:54.228831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228624 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2s9h\" (UniqueName: \"kubernetes.io/projected/52970f42-ef4e-4211-a90e-9180254d82b4-kube-api-access-l2s9h\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.228831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.228672 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/52970f42-ef4e-4211-a90e-9180254d82b4-trusted-ca\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.229282 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.229258 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52970f42-ef4e-4211-a90e-9180254d82b4-config\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.229541 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.229525 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/52970f42-ef4e-4211-a90e-9180254d82b4-trusted-ca\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.230885 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.230863 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-default-certificate\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.231403 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.231378 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52970f42-ef4e-4211-a90e-9180254d82b4-serving-cert\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.231502 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.231418 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-stats-auth\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.240740 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.240715 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2s9h\" (UniqueName: \"kubernetes.io/projected/52970f42-ef4e-4211-a90e-9180254d82b4-kube-api-access-l2s9h\") pod \"console-operator-5dbbb5d744-8g46n\" (UID: \"52970f42-ef4e-4211-a90e-9180254d82b4\") " pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.240932 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.240916 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcjc8\" (UniqueName: \"kubernetes.io/projected/713f3368-9e3d-4734-bff8-764fb126fdae-kube-api-access-dcjc8\") pod \"cluster-samples-operator-9547488fd-mhsx7\" (UID: \"713f3368-9e3d-4734-bff8-764fb126fdae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:58:54.241154 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.241132 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z9cg\" (UniqueName: \"kubernetes.io/projected/65558665-5b69-4003-b6d6-c90ced0698ab-kube-api-access-7z9cg\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.329872 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.329787 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sddn5\" (UniqueName: \"kubernetes.io/projected/32929c1f-717e-4932-b9f9-9fed7c721135-kube-api-access-sddn5\") pod \"network-check-source-6947749cfc-xr776\" (UID: \"32929c1f-717e-4932-b9f9-9fed7c721135\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-xr776" Jun 14 14:58:54.338003 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.337975 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sddn5\" (UniqueName: \"kubernetes.io/projected/32929c1f-717e-4932-b9f9-9fed7c721135-kube-api-access-sddn5\") pod \"network-check-source-6947749cfc-xr776\" (UID: \"32929c1f-717e-4932-b9f9-9fed7c721135\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-xr776" Jun 14 14:58:54.376709 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.376683 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:58:54.447106 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.447079 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-xr776" Jun 14 14:58:54.506229 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.506196 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-8g46n"] Jun 14 14:58:54.510296 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:58:54.510271 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52970f42_ef4e_4211_a90e_9180254d82b4.slice/crio-283634f0e52d4dab6bfe4431e66e59ac115fba5bdc2b70e8d4a5a30c090ce51e WatchSource:0}: Error finding container 283634f0e52d4dab6bfe4431e66e59ac115fba5bdc2b70e8d4a5a30c090ce51e: Status 404 returned error can't find the container with id 283634f0e52d4dab6bfe4431e66e59ac115fba5bdc2b70e8d4a5a30c090ce51e Jun 14 14:58:54.574630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.574600 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-xr776"] Jun 14 14:58:54.577449 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:58:54.577426 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32929c1f_717e_4932_b9f9_9fed7c721135.slice/crio-cc9a89eb2bdb2351ec7b26d56f7e679ad657c8034b559176d99f3da48431ab5b WatchSource:0}: Error finding container cc9a89eb2bdb2351ec7b26d56f7e679ad657c8034b559176d99f3da48431ab5b: Status 404 returned error can't find the container with id cc9a89eb2bdb2351ec7b26d56f7e679ad657c8034b559176d99f3da48431ab5b Jun 14 14:58:54.732009 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.731969 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-mhsx7\" (UID: \"713f3368-9e3d-4734-bff8-764fb126fdae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:58:54.732188 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.732016 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.732188 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:54.732058 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:54.732188 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:54.732144 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 14:58:54.732188 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:54.732151 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 14:58:54.732188 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:54.732172 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle podName:65558665-5b69-4003-b6d6-c90ced0698ab nodeName:}" failed. No retries permitted until 2026-06-14 14:58:55.732155047 +0000 UTC m=+233.383348410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle") pod "router-default-56f859595b-bwxg8" (UID: "65558665-5b69-4003-b6d6-c90ced0698ab") : configmap references non-existent config key: service-ca.crt Jun 14 14:58:54.732344 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:54.732193 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs podName:65558665-5b69-4003-b6d6-c90ced0698ab nodeName:}" failed. No retries permitted until 2026-06-14 14:58:55.7321863 +0000 UTC m=+233.383379647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs") pod "router-default-56f859595b-bwxg8" (UID: "65558665-5b69-4003-b6d6-c90ced0698ab") : secret "router-metrics-certs-default" not found Jun 14 14:58:54.732344 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:54.732204 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls podName:713f3368-9e3d-4734-bff8-764fb126fdae nodeName:}" failed. No retries permitted until 2026-06-14 14:58:55.732198488 +0000 UTC m=+233.383391835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls") pod "cluster-samples-operator-9547488fd-mhsx7" (UID: "713f3368-9e3d-4734-bff8-764fb126fdae") : secret "samples-operator-tls" not found Jun 14 14:58:55.496866 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:55.496825 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-xr776" event={"ID":"32929c1f-717e-4932-b9f9-9fed7c721135","Type":"ContainerStarted","Data":"dcfef1daa2670ac64a53a72d5853c805bc586aaa4be8c1bb5a21a075dd8d26c0"} Jun 14 14:58:55.497334 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:55.496885 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-xr776" event={"ID":"32929c1f-717e-4932-b9f9-9fed7c721135","Type":"ContainerStarted","Data":"cc9a89eb2bdb2351ec7b26d56f7e679ad657c8034b559176d99f3da48431ab5b"} Jun 14 14:58:55.498426 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:55.498400 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" event={"ID":"52970f42-ef4e-4211-a90e-9180254d82b4","Type":"ContainerStarted","Data":"283634f0e52d4dab6bfe4431e66e59ac115fba5bdc2b70e8d4a5a30c090ce51e"} Jun 14 14:58:55.512047 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:55.512002 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-xr776" podStartSLOduration=1.511987755 podStartE2EDuration="1.511987755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:58:55.511393045 +0000 UTC m=+233.162586414" watchObservedRunningTime="2026-06-14 14:58:55.511987755 +0000 UTC m=+233.163181125" Jun 14 14:58:55.742499 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:55.742455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:55.742705 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:55.742530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-mhsx7\" (UID: \"713f3368-9e3d-4734-bff8-764fb126fdae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:58:55.742705 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:55.742593 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:55.742705 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:55.742645 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 14:58:55.742705 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:55.742676 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 14:58:55.742921 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:55.742728 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls podName:713f3368-9e3d-4734-bff8-764fb126fdae nodeName:}" failed. No retries permitted until 2026-06-14 14:58:57.742708206 +0000 UTC m=+235.393901554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls") pod "cluster-samples-operator-9547488fd-mhsx7" (UID: "713f3368-9e3d-4734-bff8-764fb126fdae") : secret "samples-operator-tls" not found Jun 14 14:58:55.742921 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:55.742745 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs podName:65558665-5b69-4003-b6d6-c90ced0698ab nodeName:}" failed. No retries permitted until 2026-06-14 14:58:57.7427372 +0000 UTC m=+235.393930549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs") pod "router-default-56f859595b-bwxg8" (UID: "65558665-5b69-4003-b6d6-c90ced0698ab") : secret "router-metrics-certs-default" not found Jun 14 14:58:55.742921 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:55.742761 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle podName:65558665-5b69-4003-b6d6-c90ced0698ab nodeName:}" failed. No retries permitted until 2026-06-14 14:58:57.742751387 +0000 UTC m=+235.393944734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle") pod "router-default-56f859595b-bwxg8" (UID: "65558665-5b69-4003-b6d6-c90ced0698ab") : configmap references non-existent config key: service-ca.crt Jun 14 14:58:56.502456 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:56.502366 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/0.log" Jun 14 14:58:56.502456 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:56.502408 2572 generic.go:356] "Generic (PLEG): container finished" podID="52970f42-ef4e-4211-a90e-9180254d82b4" containerID="5ec1253219401e27cd0a08f2f7a1e618313382a5d90be480152fb1f78ac442e9" exitCode=255 Jun 14 14:58:56.502456 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:56.502442 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" event={"ID":"52970f42-ef4e-4211-a90e-9180254d82b4","Type":"ContainerDied","Data":"5ec1253219401e27cd0a08f2f7a1e618313382a5d90be480152fb1f78ac442e9"} Jun 14 14:58:56.503030 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:56.502756 2572 scope.go:117] "RemoveContainer" containerID="5ec1253219401e27cd0a08f2f7a1e618313382a5d90be480152fb1f78ac442e9" Jun 14 14:58:57.509026 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:57.508998 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 14:58:57.509479 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:57.509441 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/0.log" Jun 14 14:58:57.509546 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:57.509483 2572 generic.go:356] "Generic (PLEG): container finished" podID="52970f42-ef4e-4211-a90e-9180254d82b4" containerID="6a73943e3ae77434c0fa73fa57d8d845fb38ce14dc4f76673f7d989a67bdb145" exitCode=255 Jun 14 14:58:57.509546 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:57.509538 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" event={"ID":"52970f42-ef4e-4211-a90e-9180254d82b4","Type":"ContainerDied","Data":"6a73943e3ae77434c0fa73fa57d8d845fb38ce14dc4f76673f7d989a67bdb145"} Jun 14 14:58:57.509676 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:57.509619 2572 scope.go:117] "RemoveContainer" containerID="5ec1253219401e27cd0a08f2f7a1e618313382a5d90be480152fb1f78ac442e9" Jun 14 14:58:57.509780 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:57.509763 2572 scope.go:117] "RemoveContainer" containerID="6a73943e3ae77434c0fa73fa57d8d845fb38ce14dc4f76673f7d989a67bdb145" Jun 14 14:58:57.509963 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:57.509934 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-8g46n_openshift-console-operator(52970f42-ef4e-4211-a90e-9180254d82b4)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" podUID="52970f42-ef4e-4211-a90e-9180254d82b4" Jun 14 14:58:57.756787 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:57.756760 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:57.757013 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:57.756808 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:58:57.757013 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:57.756851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-mhsx7\" (UID: \"713f3368-9e3d-4734-bff8-764fb126fdae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:58:57.757013 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:57.756936 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle podName:65558665-5b69-4003-b6d6-c90ced0698ab nodeName:}" failed. No retries permitted until 2026-06-14 14:59:01.756917175 +0000 UTC m=+239.408110539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle") pod "router-default-56f859595b-bwxg8" (UID: "65558665-5b69-4003-b6d6-c90ced0698ab") : configmap references non-existent config key: service-ca.crt Jun 14 14:58:57.757013 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:57.756941 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 14:58:57.757013 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:57.756979 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls podName:713f3368-9e3d-4734-bff8-764fb126fdae nodeName:}" failed. No retries permitted until 2026-06-14 14:59:01.756970105 +0000 UTC m=+239.408163453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls") pod "cluster-samples-operator-9547488fd-mhsx7" (UID: "713f3368-9e3d-4734-bff8-764fb126fdae") : secret "samples-operator-tls" not found Jun 14 14:58:57.757013 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:57.756982 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 14:58:57.757210 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:57.757046 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs podName:65558665-5b69-4003-b6d6-c90ced0698ab nodeName:}" failed. No retries permitted until 2026-06-14 14:59:01.75703003 +0000 UTC m=+239.408223395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs") pod "router-default-56f859595b-bwxg8" (UID: "65558665-5b69-4003-b6d6-c90ced0698ab") : secret "router-metrics-certs-default" not found Jun 14 14:58:58.493626 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.493585 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q8h9s"] Jun 14 14:58:58.496284 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.496263 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.499419 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.499396 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 14:58:58.499553 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.499483 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 14:58:58.500473 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.500458 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 14:58:58.500473 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.500471 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kkhv5\"" Jun 14 14:58:58.500619 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.500469 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 14:58:58.508533 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.508510 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q8h9s"] Jun 14 14:58:58.514364 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.514347 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 14:58:58.514687 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.514673 2572 scope.go:117] "RemoveContainer" containerID="6a73943e3ae77434c0fa73fa57d8d845fb38ce14dc4f76673f7d989a67bdb145" Jun 14 14:58:58.514853 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:58.514827 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-8g46n_openshift-console-operator(52970f42-ef4e-4211-a90e-9180254d82b4)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" podUID="52970f42-ef4e-4211-a90e-9180254d82b4" Jun 14 14:58:58.563612 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.563557 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-crio-socket\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.563796 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.563670 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-data-volume\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.563796 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.563712 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j78k7\" (UniqueName: \"kubernetes.io/projected/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-api-access-j78k7\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.563796 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.563779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.563922 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.563866 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.664318 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.664278 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-crio-socket\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.664478 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.664335 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-data-volume\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.664478 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.664368 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j78k7\" (UniqueName: \"kubernetes.io/projected/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-api-access-j78k7\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.664478 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.664393 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.664478 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.664409 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-crio-socket\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.664478 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.664433 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.664706 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:58.664488 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:58:58.664706 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:58.664556 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:58:58.664706 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:58.664590 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm podName:7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:59.164547636 +0000 UTC m=+236.815740984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8h9s" (UID: "7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20") : configmap "kube-rbac-proxy" not found Jun 14 14:58:58.664706 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:58.664617 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls podName:7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20 nodeName:}" failed. No retries permitted until 2026-06-14 14:58:59.164605589 +0000 UTC m=+236.815798939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8h9s" (UID: "7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20") : secret "insights-runtime-extractor-tls" not found Jun 14 14:58:58.664844 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.664730 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-data-volume\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:58.672524 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:58.672494 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j78k7\" (UniqueName: \"kubernetes.io/projected/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-api-access-j78k7\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:59.168037 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.167995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:59.168218 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.168061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:58:59.168218 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:59.168120 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:58:59.168218 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:59.168194 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm podName:7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:00.168177988 +0000 UTC m=+237.819371340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8h9s" (UID: "7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20") : configmap "kube-rbac-proxy" not found Jun 14 14:58:59.168326 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:59.168218 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:58:59.168326 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:58:59.168272 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls podName:7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:00.168259639 +0000 UTC m=+237.819452986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8h9s" (UID: "7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20") : secret "insights-runtime-extractor-tls" not found Jun 14 14:58:59.547437 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.547401 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7"] Jun 14 14:58:59.549576 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.549548 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7" Jun 14 14:58:59.552252 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.552232 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 14 14:58:59.553327 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.553310 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-c77jp\"" Jun 14 14:58:59.553406 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.553328 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 14 14:58:59.557471 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.557447 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7"] Jun 14 14:58:59.672681 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.672646 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5nfq\" (UniqueName: \"kubernetes.io/projected/0a765b3d-c90f-4987-8180-b4aa90dcfe1d-kube-api-access-m5nfq\") pod \"migrator-d4bcd4867-w7jc7\" (UID: \"0a765b3d-c90f-4987-8180-b4aa90dcfe1d\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7" Jun 14 14:58:59.772967 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.772936 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5nfq\" (UniqueName: \"kubernetes.io/projected/0a765b3d-c90f-4987-8180-b4aa90dcfe1d-kube-api-access-m5nfq\") pod \"migrator-d4bcd4867-w7jc7\" (UID: \"0a765b3d-c90f-4987-8180-b4aa90dcfe1d\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7" Jun 14 14:58:59.782604 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.782558 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5nfq\" (UniqueName: \"kubernetes.io/projected/0a765b3d-c90f-4987-8180-b4aa90dcfe1d-kube-api-access-m5nfq\") pod \"migrator-d4bcd4867-w7jc7\" (UID: \"0a765b3d-c90f-4987-8180-b4aa90dcfe1d\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7" Jun 14 14:58:59.859103 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.859021 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7" Jun 14 14:58:59.978237 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:58:59.978084 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7"] Jun 14 14:58:59.980501 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:58:59.980471 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a765b3d_c90f_4987_8180_b4aa90dcfe1d.slice/crio-eaac6327779df17c5bfe3c2fbe845c32aaf0adbf1b111a7f2f280cb1db8752d9 WatchSource:0}: Error finding container eaac6327779df17c5bfe3c2fbe845c32aaf0adbf1b111a7f2f280cb1db8752d9: Status 404 returned error can't find the container with id eaac6327779df17c5bfe3c2fbe845c32aaf0adbf1b111a7f2f280cb1db8752d9 Jun 14 14:59:00.176142 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:00.176054 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:59:00.176142 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:00.176110 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:59:00.176315 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:00.176180 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:59:00.176315 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:00.176245 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm podName:7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:02.176231075 +0000 UTC m=+239.827424423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8h9s" (UID: "7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20") : configmap "kube-rbac-proxy" not found Jun 14 14:59:00.176315 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:00.176272 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:59:00.176445 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:00.176328 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls podName:7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:02.176315418 +0000 UTC m=+239.827508769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8h9s" (UID: "7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20") : secret "insights-runtime-extractor-tls" not found Jun 14 14:59:00.523056 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:00.522970 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7" event={"ID":"0a765b3d-c90f-4987-8180-b4aa90dcfe1d","Type":"ContainerStarted","Data":"eaac6327779df17c5bfe3c2fbe845c32aaf0adbf1b111a7f2f280cb1db8752d9"} Jun 14 14:59:00.564503 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:00.564470 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ff8ft_261cff16-3b72-49bc-8d5c-0f0adc1f6b41/dns-node-resolver/0.log" Jun 14 14:59:01.364490 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:01.364464 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mlskw_56ea1beb-5880-4c72-bfb2-b57784851c0f/node-ca/0.log" Jun 14 14:59:01.527533 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:01.527501 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7" event={"ID":"0a765b3d-c90f-4987-8180-b4aa90dcfe1d","Type":"ContainerStarted","Data":"80551370a4d82e137c660bd6f9e1a7bae6a7bd67d1facb5e6da7e5b23e64c024"} Jun 14 14:59:01.527732 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:01.527551 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7" event={"ID":"0a765b3d-c90f-4987-8180-b4aa90dcfe1d","Type":"ContainerStarted","Data":"f5ecf3f43421803356fd8de1d78afa743fe64a71d3ea3c57ce69b0e1daef4704"} Jun 14 14:59:01.543488 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:01.543441 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-w7jc7" podStartSLOduration=1.508769987 podStartE2EDuration="2.543425364s" totalImagesPullingTime="1.034655377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:01.542540527 +0000 UTC m=+239.193733910" watchObservedRunningTime="2026-06-14 14:59:01.543425364 +0000 UTC m=+239.194618734" Jun 14 14:59:01.790250 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:01.790154 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:01.790250 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:01.790233 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-mhsx7\" (UID: \"713f3368-9e3d-4734-bff8-764fb126fdae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:59:01.790662 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:01.790279 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:01.790662 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:01.790312 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 14 14:59:01.790662 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:01.790378 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs podName:65558665-5b69-4003-b6d6-c90ced0698ab nodeName:}" failed. No retries permitted until 2026-06-14 14:59:09.790358537 +0000 UTC m=+247.441551898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs") pod "router-default-56f859595b-bwxg8" (UID: "65558665-5b69-4003-b6d6-c90ced0698ab") : secret "router-metrics-certs-default" not found Jun 14 14:59:01.790662 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:01.790391 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 14:59:01.790662 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:01.790411 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle podName:65558665-5b69-4003-b6d6-c90ced0698ab nodeName:}" failed. No retries permitted until 2026-06-14 14:59:09.790401825 +0000 UTC m=+247.441595172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle") pod "router-default-56f859595b-bwxg8" (UID: "65558665-5b69-4003-b6d6-c90ced0698ab") : configmap references non-existent config key: service-ca.crt Jun 14 14:59:01.790662 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:01.790452 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls podName:713f3368-9e3d-4734-bff8-764fb126fdae nodeName:}" failed. No retries permitted until 2026-06-14 14:59:09.790435261 +0000 UTC m=+247.441628619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls") pod "cluster-samples-operator-9547488fd-mhsx7" (UID: "713f3368-9e3d-4734-bff8-764fb126fdae") : secret "samples-operator-tls" not found Jun 14 14:59:02.193945 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:02.193891 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:59:02.194142 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:02.193959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:59:02.194142 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:02.194015 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:59:02.194142 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:02.194075 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:59:02.194142 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:02.194082 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm podName:7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:06.194067619 +0000 UTC m=+243.845260970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8h9s" (UID: "7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20") : configmap "kube-rbac-proxy" not found Jun 14 14:59:02.194142 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:02.194143 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls podName:7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:06.194126801 +0000 UTC m=+243.845320154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8h9s" (UID: "7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20") : secret "insights-runtime-extractor-tls" not found Jun 14 14:59:02.365256 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:02.365221 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w9slm_7f47767f-8df8-4ab4-aefb-7333d61ddf0f/serve-healthcheck-canary/0.log" Jun 14 14:59:04.377797 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:04.377761 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:59:04.378159 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:04.377828 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:59:04.378195 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:04.378180 2572 scope.go:117] "RemoveContainer" containerID="6a73943e3ae77434c0fa73fa57d8d845fb38ce14dc4f76673f7d989a67bdb145" Jun 14 14:59:04.378344 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:04.378323 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-8g46n_openshift-console-operator(52970f42-ef4e-4211-a90e-9180254d82b4)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" podUID="52970f42-ef4e-4211-a90e-9180254d82b4" Jun 14 14:59:06.228913 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:06.228867 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:59:06.228913 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:06.228926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:59:06.229400 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:06.229010 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 14:59:06.229400 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:06.229033 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 14:59:06.229400 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:06.229093 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm podName:7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:14.229072176 +0000 UTC m=+251.880265524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8h9s" (UID: "7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20") : configmap "kube-rbac-proxy" not found Jun 14 14:59:06.229400 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:06.229115 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls podName:7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20 nodeName:}" failed. No retries permitted until 2026-06-14 14:59:14.229106056 +0000 UTC m=+251.880299406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8h9s" (UID: "7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20") : secret "insights-runtime-extractor-tls" not found Jun 14 14:59:09.858458 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:09.858407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-mhsx7\" (UID: \"713f3368-9e3d-4734-bff8-764fb126fdae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:59:09.858458 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:09.858473 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:09.859000 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:09.858524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:09.859000 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:09.858691 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle podName:65558665-5b69-4003-b6d6-c90ced0698ab nodeName:}" failed. No retries permitted until 2026-06-14 14:59:25.858670063 +0000 UTC m=+263.509863422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle") pod "router-default-56f859595b-bwxg8" (UID: "65558665-5b69-4003-b6d6-c90ced0698ab") : configmap references non-existent config key: service-ca.crt Jun 14 14:59:09.861067 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:09.861037 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/713f3368-9e3d-4734-bff8-764fb126fdae-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-mhsx7\" (UID: \"713f3368-9e3d-4734-bff8-764fb126fdae\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:59:09.861181 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:09.861131 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65558665-5b69-4003-b6d6-c90ced0698ab-metrics-certs\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:09.976255 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:09.976223 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-d6pmm\"" Jun 14 14:59:09.984257 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:09.984239 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" Jun 14 14:59:10.110164 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:10.110064 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7"] Jun 14 14:59:10.553612 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:10.553556 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" event={"ID":"713f3368-9e3d-4734-bff8-764fb126fdae","Type":"ContainerStarted","Data":"590368a8af2753769a640cd8d974c00eee208b128004aef2242c9a63e8a38886"} Jun 14 14:59:12.561639 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:12.561604 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" event={"ID":"713f3368-9e3d-4734-bff8-764fb126fdae","Type":"ContainerStarted","Data":"ff530b5064d5db6325a7a48f5249307e337bfbc88e743aef6771186577678818"} Jun 14 14:59:12.562106 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:12.561668 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" event={"ID":"713f3368-9e3d-4734-bff8-764fb126fdae","Type":"ContainerStarted","Data":"af67bc18e58c27b74dde6877293f3633de243ea6b9c56a7f33fc0899d5d776cb"} Jun 14 14:59:12.578213 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:12.578169 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-mhsx7" podStartSLOduration=16.859654545 podStartE2EDuration="18.578157169s" totalImagesPullingTime="1.718502624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:12.577288598 +0000 UTC m=+250.228481966" watchObservedRunningTime="2026-06-14 14:59:12.578157169 +0000 UTC m=+250.229350578" Jun 14 14:59:13.590614 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:13.590578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:59:13.593028 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:13.593000 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47-metrics-certs\") pod \"network-metrics-daemon-2dkvj\" (UID: \"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47\") " pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:59:13.806465 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:13.806431 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zrcbh\"" Jun 14 14:59:13.814450 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:13.814430 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkvj" Jun 14 14:59:13.945933 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:13.943474 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2dkvj"] Jun 14 14:59:13.948709 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:13.948682 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8d3060_5a65_46a3_bf4d_7ba0c0cdfb47.slice/crio-f4cc3b1a7e7dd6da907669c8c85719c8c8307c107a0a8252b431936e94144ae5 WatchSource:0}: Error finding container f4cc3b1a7e7dd6da907669c8c85719c8c8307c107a0a8252b431936e94144ae5: Status 404 returned error can't find the container with id f4cc3b1a7e7dd6da907669c8c85719c8c8307c107a0a8252b431936e94144ae5 Jun 14 14:59:14.296379 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:14.296343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:59:14.296506 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:14.296395 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:59:14.297057 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:14.297038 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:59:14.298762 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:14.298745 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8h9s\" (UID: \"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20\") " pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:59:14.408180 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:14.408149 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kkhv5\"" Jun 14 14:59:14.415647 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:14.415618 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q8h9s" Jun 14 14:59:14.558464 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:14.558360 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q8h9s"] Jun 14 14:59:14.562055 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:14.562021 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef3d01c_2a7f_4b9f_9095_8f2d31d2fa20.slice/crio-73981a6e0045c9288aaf43a4e392d7899a8e3992ae41cae240db1ff9b69f0262 WatchSource:0}: Error finding container 73981a6e0045c9288aaf43a4e392d7899a8e3992ae41cae240db1ff9b69f0262: Status 404 returned error can't find the container with id 73981a6e0045c9288aaf43a4e392d7899a8e3992ae41cae240db1ff9b69f0262 Jun 14 14:59:14.568440 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:14.568409 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dkvj" event={"ID":"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47","Type":"ContainerStarted","Data":"f4cc3b1a7e7dd6da907669c8c85719c8c8307c107a0a8252b431936e94144ae5"} Jun 14 14:59:14.569464 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:14.569439 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8h9s" event={"ID":"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20","Type":"ContainerStarted","Data":"73981a6e0045c9288aaf43a4e392d7899a8e3992ae41cae240db1ff9b69f0262"} Jun 14 14:59:15.575729 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:15.575674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dkvj" event={"ID":"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47","Type":"ContainerStarted","Data":"49447eb0176928a39c3cec4425a9a49b79f648a6b59120da7fdc6b326a3f3d6b"} Jun 14 14:59:15.576149 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:15.575798 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dkvj" event={"ID":"4a8d3060-5a65-46a3-bf4d-7ba0c0cdfb47","Type":"ContainerStarted","Data":"102177c6d29a30a9bfef6b0ef757e4b1e5436e673d69727b16344058d45af9c7"} Jun 14 14:59:15.592514 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:15.592466 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2dkvj" podStartSLOduration=252.730944925 podStartE2EDuration="4m13.592448767s" totalImagesPullingTime="861.503842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:15.5909162 +0000 UTC m=+253.242109571" watchObservedRunningTime="2026-06-14 14:59:15.592448767 +0000 UTC m=+253.243642137" Jun 14 14:59:15.801583 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:15.801527 2572 scope.go:117] "RemoveContainer" containerID="6a73943e3ae77434c0fa73fa57d8d845fb38ce14dc4f76673f7d989a67bdb145" Jun 14 14:59:16.583171 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:16.583138 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 14:59:16.583576 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:16.583472 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" event={"ID":"52970f42-ef4e-4211-a90e-9180254d82b4","Type":"ContainerStarted","Data":"d3dbf9a7d6b9b3645291271d71b97287ff3fd93aa661f94ea1444bc3ad50016e"} Jun 14 14:59:16.583937 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:16.583862 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:59:16.588940 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:16.588916 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" Jun 14 14:59:16.599621 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:16.599545 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-8g46n" podStartSLOduration=20.900638955 podStartE2EDuration="22.599527635s" totalImagesPullingTime="1.69888868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:16.598994297 +0000 UTC m=+254.250187666" watchObservedRunningTime="2026-06-14 14:59:16.599527635 +0000 UTC m=+254.250721010" Jun 14 14:59:18.591363 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:18.591328 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8h9s" event={"ID":"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20","Type":"ContainerStarted","Data":"a6968b982229ae0031a1490d2d425a03876bc3f0d7273f27e847598ee0e5dee5"} Jun 14 14:59:19.597512 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:19.597421 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8h9s" event={"ID":"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20","Type":"ContainerStarted","Data":"585387da2085137cbac8215a8372bbe9796e6a04080ad1c55391e986e7790004"} Jun 14 14:59:20.603193 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.603156 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8h9s" event={"ID":"7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20","Type":"ContainerStarted","Data":"58634d95441f497621582065ea8a6513ddad18191d217e50004632c8509a82a6"} Jun 14 14:59:20.624933 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.624877 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q8h9s" podStartSLOduration=16.907908148 podStartE2EDuration="22.624861408s" totalImagesPullingTime="5.71695326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 14:58:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:20.623118697 +0000 UTC m=+258.274312079" watchObservedRunningTime="2026-06-14 14:59:20.624861408 +0000 UTC m=+258.276054777" Jun 14 14:59:20.646371 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.646297 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-6dpx8"] Jun 14 14:59:20.649529 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.649507 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-6dpx8" Jun 14 14:59:20.652225 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.652200 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sbgmw\"" Jun 14 14:59:20.652225 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.652219 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 14:59:20.653400 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.653381 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 14:59:20.666152 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.666116 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-6dpx8"] Jun 14 14:59:20.747050 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.747012 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdg8l\" (UniqueName: \"kubernetes.io/projected/2b6db696-87b4-406e-9754-204eee61f87f-kube-api-access-qdg8l\") pod \"downloads-694c955b9-6dpx8\" (UID: \"2b6db696-87b4-406e-9754-204eee61f87f\") " pod="openshift-console/downloads-694c955b9-6dpx8" Jun 14 14:59:20.848061 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.848020 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdg8l\" (UniqueName: \"kubernetes.io/projected/2b6db696-87b4-406e-9754-204eee61f87f-kube-api-access-qdg8l\") pod \"downloads-694c955b9-6dpx8\" (UID: \"2b6db696-87b4-406e-9754-204eee61f87f\") " pod="openshift-console/downloads-694c955b9-6dpx8" Jun 14 14:59:20.856684 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.856650 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdg8l\" (UniqueName: \"kubernetes.io/projected/2b6db696-87b4-406e-9754-204eee61f87f-kube-api-access-qdg8l\") pod \"downloads-694c955b9-6dpx8\" (UID: \"2b6db696-87b4-406e-9754-204eee61f87f\") " pod="openshift-console/downloads-694c955b9-6dpx8" Jun 14 14:59:20.958711 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:20.958627 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-6dpx8" Jun 14 14:59:21.089398 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:21.089359 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-6dpx8"] Jun 14 14:59:21.092902 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:21.092875 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6db696_87b4_406e_9754_204eee61f87f.slice/crio-f5bb27433b97e2d9030ad818ee5dd8a6b8996e0f706bc3f8755f0a7f67b4cbbf WatchSource:0}: Error finding container f5bb27433b97e2d9030ad818ee5dd8a6b8996e0f706bc3f8755f0a7f67b4cbbf: Status 404 returned error can't find the container with id f5bb27433b97e2d9030ad818ee5dd8a6b8996e0f706bc3f8755f0a7f67b4cbbf Jun 14 14:59:21.608049 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:21.608017 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-6dpx8" event={"ID":"2b6db696-87b4-406e-9754-204eee61f87f","Type":"ContainerStarted","Data":"f5bb27433b97e2d9030ad818ee5dd8a6b8996e0f706bc3f8755f0a7f67b4cbbf"} Jun 14 14:59:25.888606 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:25.888544 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:25.889213 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:25.889192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65558665-5b69-4003-b6d6-c90ced0698ab-service-ca-bundle\") pod \"router-default-56f859595b-bwxg8\" (UID: \"65558665-5b69-4003-b6d6-c90ced0698ab\") " pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:25.895893 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:25.895877 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vk6k7\"" Jun 14 14:59:25.903962 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:25.903940 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:26.051342 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:26.051308 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56f859595b-bwxg8"] Jun 14 14:59:26.054049 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:26.054020 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65558665_5b69_4003_b6d6_c90ced0698ab.slice/crio-1b080b886396ef1029f3f705289af1f20890fc71fff6629d36a2478d25a60aa0 WatchSource:0}: Error finding container 1b080b886396ef1029f3f705289af1f20890fc71fff6629d36a2478d25a60aa0: Status 404 returned error can't find the container with id 1b080b886396ef1029f3f705289af1f20890fc71fff6629d36a2478d25a60aa0 Jun 14 14:59:26.629084 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:26.629021 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56f859595b-bwxg8" event={"ID":"65558665-5b69-4003-b6d6-c90ced0698ab","Type":"ContainerStarted","Data":"f29e95e8af71a47eca8e625ce4803896ffdbccf2c9850b91d2ce769be33ff3f8"} Jun 14 14:59:26.629084 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:26.629087 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56f859595b-bwxg8" event={"ID":"65558665-5b69-4003-b6d6-c90ced0698ab","Type":"ContainerStarted","Data":"1b080b886396ef1029f3f705289af1f20890fc71fff6629d36a2478d25a60aa0"} Jun 14 14:59:26.648363 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:26.648298 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56f859595b-bwxg8" podStartSLOduration=32.64828234 podStartE2EDuration="32.64828234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:26.647676304 +0000 UTC m=+264.298869674" watchObservedRunningTime="2026-06-14 14:59:26.64828234 +0000 UTC m=+264.299475708" Jun 14 14:59:26.905136 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:26.905044 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:26.907961 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:26.907934 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:27.632666 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:27.632636 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:27.634099 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:27.634079 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56f859595b-bwxg8" Jun 14 14:59:28.498978 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:28.498943 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv"] Jun 14 14:59:28.502761 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:28.502738 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv" Jun 14 14:59:28.505096 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:28.505065 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 14 14:59:28.505202 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:28.505183 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2p2jk\"" Jun 14 14:59:28.509143 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:28.509113 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv"] Jun 14 14:59:28.610796 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:28.610763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2dfec55-ead9-4f57-854e-b71f7a3cb85b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-mv5zv\" (UID: \"f2dfec55-ead9-4f57-854e-b71f7a3cb85b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv" Jun 14 14:59:28.711887 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:28.711849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2dfec55-ead9-4f57-854e-b71f7a3cb85b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-mv5zv\" (UID: \"f2dfec55-ead9-4f57-854e-b71f7a3cb85b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv" Jun 14 14:59:28.712082 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:28.712001 2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 14 14:59:28.712082 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:28.712075 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2dfec55-ead9-4f57-854e-b71f7a3cb85b-tls-certificates podName:f2dfec55-ead9-4f57-854e-b71f7a3cb85b nodeName:}" failed. No retries permitted until 2026-06-14 14:59:29.212054276 +0000 UTC m=+266.863247644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f2dfec55-ead9-4f57-854e-b71f7a3cb85b-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-mv5zv" (UID: "f2dfec55-ead9-4f57-854e-b71f7a3cb85b") : secret "prometheus-operator-admission-webhook-tls" not found Jun 14 14:59:29.217017 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:29.216979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2dfec55-ead9-4f57-854e-b71f7a3cb85b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-mv5zv\" (UID: \"f2dfec55-ead9-4f57-854e-b71f7a3cb85b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv" Jun 14 14:59:29.220090 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:29.220063 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f2dfec55-ead9-4f57-854e-b71f7a3cb85b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-mv5zv\" (UID: \"f2dfec55-ead9-4f57-854e-b71f7a3cb85b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv" Jun 14 14:59:29.413953 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:29.413914 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv" Jun 14 14:59:29.560172 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:29.560134 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv"] Jun 14 14:59:29.563197 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:29.563168 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2dfec55_ead9_4f57_854e_b71f7a3cb85b.slice/crio-cc4a781f26812db9b0976068302059fb50824df19e4f70851a1479543f87cc83 WatchSource:0}: Error finding container cc4a781f26812db9b0976068302059fb50824df19e4f70851a1479543f87cc83: Status 404 returned error can't find the container with id cc4a781f26812db9b0976068302059fb50824df19e4f70851a1479543f87cc83 Jun 14 14:59:29.640082 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:29.640051 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv" event={"ID":"f2dfec55-ead9-4f57-854e-b71f7a3cb85b","Type":"ContainerStarted","Data":"cc4a781f26812db9b0976068302059fb50824df19e4f70851a1479543f87cc83"} Jun 14 14:59:31.357630 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.357588 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d6bd48945-jj695"] Jun 14 14:59:31.360370 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.360347 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.363128 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.363102 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 14:59:31.364113 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.364085 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jr9b7\"" Jun 14 14:59:31.364113 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.364098 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 14:59:31.364279 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.364118 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 14:59:31.364279 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.364130 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 14:59:31.364279 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.364097 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 14:59:31.372076 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.372053 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6bd48945-jj695"] Jun 14 14:59:31.537129 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.537092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-serving-cert\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.537336 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.537143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-oauth-config\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.537336 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.537197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-service-ca\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.537336 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.537233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq89j\" (UniqueName: \"kubernetes.io/projected/e133a63e-4d32-45e3-8c64-3e799b128187-kube-api-access-wq89j\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.537336 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.537313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-oauth-serving-cert\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.537587 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.537353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-console-config\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.638055 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.637980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq89j\" (UniqueName: \"kubernetes.io/projected/e133a63e-4d32-45e3-8c64-3e799b128187-kube-api-access-wq89j\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.638055 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.638032 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-oauth-serving-cert\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.638266 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.638122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-console-config\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.638266 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.638184 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-serving-cert\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.638266 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.638212 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-oauth-config\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.638413 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.638269 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-service-ca\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.638842 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.638811 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-oauth-serving-cert\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.639143 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.639117 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-service-ca\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.639284 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.639256 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-console-config\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.641015 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.640997 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-serving-cert\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.641144 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.641123 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-oauth-config\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.647212 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.647187 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq89j\" (UniqueName: \"kubernetes.io/projected/e133a63e-4d32-45e3-8c64-3e799b128187-kube-api-access-wq89j\") pod \"console-d6bd48945-jj695\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:31.649621 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.649591 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv" event={"ID":"f2dfec55-ead9-4f57-854e-b71f7a3cb85b","Type":"ContainerStarted","Data":"417366838b92fa2b4c4a3706ef0f34b77ca28a5010b02a119653538e6ecae13e"} Jun 14 14:59:31.649831 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.649811 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv" Jun 14 14:59:31.655416 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.655394 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv" Jun 14 14:59:31.664229 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.664191 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-mv5zv" podStartSLOduration=2.539657658 podStartE2EDuration="3.664175189s" totalImagesPullingTime="1.124517531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:31.663948855 +0000 UTC m=+269.315142226" watchObservedRunningTime="2026-06-14 14:59:31.664175189 +0000 UTC m=+269.315368557" Jun 14 14:59:31.671019 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:31.671000 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:32.559695 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.559659 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm"] Jun 14 14:59:32.562008 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.561984 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.565636 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.565613 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 14:59:32.565786 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.565709 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 14:59:32.565786 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.565729 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 14 14:59:32.565786 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.565738 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 14 14:59:32.565957 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.565868 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 14:59:32.565957 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.565876 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2h99t\"" Jun 14 14:59:32.571735 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.571713 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm"] Jun 14 14:59:32.745219 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.745181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2755e9c6-5e62-4af8-aa67-b7b941a8291d-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.745219 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.745225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nmx9\" (UniqueName: \"kubernetes.io/projected/2755e9c6-5e62-4af8-aa67-b7b941a8291d-kube-api-access-2nmx9\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.745479 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.745271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2755e9c6-5e62-4af8-aa67-b7b941a8291d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.745479 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.745380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2755e9c6-5e62-4af8-aa67-b7b941a8291d-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.845878 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.845789 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2755e9c6-5e62-4af8-aa67-b7b941a8291d-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.845878 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.845840 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nmx9\" (UniqueName: \"kubernetes.io/projected/2755e9c6-5e62-4af8-aa67-b7b941a8291d-kube-api-access-2nmx9\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.846093 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.845885 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2755e9c6-5e62-4af8-aa67-b7b941a8291d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.846093 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.845925 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2755e9c6-5e62-4af8-aa67-b7b941a8291d-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.846813 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.846710 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2755e9c6-5e62-4af8-aa67-b7b941a8291d-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.848891 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.848866 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2755e9c6-5e62-4af8-aa67-b7b941a8291d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.849006 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.848947 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2755e9c6-5e62-4af8-aa67-b7b941a8291d-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.854422 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.854383 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nmx9\" (UniqueName: \"kubernetes.io/projected/2755e9c6-5e62-4af8-aa67-b7b941a8291d-kube-api-access-2nmx9\") pod \"prometheus-operator-864fcfc6f9-d2tfm\" (UID: \"2755e9c6-5e62-4af8-aa67-b7b941a8291d\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:32.873929 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:32.873893 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" Jun 14 14:59:37.979396 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:37.979366 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm"] Jun 14 14:59:37.991590 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:37.991544 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2755e9c6_5e62_4af8_aa67_b7b941a8291d.slice/crio-15d04ac041bfaed1262724d98ce19428554924c9496d745a47afe4e0a8b9eb36 WatchSource:0}: Error finding container 15d04ac041bfaed1262724d98ce19428554924c9496d745a47afe4e0a8b9eb36: Status 404 returned error can't find the container with id 15d04ac041bfaed1262724d98ce19428554924c9496d745a47afe4e0a8b9eb36 Jun 14 14:59:37.997177 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:37.997152 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6bd48945-jj695"] Jun 14 14:59:38.000330 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:38.000303 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode133a63e_4d32_45e3_8c64_3e799b128187.slice/crio-b9bd2323fc850a8386c2681a701d8e7124b087b2cd451af3123fc018425fba5c WatchSource:0}: Error finding container b9bd2323fc850a8386c2681a701d8e7124b087b2cd451af3123fc018425fba5c: Status 404 returned error can't find the container with id b9bd2323fc850a8386c2681a701d8e7124b087b2cd451af3123fc018425fba5c Jun 14 14:59:38.681528 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:38.681473 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-6dpx8" event={"ID":"2b6db696-87b4-406e-9754-204eee61f87f","Type":"ContainerStarted","Data":"ee3ded5881a670de509db9db9fe582e7b5ec448be6e3ef395a198bbbf516cc8d"} Jun 14 14:59:38.682516 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:38.682459 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-6dpx8" Jun 14 14:59:38.685246 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:38.685120 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" event={"ID":"2755e9c6-5e62-4af8-aa67-b7b941a8291d","Type":"ContainerStarted","Data":"15d04ac041bfaed1262724d98ce19428554924c9496d745a47afe4e0a8b9eb36"} Jun 14 14:59:38.686877 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:38.686821 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6bd48945-jj695" event={"ID":"e133a63e-4d32-45e3-8c64-3e799b128187","Type":"ContainerStarted","Data":"b9bd2323fc850a8386c2681a701d8e7124b087b2cd451af3123fc018425fba5c"} Jun 14 14:59:38.693670 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:38.693649 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-6dpx8" Jun 14 14:59:38.700259 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:38.698912 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-6dpx8" podStartSLOduration=1.8426058589999998 podStartE2EDuration="18.698896595s" totalImagesPullingTime="16.856290736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:38.697517588 +0000 UTC m=+276.348710958" watchObservedRunningTime="2026-06-14 14:59:38.698896595 +0000 UTC m=+276.350089963" Jun 14 14:59:42.707266 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:42.707215 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6bd48945-jj695" event={"ID":"e133a63e-4d32-45e3-8c64-3e799b128187","Type":"ContainerStarted","Data":"7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222"} Jun 14 14:59:42.709619 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:42.709585 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" event={"ID":"2755e9c6-5e62-4af8-aa67-b7b941a8291d","Type":"ContainerStarted","Data":"86a1332cc68d585e751846b00e8425ca03844d618438e1a41b911fc2fa2af481"} Jun 14 14:59:42.709745 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:42.709639 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" event={"ID":"2755e9c6-5e62-4af8-aa67-b7b941a8291d","Type":"ContainerStarted","Data":"a63152fb5bd9197908bb084882bde2a7c543bc68712534f0bd7f71dfd1630bdb"} Jun 14 14:59:42.727623 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:42.727549 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d6bd48945-jj695" podStartSLOduration=7.850210599 podStartE2EDuration="11.727529518s" totalImagesPullingTime="3.877318919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:42.726041369 +0000 UTC m=+280.377234738" watchObservedRunningTime="2026-06-14 14:59:42.727529518 +0000 UTC m=+280.378722888" Jun 14 14:59:42.741989 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:42.741937 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-d2tfm" podStartSLOduration=7.1240497 podStartE2EDuration="10.741898037s" totalImagesPullingTime="3.617848337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:42.740979424 +0000 UTC m=+280.392172807" watchObservedRunningTime="2026-06-14 14:59:42.741898037 +0000 UTC m=+280.393091407" Jun 14 14:59:43.318606 ip-10-0-133-52 kubenswrapper[2572]: E0614 14:59:43.318538 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s8tjb" podUID="20409142-101a-45b7-81e9-70f3a62939ab" Jun 14 14:59:43.713608 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:43.713509 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s8tjb" Jun 14 14:59:44.921873 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:44.921844 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bcnx9"] Jun 14 14:59:44.998183 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:44.998150 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.001154 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.001120 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m7rxh\"" Jun 14 14:59:45.001442 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.001418 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 14:59:45.001753 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.001729 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 14:59:45.001848 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.001729 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 14:59:45.047707 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.047672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-wtmp\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.047879 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.047720 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/042ecb39-d8a7-431e-b301-5dd5896712ba-sys\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.047879 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.047753 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-textfile\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.047879 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.047808 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-626l9\" (UniqueName: \"kubernetes.io/projected/042ecb39-d8a7-431e-b301-5dd5896712ba-kube-api-access-626l9\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.047879 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.047843 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-tls\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.047879 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.047874 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.048105 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.047944 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/042ecb39-d8a7-431e-b301-5dd5896712ba-metrics-client-ca\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.048105 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.047993 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/042ecb39-d8a7-431e-b301-5dd5896712ba-root\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.048105 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.048050 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.148766 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.148736 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-626l9\" (UniqueName: \"kubernetes.io/projected/042ecb39-d8a7-431e-b301-5dd5896712ba-kube-api-access-626l9\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.148938 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.148777 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-tls\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.148938 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.148803 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.148938 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.148882 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/042ecb39-d8a7-431e-b301-5dd5896712ba-metrics-client-ca\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.148938 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.148923 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/042ecb39-d8a7-431e-b301-5dd5896712ba-root\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.149170 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.148979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.149170 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.149031 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-wtmp\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.149170 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.149043 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/042ecb39-d8a7-431e-b301-5dd5896712ba-root\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.149339 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.149189 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-wtmp\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.149339 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.149228 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/042ecb39-d8a7-431e-b301-5dd5896712ba-sys\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.149339 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.149283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-textfile\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.149339 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.149318 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/042ecb39-d8a7-431e-b301-5dd5896712ba-sys\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.149687 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.149606 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-textfile\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.149687 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.149656 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.150126 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.150098 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/042ecb39-d8a7-431e-b301-5dd5896712ba-metrics-client-ca\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.152035 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.152008 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.152141 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.152077 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/042ecb39-d8a7-431e-b301-5dd5896712ba-node-exporter-tls\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.157679 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.157654 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-626l9\" (UniqueName: \"kubernetes.io/projected/042ecb39-d8a7-431e-b301-5dd5896712ba-kube-api-access-626l9\") pod \"node-exporter-bcnx9\" (UID: \"042ecb39-d8a7-431e-b301-5dd5896712ba\") " pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.309507 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.309477 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bcnx9" Jun 14 14:59:45.355737 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:45.355707 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042ecb39_d8a7_431e_b301_5dd5896712ba.slice/crio-1013ecb652ca90e681f5bb00e183c9b9c91bd73426b86311c2e64d1da297e450 WatchSource:0}: Error finding container 1013ecb652ca90e681f5bb00e183c9b9c91bd73426b86311c2e64d1da297e450: Status 404 returned error can't find the container with id 1013ecb652ca90e681f5bb00e183c9b9c91bd73426b86311c2e64d1da297e450 Jun 14 14:59:45.721915 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:45.721843 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcnx9" event={"ID":"042ecb39-d8a7-431e-b301-5dd5896712ba","Type":"ContainerStarted","Data":"1013ecb652ca90e681f5bb00e183c9b9c91bd73426b86311c2e64d1da297e450"} Jun 14 14:59:46.664513 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:46.664466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:59:46.667373 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:46.667347 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20409142-101a-45b7-81e9-70f3a62939ab-metrics-tls\") pod \"dns-default-s8tjb\" (UID: \"20409142-101a-45b7-81e9-70f3a62939ab\") " pod="openshift-dns/dns-default-s8tjb" Jun 14 14:59:46.717002 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:46.716969 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4p4qh\"" Jun 14 14:59:46.724647 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:46.724545 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s8tjb" Jun 14 14:59:47.070169 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.070141 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s8tjb"] Jun 14 14:59:47.073326 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:47.073294 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20409142_101a_45b7_81e9_70f3a62939ab.slice/crio-8f320ad681b701a2273fc1fe2d867f500c18ff92abe1d19dcb37e15af2e9a037 WatchSource:0}: Error finding container 8f320ad681b701a2273fc1fe2d867f500c18ff92abe1d19dcb37e15af2e9a037: Status 404 returned error can't find the container with id 8f320ad681b701a2273fc1fe2d867f500c18ff92abe1d19dcb37e15af2e9a037 Jun 14 14:59:47.730891 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.730848 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s8tjb" event={"ID":"20409142-101a-45b7-81e9-70f3a62939ab","Type":"ContainerStarted","Data":"8f320ad681b701a2273fc1fe2d867f500c18ff92abe1d19dcb37e15af2e9a037"} Jun 14 14:59:47.732807 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.732758 2572 generic.go:356] "Generic (PLEG): container finished" podID="042ecb39-d8a7-431e-b301-5dd5896712ba" containerID="1d4c1bf50cc98767de0353c488c8b7dae18f8995ee5514af723bbf072c296dbb" exitCode=0 Jun 14 14:59:47.732947 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.732820 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcnx9" event={"ID":"042ecb39-d8a7-431e-b301-5dd5896712ba","Type":"ContainerDied","Data":"1d4c1bf50cc98767de0353c488c8b7dae18f8995ee5514af723bbf072c296dbb"} Jun 14 14:59:47.883664 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.883635 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6984986fd6-spxg7"] Jun 14 14:59:47.900794 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.900769 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6984986fd6-spxg7"] Jun 14 14:59:47.900909 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.900884 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:47.903553 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.903290 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dczrw\"" Jun 14 14:59:47.903553 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.903463 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 14 14:59:47.903732 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.903713 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2r98m7jomocqk\"" Jun 14 14:59:47.903849 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.903732 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 14 14:59:47.903907 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.903898 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 14 14:59:47.903960 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.903910 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 14 14:59:47.904158 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.904138 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 14 14:59:47.973558 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.973498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:47.973727 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.973676 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrrs5\" (UniqueName: \"kubernetes.io/projected/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-kube-api-access-qrrs5\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:47.973804 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.973741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-grpc-tls\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:47.973804 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.973779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-metrics-client-ca\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:47.973924 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.973802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-tls\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:47.973924 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.973838 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:47.973924 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.973908 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:47.974035 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:47.973938 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.075104 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.075065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.075272 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.075138 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.075272 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.075177 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.075272 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.075232 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.075272 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.075265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrrs5\" (UniqueName: \"kubernetes.io/projected/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-kube-api-access-qrrs5\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.075479 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.075290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-grpc-tls\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.075479 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.075333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-metrics-client-ca\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.075479 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.075362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-tls\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.076794 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.076763 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-metrics-client-ca\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.078652 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.078624 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.078652 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.078639 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-tls\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.079173 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.079144 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.079533 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.079501 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.079642 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.079509 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-grpc-tls\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.080239 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.080215 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.083340 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.083301 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrrs5\" (UniqueName: \"kubernetes.io/projected/3dd8732b-bb2c-4bb1-99df-a39fcc84cd72-kube-api-access-qrrs5\") pod \"thanos-querier-6984986fd6-spxg7\" (UID: \"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72\") " pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.233393 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.233323 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:48.738953 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.738912 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcnx9" event={"ID":"042ecb39-d8a7-431e-b301-5dd5896712ba","Type":"ContainerStarted","Data":"0b56c853f820dd53c44fa96b1856216bc7b629cb8413590bd1afec9598a11193"} Jun 14 14:59:48.739427 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.738970 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcnx9" event={"ID":"042ecb39-d8a7-431e-b301-5dd5896712ba","Type":"ContainerStarted","Data":"4ad09659f0d0a5288ae33431d9848f588b5698cf27f66900703211fc52ec19a9"} Jun 14 14:59:48.761513 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.761441 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bcnx9" podStartSLOduration=3.089452602 podStartE2EDuration="4.76142217s" totalImagesPullingTime="1.558607468s" totalInitContainerRuntime="113.3621ms" isStatefulPod=true podCreationTimestamp="2026-06-14 14:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:48.759676573 +0000 UTC m=+286.410869942" watchObservedRunningTime="2026-06-14 14:59:48.76142217 +0000 UTC m=+286.412615539" Jun 14 14:59:48.837028 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:48.836991 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6984986fd6-spxg7"] Jun 14 14:59:48.839770 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:48.839742 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd8732b_bb2c_4bb1_99df_a39fcc84cd72.slice/crio-cb9d2fb5a5bd700050f22b42eff3473d48e69af37010f0525c519598847df04f WatchSource:0}: Error finding container cb9d2fb5a5bd700050f22b42eff3473d48e69af37010f0525c519598847df04f: Status 404 returned error can't find the container with id cb9d2fb5a5bd700050f22b42eff3473d48e69af37010f0525c519598847df04f Jun 14 14:59:49.703791 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.703755 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-8djcf"] Jun 14 14:59:49.722844 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.722800 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-8djcf"] Jun 14 14:59:49.723094 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.722919 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" Jun 14 14:59:49.725324 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.725297 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d6bd48945-jj695"] Jun 14 14:59:49.725858 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.725839 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 14 14:59:49.726010 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.725864 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-457xm\"" Jun 14 14:59:49.749197 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.749141 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s8tjb" event={"ID":"20409142-101a-45b7-81e9-70f3a62939ab","Type":"ContainerStarted","Data":"1958497dafeee768c776f145d5aa68687c5519334986d4d9af0625b458a6b99a"} Jun 14 14:59:49.749197 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.749197 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s8tjb" Jun 14 14:59:49.749610 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.749218 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s8tjb" event={"ID":"20409142-101a-45b7-81e9-70f3a62939ab","Type":"ContainerStarted","Data":"8dbe69153d770e60a20709a72867dcae1da96312294000533e6eb45e7ab17be1"} Jun 14 14:59:49.750739 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.750713 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" event={"ID":"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72","Type":"ContainerStarted","Data":"cb9d2fb5a5bd700050f22b42eff3473d48e69af37010f0525c519598847df04f"} Jun 14 14:59:49.783796 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.783742 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s8tjb" podStartSLOduration=251.863917527 podStartE2EDuration="4m13.78372358s" totalImagesPullingTime="1.919806053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:49.782540813 +0000 UTC m=+287.433734182" watchObservedRunningTime="2026-06-14 14:59:49.78372358 +0000 UTC m=+287.434916949" Jun 14 14:59:49.788932 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.788895 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2aa6e792-a2c2-4542-8444-f1bc11207de7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-8djcf\" (UID: \"2aa6e792-a2c2-4542-8444-f1bc11207de7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" Jun 14 14:59:49.789821 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.789795 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxkj9\" (UniqueName: \"kubernetes.io/projected/2aa6e792-a2c2-4542-8444-f1bc11207de7-kube-api-access-kxkj9\") pod \"monitoring-plugin-589576dfc7-8djcf\" (UID: \"2aa6e792-a2c2-4542-8444-f1bc11207de7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" Jun 14 14:59:49.891154 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.891121 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2aa6e792-a2c2-4542-8444-f1bc11207de7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-8djcf\" (UID: \"2aa6e792-a2c2-4542-8444-f1bc11207de7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" Jun 14 14:59:49.891350 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.891215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxkj9\" (UniqueName: \"kubernetes.io/projected/2aa6e792-a2c2-4542-8444-f1bc11207de7-kube-api-access-kxkj9\") pod \"monitoring-plugin-589576dfc7-8djcf\" (UID: \"2aa6e792-a2c2-4542-8444-f1bc11207de7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" Jun 14 14:59:49.894158 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.894133 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2aa6e792-a2c2-4542-8444-f1bc11207de7-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-8djcf\" (UID: \"2aa6e792-a2c2-4542-8444-f1bc11207de7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" Jun 14 14:59:49.901860 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:49.901829 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxkj9\" (UniqueName: \"kubernetes.io/projected/2aa6e792-a2c2-4542-8444-f1bc11207de7-kube-api-access-kxkj9\") pod \"monitoring-plugin-589576dfc7-8djcf\" (UID: \"2aa6e792-a2c2-4542-8444-f1bc11207de7\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" Jun 14 14:59:50.036852 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.036766 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" Jun 14 14:59:50.128227 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.128186 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8556b87877-9xbm6"] Jun 14 14:59:50.147708 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.147339 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8556b87877-9xbm6"] Jun 14 14:59:50.147708 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.147448 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.150602 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.150407 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 14 14:59:50.150602 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.150435 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 14 14:59:50.150602 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.150478 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 14 14:59:50.150602 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.150583 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 14 14:59:50.150881 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.150719 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 14 14:59:50.150881 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.150792 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-26d5n\"" Jun 14 14:59:50.157128 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.156944 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 14 14:59:50.191375 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.191337 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-8djcf"] Jun 14 14:59:50.193444 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.193419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-telemeter-client-tls\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.193593 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.193460 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.193593 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.193482 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7164ded-d87b-4067-8e2c-3827e66f579c-metrics-client-ca\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.193748 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.193553 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-secret-telemeter-client\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.193809 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.193775 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7164ded-d87b-4067-8e2c-3827e66f579c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.193862 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.193806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-federate-client-tls\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.193910 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.193871 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7164ded-d87b-4067-8e2c-3827e66f579c-serving-certs-ca-bundle\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.193910 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.193899 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkqgr\" (UniqueName: \"kubernetes.io/projected/f7164ded-d87b-4067-8e2c-3827e66f579c-kube-api-access-zkqgr\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.294825 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.294751 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7164ded-d87b-4067-8e2c-3827e66f579c-serving-certs-ca-bundle\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.294825 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.294805 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkqgr\" (UniqueName: \"kubernetes.io/projected/f7164ded-d87b-4067-8e2c-3827e66f579c-kube-api-access-zkqgr\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.295056 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.294842 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-telemeter-client-tls\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.295056 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.294865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.295056 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.294892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7164ded-d87b-4067-8e2c-3827e66f579c-metrics-client-ca\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.295215 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.295090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-secret-telemeter-client\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.295215 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.295137 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7164ded-d87b-4067-8e2c-3827e66f579c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.295215 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.295169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-federate-client-tls\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.295749 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.295715 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7164ded-d87b-4067-8e2c-3827e66f579c-serving-certs-ca-bundle\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.295871 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.295813 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7164ded-d87b-4067-8e2c-3827e66f579c-metrics-client-ca\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.296145 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.296118 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7164ded-d87b-4067-8e2c-3827e66f579c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.298198 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.298172 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.298308 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.298264 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-telemeter-client-tls\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.298468 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.298447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-federate-client-tls\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.298642 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.298623 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7164ded-d87b-4067-8e2c-3827e66f579c-secret-telemeter-client\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.303507 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.303484 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkqgr\" (UniqueName: \"kubernetes.io/projected/f7164ded-d87b-4067-8e2c-3827e66f579c-kube-api-access-zkqgr\") pod \"telemeter-client-8556b87877-9xbm6\" (UID: \"f7164ded-d87b-4067-8e2c-3827e66f579c\") " pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.462229 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.462189 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" Jun 14 14:59:50.681418 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:50.681371 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa6e792_a2c2_4542_8444_f1bc11207de7.slice/crio-b77a281d84b36801f96893c38f4417f724634a2bff462a559b7a8e043dae20df WatchSource:0}: Error finding container b77a281d84b36801f96893c38f4417f724634a2bff462a559b7a8e043dae20df: Status 404 returned error can't find the container with id b77a281d84b36801f96893c38f4417f724634a2bff462a559b7a8e043dae20df Jun 14 14:59:50.756460 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.756420 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" event={"ID":"2aa6e792-a2c2-4542-8444-f1bc11207de7","Type":"ContainerStarted","Data":"b77a281d84b36801f96893c38f4417f724634a2bff462a559b7a8e043dae20df"} Jun 14 14:59:50.819501 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:50.819474 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8556b87877-9xbm6"] Jun 14 14:59:50.821651 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:50.821623 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7164ded_d87b_4067_8e2c_3827e66f579c.slice/crio-916db05264bb1d096e2fef545b915905e10cd767fbf8232fd28513032acc1ba9 WatchSource:0}: Error finding container 916db05264bb1d096e2fef545b915905e10cd767fbf8232fd28513032acc1ba9: Status 404 returned error can't find the container with id 916db05264bb1d096e2fef545b915905e10cd767fbf8232fd28513032acc1ba9 Jun 14 14:59:51.671588 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:51.671535 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d6bd48945-jj695" Jun 14 14:59:51.763113 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:51.763075 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" event={"ID":"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72","Type":"ContainerStarted","Data":"ce5a7eb2fbe8a81cea45dd70c60c2c3f836cc95fe2d7a6e145d3236fdc03bbd1"} Jun 14 14:59:51.763604 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:51.763160 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" event={"ID":"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72","Type":"ContainerStarted","Data":"4d58125910c6ba8ef43041d0eb5a642c9be96a44798adea28a5574417806c9b3"} Jun 14 14:59:51.763604 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:51.763205 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" event={"ID":"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72","Type":"ContainerStarted","Data":"820cecc521008e73ccd67a970b8ac10f5e9dd490f1584fcbfdab482194214226"} Jun 14 14:59:51.764366 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:51.764329 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" event={"ID":"f7164ded-d87b-4067-8e2c-3827e66f579c","Type":"ContainerStarted","Data":"916db05264bb1d096e2fef545b915905e10cd767fbf8232fd28513032acc1ba9"} Jun 14 14:59:54.780911 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:54.780871 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" event={"ID":"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72","Type":"ContainerStarted","Data":"c166fa0b503747f0836a4824c45d2585175514374bf24ec2b95d901189628b12"} Jun 14 14:59:54.781414 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:54.780956 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" event={"ID":"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72","Type":"ContainerStarted","Data":"c4577b2f10aa2bd5e96d62c0ed8ac4bd7dc7f49a4c2843db5c864a6e04e85f05"} Jun 14 14:59:54.781414 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:54.780996 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" event={"ID":"3dd8732b-bb2c-4bb1-99df-a39fcc84cd72","Type":"ContainerStarted","Data":"4f36e177d94d9339158ccec85e6b21f6f7d92171e91dba3e15a8715421fe499d"} Jun 14 14:59:54.781414 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:54.781049 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 14:59:54.782708 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:54.782683 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" event={"ID":"2aa6e792-a2c2-4542-8444-f1bc11207de7","Type":"ContainerStarted","Data":"a29e113198cd531db83306d58b5a1f27b375116d170ef584813fcccd20a82682"} Jun 14 14:59:54.782818 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:54.782789 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" Jun 14 14:59:54.784406 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:54.784379 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" event={"ID":"f7164ded-d87b-4067-8e2c-3827e66f579c","Type":"ContainerStarted","Data":"786fc7c018b6db1106ff880eb427d8c355332fa19f007b3a8d48618359c62722"} Jun 14 14:59:54.788927 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:54.788905 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" Jun 14 14:59:54.804364 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:54.804313 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" podStartSLOduration=3.354160441 podStartE2EDuration="7.804299313s" totalImagesPullingTime="4.450138872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:54.80186048 +0000 UTC m=+292.453053843" watchObservedRunningTime="2026-06-14 14:59:54.804299313 +0000 UTC m=+292.455492682" Jun 14 14:59:54.816353 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:54.816307 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-8djcf" podStartSLOduration=2.842801314 podStartE2EDuration="5.816288787s" totalImagesPullingTime="2.973487473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:54.815843549 +0000 UTC m=+292.467036918" watchObservedRunningTime="2026-06-14 14:59:54.816288787 +0000 UTC m=+292.467482157" Jun 14 14:59:55.790491 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:55.790443 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" event={"ID":"f7164ded-d87b-4067-8e2c-3827e66f579c","Type":"ContainerStarted","Data":"9c57bfb4c10213fc8f2c91a51c160e2e06ab344fe61be397ef47d31432cec036"} Jun 14 14:59:55.790904 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:55.790552 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" event={"ID":"f7164ded-d87b-4067-8e2c-3827e66f579c","Type":"ContainerStarted","Data":"0a9cbea4bc4fcaa44f3abc41b50ad5f5671dfdeaa9974a96bc2767e28868fdfa"} Jun 14 14:59:55.815135 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:55.815072 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8556b87877-9xbm6" podStartSLOduration=1.502390202 podStartE2EDuration="5.815052672s" totalImagesPullingTime="4.31266247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:55.814282052 +0000 UTC m=+293.465475421" watchObservedRunningTime="2026-06-14 14:59:55.815052672 +0000 UTC m=+293.466246042" Jun 14 14:59:56.531627 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.531578 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb7654776-pf6rv"] Jun 14 14:59:56.555575 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.555526 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.556861 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.556828 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb7654776-pf6rv"] Jun 14 14:59:56.564582 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.564542 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 14:59:56.657347 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.657311 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-serving-cert\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.657535 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.657353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c9xf\" (UniqueName: \"kubernetes.io/projected/3eb38438-2d41-4818-b107-7a1284560f50-kube-api-access-9c9xf\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.657535 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.657399 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-console-config\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.657535 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.657422 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-service-ca\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.657535 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.657445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-oauth-serving-cert\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.657535 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.657471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-oauth-config\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.657535 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.657521 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-trusted-ca-bundle\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.758134 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.758097 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-trusted-ca-bundle\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.758282 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.758150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-serving-cert\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.758282 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.758180 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c9xf\" (UniqueName: \"kubernetes.io/projected/3eb38438-2d41-4818-b107-7a1284560f50-kube-api-access-9c9xf\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.758282 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.758222 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-console-config\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.758282 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.758249 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-service-ca\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.758464 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.758284 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-oauth-serving-cert\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.758464 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.758417 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-oauth-config\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.759102 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.759078 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-service-ca\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.759240 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.759119 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-oauth-serving-cert\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.759301 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.759119 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-trusted-ca-bundle\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.759301 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.759165 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-console-config\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.760854 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.760828 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-serving-cert\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.760943 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.760830 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-oauth-config\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.766005 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.765985 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c9xf\" (UniqueName: \"kubernetes.io/projected/3eb38438-2d41-4818-b107-7a1284560f50-kube-api-access-9c9xf\") pod \"console-5cb7654776-pf6rv\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:56.866628 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:56.866600 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 14:59:57.023966 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:57.023941 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb7654776-pf6rv"] Jun 14 14:59:57.026538 ip-10-0-133-52 kubenswrapper[2572]: W0614 14:59:57.026509 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb38438_2d41_4818_b107_7a1284560f50.slice/crio-7b2d930679be6ad8c9ab6f0292d93d38145292a48e02b8161f5f0093d32a978f WatchSource:0}: Error finding container 7b2d930679be6ad8c9ab6f0292d93d38145292a48e02b8161f5f0093d32a978f: Status 404 returned error can't find the container with id 7b2d930679be6ad8c9ab6f0292d93d38145292a48e02b8161f5f0093d32a978f Jun 14 14:59:57.800418 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:57.800385 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb7654776-pf6rv" event={"ID":"3eb38438-2d41-4818-b107-7a1284560f50","Type":"ContainerStarted","Data":"68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c"} Jun 14 14:59:57.800596 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:57.800433 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb7654776-pf6rv" event={"ID":"3eb38438-2d41-4818-b107-7a1284560f50","Type":"ContainerStarted","Data":"7b2d930679be6ad8c9ab6f0292d93d38145292a48e02b8161f5f0093d32a978f"} Jun 14 14:59:57.817479 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:57.817429 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb7654776-pf6rv" podStartSLOduration=1.817413127 podStartE2EDuration="1.817413127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 14:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 14:59:57.816168878 +0000 UTC m=+295.467362258" watchObservedRunningTime="2026-06-14 14:59:57.817413127 +0000 UTC m=+295.468606495" Jun 14 14:59:59.759209 ip-10-0-133-52 kubenswrapper[2572]: I0614 14:59:59.759179 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s8tjb" Jun 14 15:00:00.795830 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:00.795804 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6984986fd6-spxg7" Jun 14 15:00:02.763025 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:02.762989 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:00:02.763412 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:02.763036 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:00:02.773322 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:02.773291 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:00:02.774083 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:02.774062 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:00:02.778291 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:02.778274 2572 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 15:00:06.867661 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:06.867627 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 15:00:06.870111 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:06.867676 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 15:00:06.872458 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:06.872440 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 15:00:07.843157 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:07.843126 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 15:00:14.753533 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:14.753483 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d6bd48945-jj695" podUID="e133a63e-4d32-45e3-8c64-3e799b128187" containerName="console" containerID="cri-o://7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222" gracePeriod=15 Jun 14 15:00:15.033299 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.033269 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6bd48945-jj695" Jun 14 15:00:15.118668 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.118638 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-oauth-config\") pod \"e133a63e-4d32-45e3-8c64-3e799b128187\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " Jun 14 15:00:15.118668 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.118671 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-serving-cert\") pod \"e133a63e-4d32-45e3-8c64-3e799b128187\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " Jun 14 15:00:15.118880 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.118709 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-oauth-serving-cert\") pod \"e133a63e-4d32-45e3-8c64-3e799b128187\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " Jun 14 15:00:15.118880 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.118752 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq89j\" (UniqueName: \"kubernetes.io/projected/e133a63e-4d32-45e3-8c64-3e799b128187-kube-api-access-wq89j\") pod \"e133a63e-4d32-45e3-8c64-3e799b128187\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " Jun 14 15:00:15.118880 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.118767 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-console-config\") pod \"e133a63e-4d32-45e3-8c64-3e799b128187\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " Jun 14 15:00:15.118880 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.118804 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-service-ca\") pod \"e133a63e-4d32-45e3-8c64-3e799b128187\" (UID: \"e133a63e-4d32-45e3-8c64-3e799b128187\") " Jun 14 15:00:15.119210 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.119179 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-console-config" (OuterVolumeSpecName: "console-config") pod "e133a63e-4d32-45e3-8c64-3e799b128187" (UID: "e133a63e-4d32-45e3-8c64-3e799b128187"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:15.119210 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.119192 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e133a63e-4d32-45e3-8c64-3e799b128187" (UID: "e133a63e-4d32-45e3-8c64-3e799b128187"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:15.119361 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.119265 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-service-ca" (OuterVolumeSpecName: "service-ca") pod "e133a63e-4d32-45e3-8c64-3e799b128187" (UID: "e133a63e-4d32-45e3-8c64-3e799b128187"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:00:15.121204 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.121181 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e133a63e-4d32-45e3-8c64-3e799b128187-kube-api-access-wq89j" (OuterVolumeSpecName: "kube-api-access-wq89j") pod "e133a63e-4d32-45e3-8c64-3e799b128187" (UID: "e133a63e-4d32-45e3-8c64-3e799b128187"). InnerVolumeSpecName "kube-api-access-wq89j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:00:15.121407 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.121391 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e133a63e-4d32-45e3-8c64-3e799b128187" (UID: "e133a63e-4d32-45e3-8c64-3e799b128187"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:00:15.121479 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.121444 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e133a63e-4d32-45e3-8c64-3e799b128187" (UID: "e133a63e-4d32-45e3-8c64-3e799b128187"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:00:15.220328 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.220295 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq89j\" (UniqueName: \"kubernetes.io/projected/e133a63e-4d32-45e3-8c64-3e799b128187-kube-api-access-wq89j\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:00:15.220440 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.220330 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-console-config\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:00:15.220440 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.220345 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-service-ca\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:00:15.220440 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.220357 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-oauth-config\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:00:15.220440 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.220370 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e133a63e-4d32-45e3-8c64-3e799b128187-console-serving-cert\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:00:15.220440 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.220383 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e133a63e-4d32-45e3-8c64-3e799b128187-oauth-serving-cert\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:00:15.871970 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.871934 2572 generic.go:356] "Generic (PLEG): container finished" podID="e133a63e-4d32-45e3-8c64-3e799b128187" containerID="7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222" exitCode=0 Jun 14 15:00:15.872380 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.871977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6bd48945-jj695" event={"ID":"e133a63e-4d32-45e3-8c64-3e799b128187","Type":"ContainerDied","Data":"7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222"} Jun 14 15:00:15.872380 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.872018 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6bd48945-jj695" event={"ID":"e133a63e-4d32-45e3-8c64-3e799b128187","Type":"ContainerDied","Data":"b9bd2323fc850a8386c2681a701d8e7124b087b2cd451af3123fc018425fba5c"} Jun 14 15:00:15.872380 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.872039 2572 scope.go:117] "RemoveContainer" containerID="7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222" Jun 14 15:00:15.872380 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.871977 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6bd48945-jj695" Jun 14 15:00:15.881506 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.881488 2572 scope.go:117] "RemoveContainer" containerID="7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222" Jun 14 15:00:15.881803 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:00:15.881782 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222\": container with ID starting with 7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222 not found: ID does not exist" containerID="7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222" Jun 14 15:00:15.881879 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.881813 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222"} err="failed to get container status \"7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222\": rpc error: code = NotFound desc = could not find container \"7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222\": container with ID starting with 7b85c1a298ad70b0a5b3a19020d133ff06d2e0c364ca32549cd7ab5ac63d3222 not found: ID does not exist" Jun 14 15:00:15.892747 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.892724 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d6bd48945-jj695"] Jun 14 15:00:15.896199 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:15.896173 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d6bd48945-jj695"] Jun 14 15:00:16.805815 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:16.805782 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e133a63e-4d32-45e3-8c64-3e799b128187" path="/var/lib/kubelet/pods/e133a63e-4d32-45e3-8c64-3e799b128187/volumes" Jun 14 15:00:29.118731 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:00:29.118698 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mlskw_56ea1beb-5880-4c72-bfb2-b57784851c0f/node-ca/0.log" Jun 14 15:01:06.980302 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.980267 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:01:06.980712 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.980574 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e133a63e-4d32-45e3-8c64-3e799b128187" containerName="console" Jun 14 15:01:06.980712 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.980586 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e133a63e-4d32-45e3-8c64-3e799b128187" containerName="console" Jun 14 15:01:06.980712 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.980651 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e133a63e-4d32-45e3-8c64-3e799b128187" containerName="console" Jun 14 15:01:06.984451 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.984433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:06.988097 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.988072 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 15:01:06.988226 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.988072 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 15:01:06.988226 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.988204 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 15:01:06.988226 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.988208 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 15:01:06.988465 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.988449 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 15:01:06.988537 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.988508 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 15:01:06.988753 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.988737 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 15:01:06.988846 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.988830 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 15:01:06.989320 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.989304 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nrlk5\"" Jun 14 15:01:06.993528 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.993509 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 15:01:06.999398 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:06.999377 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:01:07.131722 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.131680 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49kfg\" (UniqueName: \"kubernetes.io/projected/69548512-e6a7-403e-b062-cf5867b6cbf0-kube-api-access-49kfg\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.131885 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.131732 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-web-config\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.131885 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.131784 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.131885 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.131834 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.131885 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.131859 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69548512-e6a7-403e-b062-cf5867b6cbf0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.131885 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.131884 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69548512-e6a7-403e-b062-cf5867b6cbf0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.132157 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.131918 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.132157 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.131937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.132157 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.131970 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69548512-e6a7-403e-b062-cf5867b6cbf0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.132157 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.132039 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-config-volume\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.132157 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.132075 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.132157 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.132135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69548512-e6a7-403e-b062-cf5867b6cbf0-config-out\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.132157 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.132155 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69548512-e6a7-403e-b062-cf5867b6cbf0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.232912 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.232825 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-config-volume\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.232912 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.232878 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233118 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.232926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69548512-e6a7-403e-b062-cf5867b6cbf0-config-out\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233118 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.232944 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69548512-e6a7-403e-b062-cf5867b6cbf0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233118 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.233051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49kfg\" (UniqueName: \"kubernetes.io/projected/69548512-e6a7-403e-b062-cf5867b6cbf0-kube-api-access-49kfg\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233118 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.233100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-web-config\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233320 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.233145 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233320 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.233193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233320 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.233224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69548512-e6a7-403e-b062-cf5867b6cbf0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233320 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.233252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69548512-e6a7-403e-b062-cf5867b6cbf0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233320 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.233279 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233320 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.233319 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233649 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.233364 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69548512-e6a7-403e-b062-cf5867b6cbf0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233754 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.233731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/69548512-e6a7-403e-b062-cf5867b6cbf0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.233842 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.233819 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69548512-e6a7-403e-b062-cf5867b6cbf0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.234743 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.234717 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69548512-e6a7-403e-b062-cf5867b6cbf0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.236517 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.236493 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/69548512-e6a7-403e-b062-cf5867b6cbf0-config-out\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.236676 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.236651 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.236758 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.236671 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.236758 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.236695 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/69548512-e6a7-403e-b062-cf5867b6cbf0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.236881 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.236797 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-web-config\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.236935 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.236891 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-config-volume\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.237357 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.237338 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.237645 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.237625 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.238725 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.238708 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69548512-e6a7-403e-b062-cf5867b6cbf0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.248383 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.248362 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49kfg\" (UniqueName: \"kubernetes.io/projected/69548512-e6a7-403e-b062-cf5867b6cbf0-kube-api-access-49kfg\") pod \"alertmanager-main-0\" (UID: \"69548512-e6a7-403e-b062-cf5867b6cbf0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.296270 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.296244 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:01:07.440953 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:07.440864 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:01:07.443900 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:01:07.443868 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69548512_e6a7_403e_b062_cf5867b6cbf0.slice/crio-51df1f25f7783a77a5d205c6cbe089911de9caac528dac6408846934e47f9adc WatchSource:0}: Error finding container 51df1f25f7783a77a5d205c6cbe089911de9caac528dac6408846934e47f9adc: Status 404 returned error can't find the container with id 51df1f25f7783a77a5d205c6cbe089911de9caac528dac6408846934e47f9adc Jun 14 15:01:08.074265 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:08.074222 2572 generic.go:356] "Generic (PLEG): container finished" podID="69548512-e6a7-403e-b062-cf5867b6cbf0" containerID="63bc6600f93abf5861da33617045190333b122bae5a1dfe04485abc2d89e72cd" exitCode=0 Jun 14 15:01:08.074751 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:08.074311 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69548512-e6a7-403e-b062-cf5867b6cbf0","Type":"ContainerDied","Data":"63bc6600f93abf5861da33617045190333b122bae5a1dfe04485abc2d89e72cd"} Jun 14 15:01:08.074751 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:08.074407 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69548512-e6a7-403e-b062-cf5867b6cbf0","Type":"ContainerStarted","Data":"51df1f25f7783a77a5d205c6cbe089911de9caac528dac6408846934e47f9adc"} Jun 14 15:01:08.075434 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:08.075421 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:01:10.086167 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:10.086133 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69548512-e6a7-403e-b062-cf5867b6cbf0","Type":"ContainerStarted","Data":"e062b97fe9058c2ca79ab3f58a527a4dd1a84061c0af688c94062cc7b8a747b6"} Jun 14 15:01:10.086531 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:10.086198 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69548512-e6a7-403e-b062-cf5867b6cbf0","Type":"ContainerStarted","Data":"6b5dbce1a957aae382521ac917308cf99276804809e52385d5c502213801e2e4"} Jun 14 15:01:10.086531 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:10.086222 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69548512-e6a7-403e-b062-cf5867b6cbf0","Type":"ContainerStarted","Data":"93f24af04cad4585cce09a5d160af4c2269fc914a515a858f6effcc038fc6407"} Jun 14 15:01:10.086531 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:10.086246 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69548512-e6a7-403e-b062-cf5867b6cbf0","Type":"ContainerStarted","Data":"6aec01da3fb32645fa2f96c1496e1b02c58ff0ac3b25d379e4a7ae27982ccd65"} Jun 14 15:01:10.086531 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:10.086270 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69548512-e6a7-403e-b062-cf5867b6cbf0","Type":"ContainerStarted","Data":"525994dcfc3e1b38cba4c6f3296844f46a73deb2f2358bb58745274375f8b6f0"} Jun 14 15:01:10.086531 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:10.086292 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"69548512-e6a7-403e-b062-cf5867b6cbf0","Type":"ContainerStarted","Data":"4ccb4dbc7b2718b89965dbcca6ec81f730026d2dc3cfe131b96900e8055f7517"} Jun 14 15:01:10.111514 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:10.111469 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.557713854 podStartE2EDuration="4.111455799s" totalImagesPullingTime="1.539682372s" totalInitContainerRuntime="14.059573ms" isStatefulPod=false podCreationTimestamp="2026-06-14 15:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:01:10.109187466 +0000 UTC m=+367.760380836" watchObservedRunningTime="2026-06-14 15:01:10.111455799 +0000 UTC m=+367.762649167" Jun 14 15:01:16.815013 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:16.814976 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f75d786c8-57kpn"] Jun 14 15:01:16.817581 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:16.817542 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:16.830647 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:16.830617 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f75d786c8-57kpn"] Jun 14 15:01:16.916239 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:16.916205 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-oauth-serving-cert\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:16.916410 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:16.916259 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-service-ca\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:16.916410 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:16.916330 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c85mm\" (UniqueName: \"kubernetes.io/projected/0327348e-aaeb-4973-a56f-a438882b0c73-kube-api-access-c85mm\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:16.916410 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:16.916380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-oauth-config\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:16.916410 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:16.916406 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-serving-cert\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:16.916617 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:16.916424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-console-config\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:16.916617 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:16.916442 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-trusted-ca-bundle\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.017060 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.017018 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-oauth-config\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.017060 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.017061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-serving-cert\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.017270 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.017080 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-console-config\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.017270 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.017100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-trusted-ca-bundle\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.017270 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.017135 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-oauth-serving-cert\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.017270 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.017204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-service-ca\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.017270 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.017242 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c85mm\" (UniqueName: \"kubernetes.io/projected/0327348e-aaeb-4973-a56f-a438882b0c73-kube-api-access-c85mm\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.018021 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.017992 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-oauth-serving-cert\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.018021 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.018015 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-trusted-ca-bundle\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.018187 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.018166 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-console-config\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.018424 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.018400 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-service-ca\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.019706 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.019685 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-serving-cert\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.019778 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.019760 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-oauth-config\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.027237 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.027209 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c85mm\" (UniqueName: \"kubernetes.io/projected/0327348e-aaeb-4973-a56f-a438882b0c73-kube-api-access-c85mm\") pod \"console-5f75d786c8-57kpn\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.130112 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.130024 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:17.264541 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:17.264515 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f75d786c8-57kpn"] Jun 14 15:01:17.266904 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:01:17.266870 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0327348e_aaeb_4973_a56f_a438882b0c73.slice/crio-22716314c6ae6f0e45b0594467a93299ae4cd738a0fab01bf336803b4425a222 WatchSource:0}: Error finding container 22716314c6ae6f0e45b0594467a93299ae4cd738a0fab01bf336803b4425a222: Status 404 returned error can't find the container with id 22716314c6ae6f0e45b0594467a93299ae4cd738a0fab01bf336803b4425a222 Jun 14 15:01:18.121344 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:18.121300 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f75d786c8-57kpn" event={"ID":"0327348e-aaeb-4973-a56f-a438882b0c73","Type":"ContainerStarted","Data":"39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5"} Jun 14 15:01:18.121736 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:18.121357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f75d786c8-57kpn" event={"ID":"0327348e-aaeb-4973-a56f-a438882b0c73","Type":"ContainerStarted","Data":"22716314c6ae6f0e45b0594467a93299ae4cd738a0fab01bf336803b4425a222"} Jun 14 15:01:18.138876 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:18.138833 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f75d786c8-57kpn" podStartSLOduration=2.13881781 podStartE2EDuration="2.13881781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:01:18.137256642 +0000 UTC m=+375.788450012" watchObservedRunningTime="2026-06-14 15:01:18.13881781 +0000 UTC m=+375.790011179" Jun 14 15:01:27.130440 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:27.130401 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:27.130841 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:27.130476 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:27.135268 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:27.135244 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:27.161078 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:27.161052 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:01:27.206861 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:27.206829 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb7654776-pf6rv"] Jun 14 15:01:52.233846 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.233784 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cb7654776-pf6rv" podUID="3eb38438-2d41-4818-b107-7a1284560f50" containerName="console" containerID="cri-o://68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c" gracePeriod=15 Jun 14 15:01:52.483511 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.483487 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 15:01:52.504648 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.504554 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-oauth-config\") pod \"3eb38438-2d41-4818-b107-7a1284560f50\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " Jun 14 15:01:52.504775 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.504652 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-service-ca\") pod \"3eb38438-2d41-4818-b107-7a1284560f50\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " Jun 14 15:01:52.504775 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.504690 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c9xf\" (UniqueName: \"kubernetes.io/projected/3eb38438-2d41-4818-b107-7a1284560f50-kube-api-access-9c9xf\") pod \"3eb38438-2d41-4818-b107-7a1284560f50\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " Jun 14 15:01:52.504775 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.504714 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-oauth-serving-cert\") pod \"3eb38438-2d41-4818-b107-7a1284560f50\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " Jun 14 15:01:52.504775 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.504747 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-console-config\") pod \"3eb38438-2d41-4818-b107-7a1284560f50\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " Jun 14 15:01:52.504775 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.504770 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-trusted-ca-bundle\") pod \"3eb38438-2d41-4818-b107-7a1284560f50\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " Jun 14 15:01:52.505040 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.504837 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-serving-cert\") pod \"3eb38438-2d41-4818-b107-7a1284560f50\" (UID: \"3eb38438-2d41-4818-b107-7a1284560f50\") " Jun 14 15:01:52.505179 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.505150 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-service-ca" (OuterVolumeSpecName: "service-ca") pod "3eb38438-2d41-4818-b107-7a1284560f50" (UID: "3eb38438-2d41-4818-b107-7a1284560f50"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:52.505179 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.505160 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3eb38438-2d41-4818-b107-7a1284560f50" (UID: "3eb38438-2d41-4818-b107-7a1284560f50"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:52.505526 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.505499 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-console-config" (OuterVolumeSpecName: "console-config") pod "3eb38438-2d41-4818-b107-7a1284560f50" (UID: "3eb38438-2d41-4818-b107-7a1284560f50"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:52.505526 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.505514 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3eb38438-2d41-4818-b107-7a1284560f50" (UID: "3eb38438-2d41-4818-b107-7a1284560f50"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:01:52.507458 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.507430 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3eb38438-2d41-4818-b107-7a1284560f50" (UID: "3eb38438-2d41-4818-b107-7a1284560f50"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:52.507458 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.507447 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb38438-2d41-4818-b107-7a1284560f50-kube-api-access-9c9xf" (OuterVolumeSpecName: "kube-api-access-9c9xf") pod "3eb38438-2d41-4818-b107-7a1284560f50" (UID: "3eb38438-2d41-4818-b107-7a1284560f50"). InnerVolumeSpecName "kube-api-access-9c9xf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:01:52.507663 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.507453 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3eb38438-2d41-4818-b107-7a1284560f50" (UID: "3eb38438-2d41-4818-b107-7a1284560f50"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:01:52.606231 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.606202 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-service-ca\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:01:52.606231 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.606227 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c9xf\" (UniqueName: \"kubernetes.io/projected/3eb38438-2d41-4818-b107-7a1284560f50-kube-api-access-9c9xf\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:01:52.606231 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.606237 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-oauth-serving-cert\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:01:52.606435 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.606246 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-console-config\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:01:52.606435 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.606254 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3eb38438-2d41-4818-b107-7a1284560f50-trusted-ca-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:01:52.606435 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.606262 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-serving-cert\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:01:52.606435 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:52.606272 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3eb38438-2d41-4818-b107-7a1284560f50-console-oauth-config\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:01:53.263544 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:53.263442 2572 generic.go:356] "Generic (PLEG): container finished" podID="3eb38438-2d41-4818-b107-7a1284560f50" containerID="68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c" exitCode=0 Jun 14 15:01:53.263544 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:53.263487 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb7654776-pf6rv" Jun 14 15:01:53.263544 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:53.263489 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb7654776-pf6rv" event={"ID":"3eb38438-2d41-4818-b107-7a1284560f50","Type":"ContainerDied","Data":"68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c"} Jun 14 15:01:53.263544 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:53.263544 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb7654776-pf6rv" event={"ID":"3eb38438-2d41-4818-b107-7a1284560f50","Type":"ContainerDied","Data":"7b2d930679be6ad8c9ab6f0292d93d38145292a48e02b8161f5f0093d32a978f"} Jun 14 15:01:53.264180 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:53.263578 2572 scope.go:117] "RemoveContainer" containerID="68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c" Jun 14 15:01:53.272120 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:53.272107 2572 scope.go:117] "RemoveContainer" containerID="68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c" Jun 14 15:01:53.272343 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:01:53.272325 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c\": container with ID starting with 68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c not found: ID does not exist" containerID="68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c" Jun 14 15:01:53.272385 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:53.272351 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c"} err="failed to get container status \"68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c\": rpc error: code = NotFound desc = could not find container \"68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c\": container with ID starting with 68a5bdf44eddfa3dc6a67bbf12b63a779ac9bd8ed0740199cc5d3adccd52495c not found: ID does not exist" Jun 14 15:01:53.280381 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:53.280359 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb7654776-pf6rv"] Jun 14 15:01:53.284576 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:53.284540 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb7654776-pf6rv"] Jun 14 15:01:54.806666 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:01:54.806632 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eb38438-2d41-4818-b107-7a1284560f50" path="/var/lib/kubelet/pods/3eb38438-2d41-4818-b107-7a1284560f50/volumes" Jun 14 15:02:21.269462 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.269377 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44"] Jun 14 15:02:21.269906 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.269728 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb38438-2d41-4818-b107-7a1284560f50" containerName="console" Jun 14 15:02:21.269906 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.269740 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb38438-2d41-4818-b107-7a1284560f50" containerName="console" Jun 14 15:02:21.269906 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.269800 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb38438-2d41-4818-b107-7a1284560f50" containerName="console" Jun 14 15:02:21.272051 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.272035 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:21.274696 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.274675 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6sjq4\"" Jun 14 15:02:21.275036 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.275021 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 15:02:21.275752 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.275734 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 15:02:21.281073 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.281053 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44"] Jun 14 15:02:21.352814 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.352776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdv9t\" (UniqueName: \"kubernetes.io/projected/b384b5e0-d938-456f-8374-fa860e528292-kube-api-access-cdv9t\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:21.352991 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.352844 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:21.352991 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.352875 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:21.453712 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.453674 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:21.453712 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.453716 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:21.453975 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.453775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdv9t\" (UniqueName: \"kubernetes.io/projected/b384b5e0-d938-456f-8374-fa860e528292-kube-api-access-cdv9t\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:21.454128 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.454105 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:21.454189 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.454124 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:21.462605 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.462578 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdv9t\" (UniqueName: \"kubernetes.io/projected/b384b5e0-d938-456f-8374-fa860e528292-kube-api-access-cdv9t\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:21.581759 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.581729 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:21.709558 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:21.709537 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44"] Jun 14 15:02:21.712324 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:02:21.712301 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb384b5e0_d938_456f_8374_fa860e528292.slice/crio-460d74cf298e0e63822fc18a2ca1137f127d85765631770b2263a8f609858a61 WatchSource:0}: Error finding container 460d74cf298e0e63822fc18a2ca1137f127d85765631770b2263a8f609858a61: Status 404 returned error can't find the container with id 460d74cf298e0e63822fc18a2ca1137f127d85765631770b2263a8f609858a61 Jun 14 15:02:22.385779 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:22.385734 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" event={"ID":"b384b5e0-d938-456f-8374-fa860e528292","Type":"ContainerStarted","Data":"460d74cf298e0e63822fc18a2ca1137f127d85765631770b2263a8f609858a61"} Jun 14 15:02:29.419327 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:29.419295 2572 generic.go:356] "Generic (PLEG): container finished" podID="b384b5e0-d938-456f-8374-fa860e528292" containerID="bfbca44a874cd7e0cce91791569157e5fd5a2411dbb11df0279b1ae0634104e5" exitCode=0 Jun 14 15:02:29.419749 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:29.419382 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" event={"ID":"b384b5e0-d938-456f-8374-fa860e528292","Type":"ContainerDied","Data":"bfbca44a874cd7e0cce91791569157e5fd5a2411dbb11df0279b1ae0634104e5"} Jun 14 15:02:32.433973 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:32.433935 2572 generic.go:356] "Generic (PLEG): container finished" podID="b384b5e0-d938-456f-8374-fa860e528292" containerID="15917f5cb30036fa1908f4f10006fc728d80bc6bb18290d1b9e21eb3f255de20" exitCode=0 Jun 14 15:02:32.434408 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:32.434018 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" event={"ID":"b384b5e0-d938-456f-8374-fa860e528292","Type":"ContainerDied","Data":"15917f5cb30036fa1908f4f10006fc728d80bc6bb18290d1b9e21eb3f255de20"} Jun 14 15:02:40.473954 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:40.473856 2572 generic.go:356] "Generic (PLEG): container finished" podID="b384b5e0-d938-456f-8374-fa860e528292" containerID="8ed155cab614e0d1cd0db6c8ddcce34537f4feb7eb25be4199553b00a7491202" exitCode=0 Jun 14 15:02:40.473954 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:40.473939 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" event={"ID":"b384b5e0-d938-456f-8374-fa860e528292","Type":"ContainerDied","Data":"8ed155cab614e0d1cd0db6c8ddcce34537f4feb7eb25be4199553b00a7491202"} Jun 14 15:02:41.611669 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:41.611636 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:41.736618 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:41.736505 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-util\") pod \"b384b5e0-d938-456f-8374-fa860e528292\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " Jun 14 15:02:41.736618 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:41.736582 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-bundle\") pod \"b384b5e0-d938-456f-8374-fa860e528292\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " Jun 14 15:02:41.736808 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:41.736683 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdv9t\" (UniqueName: \"kubernetes.io/projected/b384b5e0-d938-456f-8374-fa860e528292-kube-api-access-cdv9t\") pod \"b384b5e0-d938-456f-8374-fa860e528292\" (UID: \"b384b5e0-d938-456f-8374-fa860e528292\") " Jun 14 15:02:41.737272 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:41.737238 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-bundle" (OuterVolumeSpecName: "bundle") pod "b384b5e0-d938-456f-8374-fa860e528292" (UID: "b384b5e0-d938-456f-8374-fa860e528292"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:02:41.738938 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:41.738903 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b384b5e0-d938-456f-8374-fa860e528292-kube-api-access-cdv9t" (OuterVolumeSpecName: "kube-api-access-cdv9t") pod "b384b5e0-d938-456f-8374-fa860e528292" (UID: "b384b5e0-d938-456f-8374-fa860e528292"). InnerVolumeSpecName "kube-api-access-cdv9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:02:41.743825 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:41.743795 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-util" (OuterVolumeSpecName: "util") pod "b384b5e0-d938-456f-8374-fa860e528292" (UID: "b384b5e0-d938-456f-8374-fa860e528292"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:02:41.838283 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:41.838245 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-util\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:02:41.838283 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:41.838275 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b384b5e0-d938-456f-8374-fa860e528292-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:02:41.838283 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:41.838286 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdv9t\" (UniqueName: \"kubernetes.io/projected/b384b5e0-d938-456f-8374-fa860e528292-kube-api-access-cdv9t\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:02:42.484247 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:42.484209 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" event={"ID":"b384b5e0-d938-456f-8374-fa860e528292","Type":"ContainerDied","Data":"460d74cf298e0e63822fc18a2ca1137f127d85765631770b2263a8f609858a61"} Jun 14 15:02:42.484247 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:42.484254 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="460d74cf298e0e63822fc18a2ca1137f127d85765631770b2263a8f609858a61" Jun 14 15:02:42.484488 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:42.484269 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dh4j44" Jun 14 15:02:49.256934 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.256891 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd"] Jun 14 15:02:49.257504 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.257368 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b384b5e0-d938-456f-8374-fa860e528292" containerName="extract" Jun 14 15:02:49.257504 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.257388 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b384b5e0-d938-456f-8374-fa860e528292" containerName="extract" Jun 14 15:02:49.257504 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.257410 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b384b5e0-d938-456f-8374-fa860e528292" containerName="pull" Jun 14 15:02:49.257504 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.257418 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b384b5e0-d938-456f-8374-fa860e528292" containerName="pull" Jun 14 15:02:49.257504 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.257429 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b384b5e0-d938-456f-8374-fa860e528292" containerName="util" Jun 14 15:02:49.257504 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.257449 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b384b5e0-d938-456f-8374-fa860e528292" containerName="util" Jun 14 15:02:49.257835 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.257535 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b384b5e0-d938-456f-8374-fa860e528292" containerName="extract" Jun 14 15:02:49.262027 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.262004 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd" Jun 14 15:02:49.264709 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.264684 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:02:49.264826 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.264710 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 14 15:02:49.264826 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.264684 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5qsnq\"" Jun 14 15:02:49.276277 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.276251 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd"] Jun 14 15:02:49.299551 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.299520 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsmcd\" (UniqueName: \"kubernetes.io/projected/9215f23e-1ee6-464a-845a-514897dad62a-kube-api-access-zsmcd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-cr4cd\" (UID: \"9215f23e-1ee6-464a-845a-514897dad62a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd" Jun 14 15:02:49.299695 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.299598 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9215f23e-1ee6-464a-845a-514897dad62a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-cr4cd\" (UID: \"9215f23e-1ee6-464a-845a-514897dad62a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd" Jun 14 15:02:49.399958 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.399924 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsmcd\" (UniqueName: \"kubernetes.io/projected/9215f23e-1ee6-464a-845a-514897dad62a-kube-api-access-zsmcd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-cr4cd\" (UID: \"9215f23e-1ee6-464a-845a-514897dad62a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd" Jun 14 15:02:49.400105 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.399975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9215f23e-1ee6-464a-845a-514897dad62a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-cr4cd\" (UID: \"9215f23e-1ee6-464a-845a-514897dad62a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd" Jun 14 15:02:49.400296 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.400281 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9215f23e-1ee6-464a-845a-514897dad62a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-cr4cd\" (UID: \"9215f23e-1ee6-464a-845a-514897dad62a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd" Jun 14 15:02:49.410780 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.410748 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsmcd\" (UniqueName: \"kubernetes.io/projected/9215f23e-1ee6-464a-845a-514897dad62a-kube-api-access-zsmcd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-cr4cd\" (UID: \"9215f23e-1ee6-464a-845a-514897dad62a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd" Jun 14 15:02:49.571312 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.571278 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd" Jun 14 15:02:49.711087 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:49.711031 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd"] Jun 14 15:02:49.714151 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:02:49.714125 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9215f23e_1ee6_464a_845a_514897dad62a.slice/crio-94a48a183ea8bc62aea25ed5f281cbf6a0b8ea8e8ec0e99376d7f8b04e36ddc7 WatchSource:0}: Error finding container 94a48a183ea8bc62aea25ed5f281cbf6a0b8ea8e8ec0e99376d7f8b04e36ddc7: Status 404 returned error can't find the container with id 94a48a183ea8bc62aea25ed5f281cbf6a0b8ea8e8ec0e99376d7f8b04e36ddc7 Jun 14 15:02:50.526713 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:50.526672 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd" event={"ID":"9215f23e-1ee6-464a-845a-514897dad62a","Type":"ContainerStarted","Data":"94a48a183ea8bc62aea25ed5f281cbf6a0b8ea8e8ec0e99376d7f8b04e36ddc7"} Jun 14 15:02:51.533181 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:51.533090 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd" event={"ID":"9215f23e-1ee6-464a-845a-514897dad62a","Type":"ContainerStarted","Data":"7901346af1179682da6fab371c4910495e1c2c4c4da46909edc89001b9945cae"} Jun 14 15:02:51.554238 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:51.554189 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-cr4cd" podStartSLOduration=1.074050452 podStartE2EDuration="2.554172268s" totalImagesPullingTime="1.480121816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:02:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:02:51.553471316 +0000 UTC m=+469.204664685" watchObservedRunningTime="2026-06-14 15:02:51.554172268 +0000 UTC m=+469.205365636" Jun 14 15:02:53.267951 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.267915 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47"] Jun 14 15:02:53.270450 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.270433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:53.273046 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.273018 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 15:02:53.273177 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.273078 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 15:02:53.273177 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.273097 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6sjq4\"" Jun 14 15:02:53.279177 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.279151 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47"] Jun 14 15:02:53.329775 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.329736 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb6gx\" (UniqueName: \"kubernetes.io/projected/7d7e186e-01a3-46ae-9878-da5905dfe597-kube-api-access-cb6gx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:53.329936 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.329812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:53.329936 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.329853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:53.430466 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.430435 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb6gx\" (UniqueName: \"kubernetes.io/projected/7d7e186e-01a3-46ae-9878-da5905dfe597-kube-api-access-cb6gx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:53.430466 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.430469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:53.430703 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.430489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:53.430907 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.430884 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:53.430981 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.430961 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:53.441126 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.441102 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb6gx\" (UniqueName: \"kubernetes.io/projected/7d7e186e-01a3-46ae-9878-da5905dfe597-kube-api-access-cb6gx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:53.498313 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.498275 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc"] Jun 14 15:02:53.500717 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.500700 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" Jun 14 15:02:53.503351 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.503331 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-x7qp9\"" Jun 14 15:02:53.503351 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.503340 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 15:02:53.503578 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.503379 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 15:02:53.512542 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.512519 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc"] Jun 14 15:02:53.531577 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.531510 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnbbs\" (UniqueName: \"kubernetes.io/projected/09e01247-9a37-4021-8da8-93589c314f59-kube-api-access-rnbbs\") pod \"cert-manager-webhook-7dc76cbb94-cpmmc\" (UID: \"09e01247-9a37-4021-8da8-93589c314f59\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" Jun 14 15:02:53.531669 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.531559 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09e01247-9a37-4021-8da8-93589c314f59-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cpmmc\" (UID: \"09e01247-9a37-4021-8da8-93589c314f59\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" Jun 14 15:02:53.580075 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.580045 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:53.632435 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.632398 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnbbs\" (UniqueName: \"kubernetes.io/projected/09e01247-9a37-4021-8da8-93589c314f59-kube-api-access-rnbbs\") pod \"cert-manager-webhook-7dc76cbb94-cpmmc\" (UID: \"09e01247-9a37-4021-8da8-93589c314f59\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" Jun 14 15:02:53.632742 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.632468 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09e01247-9a37-4021-8da8-93589c314f59-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cpmmc\" (UID: \"09e01247-9a37-4021-8da8-93589c314f59\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" Jun 14 15:02:53.650434 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.650385 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnbbs\" (UniqueName: \"kubernetes.io/projected/09e01247-9a37-4021-8da8-93589c314f59-kube-api-access-rnbbs\") pod \"cert-manager-webhook-7dc76cbb94-cpmmc\" (UID: \"09e01247-9a37-4021-8da8-93589c314f59\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" Jun 14 15:02:53.650988 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.650965 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09e01247-9a37-4021-8da8-93589c314f59-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-cpmmc\" (UID: \"09e01247-9a37-4021-8da8-93589c314f59\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" Jun 14 15:02:53.729344 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.729318 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47"] Jun 14 15:02:53.731438 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:02:53.731410 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7e186e_01a3_46ae_9878_da5905dfe597.slice/crio-2c833fb06ae823415bee21f9c0d6304a3232171daecd9925e80903402117fcdc WatchSource:0}: Error finding container 2c833fb06ae823415bee21f9c0d6304a3232171daecd9925e80903402117fcdc: Status 404 returned error can't find the container with id 2c833fb06ae823415bee21f9c0d6304a3232171daecd9925e80903402117fcdc Jun 14 15:02:53.827859 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.827833 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" Jun 14 15:02:53.958779 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:53.958755 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc"] Jun 14 15:02:53.960582 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:02:53.960535 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09e01247_9a37_4021_8da8_93589c314f59.slice/crio-7eed683a15372e34cfe2b8fd9b56869dffdbdd9306000069b76e0c4e8056ce28 WatchSource:0}: Error finding container 7eed683a15372e34cfe2b8fd9b56869dffdbdd9306000069b76e0c4e8056ce28: Status 404 returned error can't find the container with id 7eed683a15372e34cfe2b8fd9b56869dffdbdd9306000069b76e0c4e8056ce28 Jun 14 15:02:54.548115 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:54.548067 2572 generic.go:356] "Generic (PLEG): container finished" podID="7d7e186e-01a3-46ae-9878-da5905dfe597" containerID="21d52f0a0f7fc4a5e625c6045c4abd54ac4670ed71740fdd44dc07abc55a5ef0" exitCode=0 Jun 14 15:02:54.548684 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:54.548132 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" event={"ID":"7d7e186e-01a3-46ae-9878-da5905dfe597","Type":"ContainerDied","Data":"21d52f0a0f7fc4a5e625c6045c4abd54ac4670ed71740fdd44dc07abc55a5ef0"} Jun 14 15:02:54.548684 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:54.548210 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" event={"ID":"7d7e186e-01a3-46ae-9878-da5905dfe597","Type":"ContainerStarted","Data":"2c833fb06ae823415bee21f9c0d6304a3232171daecd9925e80903402117fcdc"} Jun 14 15:02:54.549394 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:54.549369 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" event={"ID":"09e01247-9a37-4021-8da8-93589c314f59","Type":"ContainerStarted","Data":"7eed683a15372e34cfe2b8fd9b56869dffdbdd9306000069b76e0c4e8056ce28"} Jun 14 15:02:57.570032 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:57.569997 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" event={"ID":"09e01247-9a37-4021-8da8-93589c314f59","Type":"ContainerStarted","Data":"42ac581c4ee1483b749dbacaed62a3ab4caeb8453973d92279d1162a2423e8d3"} Jun 14 15:02:57.570492 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:57.570124 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" Jun 14 15:02:57.571993 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:57.571969 2572 generic.go:356] "Generic (PLEG): container finished" podID="7d7e186e-01a3-46ae-9878-da5905dfe597" containerID="2f070ed2f89ef1648ebbeb53649eeaa9d3253fd84259b1c784993b379ca24b30" exitCode=0 Jun 14 15:02:57.572096 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:57.572053 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" event={"ID":"7d7e186e-01a3-46ae-9878-da5905dfe597","Type":"ContainerDied","Data":"2f070ed2f89ef1648ebbeb53649eeaa9d3253fd84259b1c784993b379ca24b30"} Jun 14 15:02:57.586397 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:57.586359 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" podStartSLOduration=1.293942084 podStartE2EDuration="4.586345513s" totalImagesPullingTime="3.292403429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:02:57.585615329 +0000 UTC m=+475.236808697" watchObservedRunningTime="2026-06-14 15:02:57.586345513 +0000 UTC m=+475.237538882" Jun 14 15:02:58.578753 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:58.578713 2572 generic.go:356] "Generic (PLEG): container finished" podID="7d7e186e-01a3-46ae-9878-da5905dfe597" containerID="a865f1f5eff1be727021c8a35b86e3c3d293d1b42db9db475fd0036b0728fff2" exitCode=0 Jun 14 15:02:58.579116 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:58.578799 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" event={"ID":"7d7e186e-01a3-46ae-9878-da5905dfe597","Type":"ContainerDied","Data":"a865f1f5eff1be727021c8a35b86e3c3d293d1b42db9db475fd0036b0728fff2"} Jun 14 15:02:59.713351 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:59.713328 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:02:59.785282 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:59.785250 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-bundle\") pod \"7d7e186e-01a3-46ae-9878-da5905dfe597\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " Jun 14 15:02:59.785436 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:59.785309 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb6gx\" (UniqueName: \"kubernetes.io/projected/7d7e186e-01a3-46ae-9878-da5905dfe597-kube-api-access-cb6gx\") pod \"7d7e186e-01a3-46ae-9878-da5905dfe597\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " Jun 14 15:02:59.785436 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:59.785333 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-util\") pod \"7d7e186e-01a3-46ae-9878-da5905dfe597\" (UID: \"7d7e186e-01a3-46ae-9878-da5905dfe597\") " Jun 14 15:02:59.785760 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:59.785724 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-bundle" (OuterVolumeSpecName: "bundle") pod "7d7e186e-01a3-46ae-9878-da5905dfe597" (UID: "7d7e186e-01a3-46ae-9878-da5905dfe597"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:02:59.787541 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:59.787518 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7e186e-01a3-46ae-9878-da5905dfe597-kube-api-access-cb6gx" (OuterVolumeSpecName: "kube-api-access-cb6gx") pod "7d7e186e-01a3-46ae-9878-da5905dfe597" (UID: "7d7e186e-01a3-46ae-9878-da5905dfe597"). InnerVolumeSpecName "kube-api-access-cb6gx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:02:59.790311 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:59.790280 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-util" (OuterVolumeSpecName: "util") pod "7d7e186e-01a3-46ae-9878-da5905dfe597" (UID: "7d7e186e-01a3-46ae-9878-da5905dfe597"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:02:59.886611 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:59.886507 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:02:59.886611 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:59.886552 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb6gx\" (UniqueName: \"kubernetes.io/projected/7d7e186e-01a3-46ae-9878-da5905dfe597-kube-api-access-cb6gx\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:02:59.886611 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:02:59.886596 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d7e186e-01a3-46ae-9878-da5905dfe597-util\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:03:00.594250 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:00.594221 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" Jun 14 15:03:00.594410 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:00.594224 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffxv47" event={"ID":"7d7e186e-01a3-46ae-9878-da5905dfe597","Type":"ContainerDied","Data":"2c833fb06ae823415bee21f9c0d6304a3232171daecd9925e80903402117fcdc"} Jun 14 15:03:00.594410 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:00.594367 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c833fb06ae823415bee21f9c0d6304a3232171daecd9925e80903402117fcdc" Jun 14 15:03:03.581025 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:03.580993 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-cpmmc" Jun 14 15:03:06.445972 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.445932 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t"] Jun 14 15:03:06.446339 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.446249 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7e186e-01a3-46ae-9878-da5905dfe597" containerName="extract" Jun 14 15:03:06.446339 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.446260 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7e186e-01a3-46ae-9878-da5905dfe597" containerName="extract" Jun 14 15:03:06.446339 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.446284 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7e186e-01a3-46ae-9878-da5905dfe597" containerName="pull" Jun 14 15:03:06.446339 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.446289 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7e186e-01a3-46ae-9878-da5905dfe597" containerName="pull" Jun 14 15:03:06.446339 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.446297 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7e186e-01a3-46ae-9878-da5905dfe597" containerName="util" Jun 14 15:03:06.446339 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.446302 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7e186e-01a3-46ae-9878-da5905dfe597" containerName="util" Jun 14 15:03:06.446525 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.446350 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d7e186e-01a3-46ae-9878-da5905dfe597" containerName="extract" Jun 14 15:03:06.448546 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.448529 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t" Jun 14 15:03:06.451020 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.450996 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:03:06.451020 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.451013 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 15:03:06.451977 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.451961 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8xgdh\"" Jun 14 15:03:06.456948 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.456899 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t"] Jun 14 15:03:06.546392 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.546360 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x88wl\" (UniqueName: \"kubernetes.io/projected/09816be2-ca69-40b2-a254-9b5ba6f6fb8a-kube-api-access-x88wl\") pod \"openshift-lws-operator-fd8ccff4c-cl87t\" (UID: \"09816be2-ca69-40b2-a254-9b5ba6f6fb8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t" Jun 14 15:03:06.546541 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.546400 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09816be2-ca69-40b2-a254-9b5ba6f6fb8a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cl87t\" (UID: \"09816be2-ca69-40b2-a254-9b5ba6f6fb8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t" Jun 14 15:03:06.647727 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.647685 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x88wl\" (UniqueName: \"kubernetes.io/projected/09816be2-ca69-40b2-a254-9b5ba6f6fb8a-kube-api-access-x88wl\") pod \"openshift-lws-operator-fd8ccff4c-cl87t\" (UID: \"09816be2-ca69-40b2-a254-9b5ba6f6fb8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t" Jun 14 15:03:06.647889 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.647750 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09816be2-ca69-40b2-a254-9b5ba6f6fb8a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cl87t\" (UID: \"09816be2-ca69-40b2-a254-9b5ba6f6fb8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t" Jun 14 15:03:06.648150 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.648129 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09816be2-ca69-40b2-a254-9b5ba6f6fb8a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cl87t\" (UID: \"09816be2-ca69-40b2-a254-9b5ba6f6fb8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t" Jun 14 15:03:06.662603 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.662551 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x88wl\" (UniqueName: \"kubernetes.io/projected/09816be2-ca69-40b2-a254-9b5ba6f6fb8a-kube-api-access-x88wl\") pod \"openshift-lws-operator-fd8ccff4c-cl87t\" (UID: \"09816be2-ca69-40b2-a254-9b5ba6f6fb8a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t" Jun 14 15:03:06.757698 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.757613 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t" Jun 14 15:03:06.894478 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:06.894303 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t"] Jun 14 15:03:06.897073 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:03:06.897048 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09816be2_ca69_40b2_a254_9b5ba6f6fb8a.slice/crio-c42092c96cf3929d9b82c98c4c45a5c68641ecc9512114e1a134353bfc2c8d7d WatchSource:0}: Error finding container c42092c96cf3929d9b82c98c4c45a5c68641ecc9512114e1a134353bfc2c8d7d: Status 404 returned error can't find the container with id c42092c96cf3929d9b82c98c4c45a5c68641ecc9512114e1a134353bfc2c8d7d Jun 14 15:03:07.627897 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:07.627861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t" event={"ID":"09816be2-ca69-40b2-a254-9b5ba6f6fb8a","Type":"ContainerStarted","Data":"c42092c96cf3929d9b82c98c4c45a5c68641ecc9512114e1a134353bfc2c8d7d"} Jun 14 15:03:09.640742 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:09.640704 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t" event={"ID":"09816be2-ca69-40b2-a254-9b5ba6f6fb8a","Type":"ContainerStarted","Data":"615305837e873ee2c5204ac05faa5abbaa75d15170bedb55d42e8068722547c3"} Jun 14 15:03:09.656901 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:09.656845 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cl87t" podStartSLOduration=1.63867001 podStartE2EDuration="3.656831237s" totalImagesPullingTime="2.018161227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:03:09.655099255 +0000 UTC m=+487.306292619" watchObservedRunningTime="2026-06-14 15:03:09.656831237 +0000 UTC m=+487.308024606" Jun 14 15:03:12.734524 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.734484 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r"] Jun 14 15:03:12.737211 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.737194 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:12.739690 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.739665 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6sjq4\"" Jun 14 15:03:12.739809 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.739701 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 15:03:12.740715 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.740698 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 15:03:12.745406 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.745382 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r"] Jun 14 15:03:12.802004 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.801960 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:12.802197 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.802088 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mct9l\" (UniqueName: \"kubernetes.io/projected/e427048f-96df-43d5-8b4f-320cfeacd1c6-kube-api-access-mct9l\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:12.802197 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.802125 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:12.902528 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.902500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:12.902744 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.902588 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mct9l\" (UniqueName: \"kubernetes.io/projected/e427048f-96df-43d5-8b4f-320cfeacd1c6-kube-api-access-mct9l\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:12.902744 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.902617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:12.903009 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.902988 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:12.903009 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.903003 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:12.911087 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:12.911057 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mct9l\" (UniqueName: \"kubernetes.io/projected/e427048f-96df-43d5-8b4f-320cfeacd1c6-kube-api-access-mct9l\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:13.047833 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:13.047799 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:13.179007 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:13.178974 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r"] Jun 14 15:03:13.181722 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:03:13.181693 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode427048f_96df_43d5_8b4f_320cfeacd1c6.slice/crio-0b49a9727a8913e60b7d5016ba7338248dbc639684c8f2704f05264242c3b10c WatchSource:0}: Error finding container 0b49a9727a8913e60b7d5016ba7338248dbc639684c8f2704f05264242c3b10c: Status 404 returned error can't find the container with id 0b49a9727a8913e60b7d5016ba7338248dbc639684c8f2704f05264242c3b10c Jun 14 15:03:13.661368 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:13.661336 2572 generic.go:356] "Generic (PLEG): container finished" podID="e427048f-96df-43d5-8b4f-320cfeacd1c6" containerID="3364636658eb5c3a354117f345ea2c3546675df0e67e3fb97caf1e3d3fe51f0d" exitCode=0 Jun 14 15:03:13.661549 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:13.661421 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" event={"ID":"e427048f-96df-43d5-8b4f-320cfeacd1c6","Type":"ContainerDied","Data":"3364636658eb5c3a354117f345ea2c3546675df0e67e3fb97caf1e3d3fe51f0d"} Jun 14 15:03:13.661549 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:13.661478 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" event={"ID":"e427048f-96df-43d5-8b4f-320cfeacd1c6","Type":"ContainerStarted","Data":"0b49a9727a8913e60b7d5016ba7338248dbc639684c8f2704f05264242c3b10c"} Jun 14 15:03:14.667716 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:14.667683 2572 generic.go:356] "Generic (PLEG): container finished" podID="e427048f-96df-43d5-8b4f-320cfeacd1c6" containerID="27d0843688d87918e315501d692df4937739945e0aad7de4c08b7bb3b65595ef" exitCode=0 Jun 14 15:03:14.668089 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:14.667775 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" event={"ID":"e427048f-96df-43d5-8b4f-320cfeacd1c6","Type":"ContainerDied","Data":"27d0843688d87918e315501d692df4937739945e0aad7de4c08b7bb3b65595ef"} Jun 14 15:03:15.674477 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:15.674438 2572 generic.go:356] "Generic (PLEG): container finished" podID="e427048f-96df-43d5-8b4f-320cfeacd1c6" containerID="dc42ba85b33bf5cc6204fb94d298ce6bc52d260914de65938c44406ab87806ce" exitCode=0 Jun 14 15:03:15.674950 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:15.674522 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" event={"ID":"e427048f-96df-43d5-8b4f-320cfeacd1c6","Type":"ContainerDied","Data":"dc42ba85b33bf5cc6204fb94d298ce6bc52d260914de65938c44406ab87806ce"} Jun 14 15:03:16.818062 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:16.818029 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:16.935628 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:16.935516 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-bundle\") pod \"e427048f-96df-43d5-8b4f-320cfeacd1c6\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " Jun 14 15:03:16.935772 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:16.935651 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-util\") pod \"e427048f-96df-43d5-8b4f-320cfeacd1c6\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " Jun 14 15:03:16.935772 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:16.935691 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mct9l\" (UniqueName: \"kubernetes.io/projected/e427048f-96df-43d5-8b4f-320cfeacd1c6-kube-api-access-mct9l\") pod \"e427048f-96df-43d5-8b4f-320cfeacd1c6\" (UID: \"e427048f-96df-43d5-8b4f-320cfeacd1c6\") " Jun 14 15:03:16.936215 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:16.936186 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-bundle" (OuterVolumeSpecName: "bundle") pod "e427048f-96df-43d5-8b4f-320cfeacd1c6" (UID: "e427048f-96df-43d5-8b4f-320cfeacd1c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:03:16.937974 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:16.937933 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e427048f-96df-43d5-8b4f-320cfeacd1c6-kube-api-access-mct9l" (OuterVolumeSpecName: "kube-api-access-mct9l") pod "e427048f-96df-43d5-8b4f-320cfeacd1c6" (UID: "e427048f-96df-43d5-8b4f-320cfeacd1c6"). InnerVolumeSpecName "kube-api-access-mct9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:03:16.941396 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:16.941364 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-util" (OuterVolumeSpecName: "util") pod "e427048f-96df-43d5-8b4f-320cfeacd1c6" (UID: "e427048f-96df-43d5-8b4f-320cfeacd1c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:03:17.037127 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:17.037079 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mct9l\" (UniqueName: \"kubernetes.io/projected/e427048f-96df-43d5-8b4f-320cfeacd1c6-kube-api-access-mct9l\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:03:17.037127 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:17.037122 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:03:17.037127 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:17.037132 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e427048f-96df-43d5-8b4f-320cfeacd1c6-util\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:03:17.686372 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:17.686346 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" Jun 14 15:03:17.686587 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:17.686384 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhc67r" event={"ID":"e427048f-96df-43d5-8b4f-320cfeacd1c6","Type":"ContainerDied","Data":"0b49a9727a8913e60b7d5016ba7338248dbc639684c8f2704f05264242c3b10c"} Jun 14 15:03:17.686587 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:17.686432 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b49a9727a8913e60b7d5016ba7338248dbc639684c8f2704f05264242c3b10c" Jun 14 15:03:28.903131 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.903097 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb"] Jun 14 15:03:28.903522 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.903428 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e427048f-96df-43d5-8b4f-320cfeacd1c6" containerName="util" Jun 14 15:03:28.903522 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.903438 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e427048f-96df-43d5-8b4f-320cfeacd1c6" containerName="util" Jun 14 15:03:28.903522 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.903451 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e427048f-96df-43d5-8b4f-320cfeacd1c6" containerName="pull" Jun 14 15:03:28.903522 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.903457 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e427048f-96df-43d5-8b4f-320cfeacd1c6" containerName="pull" Jun 14 15:03:28.903522 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.903470 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e427048f-96df-43d5-8b4f-320cfeacd1c6" containerName="extract" Jun 14 15:03:28.903522 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.903475 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e427048f-96df-43d5-8b4f-320cfeacd1c6" containerName="extract" Jun 14 15:03:28.903762 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.903528 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e427048f-96df-43d5-8b4f-320cfeacd1c6" containerName="extract" Jun 14 15:03:28.908130 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.908112 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:28.911001 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.910952 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 15:03:28.911144 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.911035 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-msgfl\"" Jun 14 15:03:28.911369 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.911346 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 15:03:28.911494 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.911374 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 15:03:28.911494 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.911395 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 15:03:28.919992 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:28.919967 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb"] Jun 14 15:03:29.040816 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.040777 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-manifests\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.040983 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.040829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.040983 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.040923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.040983 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.040964 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-tmp\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.041084 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.040990 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-974c8\" (UniqueName: \"kubernetes.io/projected/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-kube-api-access-974c8\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.142326 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.142291 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-manifests\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.142519 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.142348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.142519 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.142403 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.142519 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.142437 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-tmp\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.142519 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.142459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-974c8\" (UniqueName: \"kubernetes.io/projected/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-kube-api-access-974c8\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.142792 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.142769 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-manifests\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.144818 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.144794 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-tmp\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.145037 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.145018 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.145096 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.145053 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.159238 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.159181 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-974c8\" (UniqueName: \"kubernetes.io/projected/6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62-kube-api-access-974c8\") pod \"opendatahub-operator-controller-manager-8b6c5698-22wtb\" (UID: \"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62\") " pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.219428 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.219386 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:29.356165 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.356141 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb"] Jun 14 15:03:29.357955 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:03:29.357929 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6807c0ff_cdb1_4cc5_a7a5_10a90c3cde62.slice/crio-930764f01dbac5f89e9e676e76081a403164eb210803980a2480b1f2f797daeb WatchSource:0}: Error finding container 930764f01dbac5f89e9e676e76081a403164eb210803980a2480b1f2f797daeb: Status 404 returned error can't find the container with id 930764f01dbac5f89e9e676e76081a403164eb210803980a2480b1f2f797daeb Jun 14 15:03:29.744508 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:29.744474 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" event={"ID":"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62","Type":"ContainerStarted","Data":"930764f01dbac5f89e9e676e76081a403164eb210803980a2480b1f2f797daeb"} Jun 14 15:03:32.762704 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:32.762662 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" event={"ID":"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62","Type":"ContainerStarted","Data":"69d200707453392114e50b01e2d8775014ea5d58c56430ad5c93dfcc5e82e37a"} Jun 14 15:03:33.769335 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:33.769303 2572 generic.go:356] "Generic (PLEG): container finished" podID="6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62" containerID="69d200707453392114e50b01e2d8775014ea5d58c56430ad5c93dfcc5e82e37a" exitCode=0 Jun 14 15:03:33.769757 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:33.769393 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" event={"ID":"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62","Type":"ContainerDied","Data":"69d200707453392114e50b01e2d8775014ea5d58c56430ad5c93dfcc5e82e37a"} Jun 14 15:03:34.775755 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:34.775718 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" event={"ID":"6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62","Type":"ContainerStarted","Data":"dc0240c933959e5932e781b7e5e514167a65fa760d6b67d8f886967f8b572262"} Jun 14 15:03:34.776122 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:34.775808 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:03:34.797774 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:34.797732 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" podStartSLOduration=2.635518544 podStartE2EDuration="6.797716218s" totalImagesPullingTime="3.19617757s" totalInitContainerRuntime="966.020104ms" isStatefulPod=false podCreationTimestamp="2026-06-14 15:03:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:03:34.795706024 +0000 UTC m=+512.446899395" watchObservedRunningTime="2026-06-14 15:03:34.797716218 +0000 UTC m=+512.448909654" Jun 14 15:03:45.783224 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:03:45.783188 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8b6c5698-22wtb" Jun 14 15:04:33.820794 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.820752 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz"] Jun 14 15:04:33.823153 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.823132 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" Jun 14 15:04:33.825527 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.825504 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 15:04:33.825654 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.825588 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x84m4\"" Jun 14 15:04:33.825654 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.825639 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 15:04:33.832266 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.832241 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz"] Jun 14 15:04:33.890955 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.890925 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd039da6-3ec2-4371-8aad-afef9ca665b9-tmp\") pod \"kube-auth-proxy-85cfd86dcb-frkjz\" (UID: \"fd039da6-3ec2-4371-8aad-afef9ca665b9\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" Jun 14 15:04:33.891125 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.890982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd039da6-3ec2-4371-8aad-afef9ca665b9-tls-certs\") pod \"kube-auth-proxy-85cfd86dcb-frkjz\" (UID: \"fd039da6-3ec2-4371-8aad-afef9ca665b9\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" Jun 14 15:04:33.891125 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.891063 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88kv7\" (UniqueName: \"kubernetes.io/projected/fd039da6-3ec2-4371-8aad-afef9ca665b9-kube-api-access-88kv7\") pod \"kube-auth-proxy-85cfd86dcb-frkjz\" (UID: \"fd039da6-3ec2-4371-8aad-afef9ca665b9\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" Jun 14 15:04:33.991876 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.991843 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd039da6-3ec2-4371-8aad-afef9ca665b9-tmp\") pod \"kube-auth-proxy-85cfd86dcb-frkjz\" (UID: \"fd039da6-3ec2-4371-8aad-afef9ca665b9\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" Jun 14 15:04:33.992042 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.991890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd039da6-3ec2-4371-8aad-afef9ca665b9-tls-certs\") pod \"kube-auth-proxy-85cfd86dcb-frkjz\" (UID: \"fd039da6-3ec2-4371-8aad-afef9ca665b9\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" Jun 14 15:04:33.992042 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.991940 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88kv7\" (UniqueName: \"kubernetes.io/projected/fd039da6-3ec2-4371-8aad-afef9ca665b9-kube-api-access-88kv7\") pod \"kube-auth-proxy-85cfd86dcb-frkjz\" (UID: \"fd039da6-3ec2-4371-8aad-afef9ca665b9\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" Jun 14 15:04:33.994368 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.994341 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd039da6-3ec2-4371-8aad-afef9ca665b9-tmp\") pod \"kube-auth-proxy-85cfd86dcb-frkjz\" (UID: \"fd039da6-3ec2-4371-8aad-afef9ca665b9\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" Jun 14 15:04:33.994461 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.994447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd039da6-3ec2-4371-8aad-afef9ca665b9-tls-certs\") pod \"kube-auth-proxy-85cfd86dcb-frkjz\" (UID: \"fd039da6-3ec2-4371-8aad-afef9ca665b9\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" Jun 14 15:04:33.999365 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:33.999334 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88kv7\" (UniqueName: \"kubernetes.io/projected/fd039da6-3ec2-4371-8aad-afef9ca665b9-kube-api-access-88kv7\") pod \"kube-auth-proxy-85cfd86dcb-frkjz\" (UID: \"fd039da6-3ec2-4371-8aad-afef9ca665b9\") " pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" Jun 14 15:04:34.133508 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.133419 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" Jun 14 15:04:34.268158 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.268127 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz"] Jun 14 15:04:34.268957 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:04:34.268928 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd039da6_3ec2_4371_8aad_afef9ca665b9.slice/crio-f9b341c69c9348d81bf493b97506c4603c4f2c4137cd1a122cdeedddacde3a12 WatchSource:0}: Error finding container f9b341c69c9348d81bf493b97506c4603c4f2c4137cd1a122cdeedddacde3a12: Status 404 returned error can't find the container with id f9b341c69c9348d81bf493b97506c4603c4f2c4137cd1a122cdeedddacde3a12 Jun 14 15:04:34.780083 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.780043 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4wt7l"] Jun 14 15:04:34.783149 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.783133 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:34.785462 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.785411 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 14 15:04:34.785597 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.785579 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-k7gms\"" Jun 14 15:04:34.793176 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.793131 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4wt7l"] Jun 14 15:04:34.798539 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.798499 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5br8g\" (UniqueName: \"kubernetes.io/projected/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-kube-api-access-5br8g\") pod \"odh-model-controller-6dc94f689f-4wt7l\" (UID: \"ec082ef1-80c3-4f0b-a9ba-60ef08738e8f\") " pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:34.798675 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.798637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-cert\") pod \"odh-model-controller-6dc94f689f-4wt7l\" (UID: \"ec082ef1-80c3-4f0b-a9ba-60ef08738e8f\") " pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:34.900312 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.899890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-cert\") pod \"odh-model-controller-6dc94f689f-4wt7l\" (UID: \"ec082ef1-80c3-4f0b-a9ba-60ef08738e8f\") " pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:34.900312 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.900003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5br8g\" (UniqueName: \"kubernetes.io/projected/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-kube-api-access-5br8g\") pod \"odh-model-controller-6dc94f689f-4wt7l\" (UID: \"ec082ef1-80c3-4f0b-a9ba-60ef08738e8f\") " pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:34.900312 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:04:34.900031 2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 14 15:04:34.900312 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:04:34.900119 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-cert podName:ec082ef1-80c3-4f0b-a9ba-60ef08738e8f nodeName:}" failed. No retries permitted until 2026-06-14 15:04:35.40009673 +0000 UTC m=+573.051290094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-cert") pod "odh-model-controller-6dc94f689f-4wt7l" (UID: "ec082ef1-80c3-4f0b-a9ba-60ef08738e8f") : secret "odh-model-controller-webhook-cert" not found Jun 14 15:04:34.911506 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:34.911452 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5br8g\" (UniqueName: \"kubernetes.io/projected/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-kube-api-access-5br8g\") pod \"odh-model-controller-6dc94f689f-4wt7l\" (UID: \"ec082ef1-80c3-4f0b-a9ba-60ef08738e8f\") " pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:35.068696 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.068648 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" event={"ID":"fd039da6-3ec2-4371-8aad-afef9ca665b9","Type":"ContainerStarted","Data":"f9b341c69c9348d81bf493b97506c4603c4f2c4137cd1a122cdeedddacde3a12"} Jun 14 15:04:35.310841 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.310804 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-h5knv"] Jun 14 15:04:35.313732 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.313709 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-h5knv" Jun 14 15:04:35.316234 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.316207 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 14 15:04:35.316362 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.316241 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-66lfb\"" Jun 14 15:04:35.324169 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.324141 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-h5knv"] Jun 14 15:04:35.404122 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.404087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-cert\") pod \"odh-model-controller-6dc94f689f-4wt7l\" (UID: \"ec082ef1-80c3-4f0b-a9ba-60ef08738e8f\") " pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:35.404291 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.404128 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e51be3-6a53-441a-b495-ec6a4a2778e9-tls-certs\") pod \"model-serving-api-5dd488fc48-h5knv\" (UID: \"d3e51be3-6a53-441a-b495-ec6a4a2778e9\") " pod="opendatahub/model-serving-api-5dd488fc48-h5knv" Jun 14 15:04:35.404291 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.404160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6gjk\" (UniqueName: \"kubernetes.io/projected/d3e51be3-6a53-441a-b495-ec6a4a2778e9-kube-api-access-c6gjk\") pod \"model-serving-api-5dd488fc48-h5knv\" (UID: \"d3e51be3-6a53-441a-b495-ec6a4a2778e9\") " pod="opendatahub/model-serving-api-5dd488fc48-h5knv" Jun 14 15:04:35.404291 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:04:35.404262 2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 14 15:04:35.404456 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:04:35.404319 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-cert podName:ec082ef1-80c3-4f0b-a9ba-60ef08738e8f nodeName:}" failed. No retries permitted until 2026-06-14 15:04:36.404304833 +0000 UTC m=+574.055498179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-cert") pod "odh-model-controller-6dc94f689f-4wt7l" (UID: "ec082ef1-80c3-4f0b-a9ba-60ef08738e8f") : secret "odh-model-controller-webhook-cert" not found Jun 14 15:04:35.504867 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.504832 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e51be3-6a53-441a-b495-ec6a4a2778e9-tls-certs\") pod \"model-serving-api-5dd488fc48-h5knv\" (UID: \"d3e51be3-6a53-441a-b495-ec6a4a2778e9\") " pod="opendatahub/model-serving-api-5dd488fc48-h5knv" Jun 14 15:04:35.504867 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.504871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6gjk\" (UniqueName: \"kubernetes.io/projected/d3e51be3-6a53-441a-b495-ec6a4a2778e9-kube-api-access-c6gjk\") pod \"model-serving-api-5dd488fc48-h5knv\" (UID: \"d3e51be3-6a53-441a-b495-ec6a4a2778e9\") " pod="opendatahub/model-serving-api-5dd488fc48-h5knv" Jun 14 15:04:35.505073 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:04:35.504979 2572 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 14 15:04:35.505073 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:04:35.505052 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3e51be3-6a53-441a-b495-ec6a4a2778e9-tls-certs podName:d3e51be3-6a53-441a-b495-ec6a4a2778e9 nodeName:}" failed. No retries permitted until 2026-06-14 15:04:36.00503691 +0000 UTC m=+573.656230261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d3e51be3-6a53-441a-b495-ec6a4a2778e9-tls-certs") pod "model-serving-api-5dd488fc48-h5knv" (UID: "d3e51be3-6a53-441a-b495-ec6a4a2778e9") : secret "model-serving-api-tls" not found Jun 14 15:04:35.513577 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:35.513538 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6gjk\" (UniqueName: \"kubernetes.io/projected/d3e51be3-6a53-441a-b495-ec6a4a2778e9-kube-api-access-c6gjk\") pod \"model-serving-api-5dd488fc48-h5knv\" (UID: \"d3e51be3-6a53-441a-b495-ec6a4a2778e9\") " pod="opendatahub/model-serving-api-5dd488fc48-h5knv" Jun 14 15:04:36.009598 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.009535 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e51be3-6a53-441a-b495-ec6a4a2778e9-tls-certs\") pod \"model-serving-api-5dd488fc48-h5knv\" (UID: \"d3e51be3-6a53-441a-b495-ec6a4a2778e9\") " pod="opendatahub/model-serving-api-5dd488fc48-h5knv" Jun 14 15:04:36.013383 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.013350 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e51be3-6a53-441a-b495-ec6a4a2778e9-tls-certs\") pod \"model-serving-api-5dd488fc48-h5knv\" (UID: \"d3e51be3-6a53-441a-b495-ec6a4a2778e9\") " pod="opendatahub/model-serving-api-5dd488fc48-h5knv" Jun 14 15:04:36.086123 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.086087 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx"] Jun 14 15:04:36.093423 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.093187 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:36.095962 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.095933 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6sjq4\"" Jun 14 15:04:36.096187 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.096169 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 15:04:36.096403 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.096371 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 15:04:36.097627 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.097582 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx"] Jun 14 15:04:36.110880 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.110846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:36.110988 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.110943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:36.111107 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.111039 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tflhj\" (UniqueName: \"kubernetes.io/projected/a7fcae42-848a-4578-a1c1-3d5ba380a135-kube-api-access-tflhj\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:36.212297 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.211778 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:36.212297 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.211886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:36.212297 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.211950 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tflhj\" (UniqueName: \"kubernetes.io/projected/a7fcae42-848a-4578-a1c1-3d5ba380a135-kube-api-access-tflhj\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:36.212297 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.212208 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:36.212297 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.212238 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:36.220961 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.220905 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tflhj\" (UniqueName: \"kubernetes.io/projected/a7fcae42-848a-4578-a1c1-3d5ba380a135-kube-api-access-tflhj\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:36.228541 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.228505 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-h5knv" Jun 14 15:04:36.408805 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.408772 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:36.414354 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.414329 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-cert\") pod \"odh-model-controller-6dc94f689f-4wt7l\" (UID: \"ec082ef1-80c3-4f0b-a9ba-60ef08738e8f\") " pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:36.416816 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.416790 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec082ef1-80c3-4f0b-a9ba-60ef08738e8f-cert\") pod \"odh-model-controller-6dc94f689f-4wt7l\" (UID: \"ec082ef1-80c3-4f0b-a9ba-60ef08738e8f\") " pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:36.482692 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.482665 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-h5knv"] Jun 14 15:04:36.559767 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.559733 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx"] Jun 14 15:04:36.596761 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:36.596730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:37.080582 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:04:37.080391 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7fcae42_848a_4578_a1c1_3d5ba380a135.slice/crio-1ff7e2e2bada203724996b71873ad8a61c81d0191054fe3e88d1c477a5044a03 WatchSource:0}: Error finding container 1ff7e2e2bada203724996b71873ad8a61c81d0191054fe3e88d1c477a5044a03: Status 404 returned error can't find the container with id 1ff7e2e2bada203724996b71873ad8a61c81d0191054fe3e88d1c477a5044a03 Jun 14 15:04:37.084691 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:04:37.084643 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e51be3_6a53_441a_b495_ec6a4a2778e9.slice/crio-721dace7607870b2b6308e3b183c2ba9c4726d66278bd569569eaeb3484c6d96 WatchSource:0}: Error finding container 721dace7607870b2b6308e3b183c2ba9c4726d66278bd569569eaeb3484c6d96: Status 404 returned error can't find the container with id 721dace7607870b2b6308e3b183c2ba9c4726d66278bd569569eaeb3484c6d96 Jun 14 15:04:37.228376 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:37.228300 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4wt7l"] Jun 14 15:04:37.230713 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:04:37.230682 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec082ef1_80c3_4f0b_a9ba_60ef08738e8f.slice/crio-646255f7feaaf4c7583aa289ccbe3b15481578384d099254d3965ad14a51bcb3 WatchSource:0}: Error finding container 646255f7feaaf4c7583aa289ccbe3b15481578384d099254d3965ad14a51bcb3: Status 404 returned error can't find the container with id 646255f7feaaf4c7583aa289ccbe3b15481578384d099254d3965ad14a51bcb3 Jun 14 15:04:38.088934 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:38.088892 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" event={"ID":"fd039da6-3ec2-4371-8aad-afef9ca665b9","Type":"ContainerStarted","Data":"95622d791b6c10d9f8613093142daf4b25d865f69771cd64928f9572d70fdc24"} Jun 14 15:04:38.090311 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:38.090279 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" event={"ID":"ec082ef1-80c3-4f0b-a9ba-60ef08738e8f","Type":"ContainerStarted","Data":"646255f7feaaf4c7583aa289ccbe3b15481578384d099254d3965ad14a51bcb3"} Jun 14 15:04:38.092011 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:38.091985 2572 generic.go:356] "Generic (PLEG): container finished" podID="a7fcae42-848a-4578-a1c1-3d5ba380a135" containerID="6ceab511ede0ee752fe5940dea5c23813677314f117e450d6b601d93db75bd35" exitCode=0 Jun 14 15:04:38.092154 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:38.092064 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" event={"ID":"a7fcae42-848a-4578-a1c1-3d5ba380a135","Type":"ContainerDied","Data":"6ceab511ede0ee752fe5940dea5c23813677314f117e450d6b601d93db75bd35"} Jun 14 15:04:38.092154 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:38.092099 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" event={"ID":"a7fcae42-848a-4578-a1c1-3d5ba380a135","Type":"ContainerStarted","Data":"1ff7e2e2bada203724996b71873ad8a61c81d0191054fe3e88d1c477a5044a03"} Jun 14 15:04:38.093663 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:38.093627 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-h5knv" event={"ID":"d3e51be3-6a53-441a-b495-ec6a4a2778e9","Type":"ContainerStarted","Data":"721dace7607870b2b6308e3b183c2ba9c4726d66278bd569569eaeb3484c6d96"} Jun 14 15:04:38.105475 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:38.105435 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85cfd86dcb-frkjz" podStartSLOduration=2.246446397 podStartE2EDuration="5.10542177s" totalImagesPullingTime="2.858975373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:38.103251119 +0000 UTC m=+575.754444486" watchObservedRunningTime="2026-06-14 15:04:38.10542177 +0000 UTC m=+575.756615139" Jun 14 15:04:39.102165 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:39.102134 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-h5knv" event={"ID":"d3e51be3-6a53-441a-b495-ec6a4a2778e9","Type":"ContainerStarted","Data":"be1b0e80c56a58e63af23fc9a757a5483fc3ff0381600e52f57602b09b64c8df"} Jun 14 15:04:39.102604 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:39.102208 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-h5knv" Jun 14 15:04:39.127178 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:39.127028 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-h5knv" podStartSLOduration=2.194573765 podStartE2EDuration="4.126944165s" totalImagesPullingTime="1.9323704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:39.117495412 +0000 UTC m=+576.768688782" watchObservedRunningTime="2026-06-14 15:04:39.126944165 +0000 UTC m=+576.778137536" Jun 14 15:04:40.108716 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:40.108681 2572 generic.go:356] "Generic (PLEG): container finished" podID="a7fcae42-848a-4578-a1c1-3d5ba380a135" containerID="1442f2351ade8b8d0b377d2895fa6b8008d8de9f56e195ba39047f79526159a7" exitCode=0 Jun 14 15:04:40.109193 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:40.108768 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" event={"ID":"a7fcae42-848a-4578-a1c1-3d5ba380a135","Type":"ContainerDied","Data":"1442f2351ade8b8d0b377d2895fa6b8008d8de9f56e195ba39047f79526159a7"} Jun 14 15:04:41.116887 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:41.116851 2572 generic.go:356] "Generic (PLEG): container finished" podID="a7fcae42-848a-4578-a1c1-3d5ba380a135" containerID="78882d4f71fd864d48b112d7979361e5cb4f79941cc1acb923190ee93daebe39" exitCode=0 Jun 14 15:04:41.117325 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:41.116930 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" event={"ID":"a7fcae42-848a-4578-a1c1-3d5ba380a135","Type":"ContainerDied","Data":"78882d4f71fd864d48b112d7979361e5cb4f79941cc1acb923190ee93daebe39"} Jun 14 15:04:41.118416 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:41.118390 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" event={"ID":"ec082ef1-80c3-4f0b-a9ba-60ef08738e8f","Type":"ContainerStarted","Data":"93e002e20446a9c54ed817aaef3d41ee41065ce2afd6d9ac72f0dfd2dbfc7d6d"} Jun 14 15:04:41.118541 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:41.118437 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:41.191623 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:41.191543 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" podStartSLOduration=3.7697419290000003 podStartE2EDuration="7.191520922s" totalImagesPullingTime="3.421778993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:41.190554706 +0000 UTC m=+578.841748076" watchObservedRunningTime="2026-06-14 15:04:41.191520922 +0000 UTC m=+578.842714292" Jun 14 15:04:42.249973 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:42.249943 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:42.372814 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:42.372785 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-util\") pod \"a7fcae42-848a-4578-a1c1-3d5ba380a135\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " Jun 14 15:04:42.372986 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:42.372820 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-bundle\") pod \"a7fcae42-848a-4578-a1c1-3d5ba380a135\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " Jun 14 15:04:42.372986 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:42.372869 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tflhj\" (UniqueName: \"kubernetes.io/projected/a7fcae42-848a-4578-a1c1-3d5ba380a135-kube-api-access-tflhj\") pod \"a7fcae42-848a-4578-a1c1-3d5ba380a135\" (UID: \"a7fcae42-848a-4578-a1c1-3d5ba380a135\") " Jun 14 15:04:42.373818 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:42.373791 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-bundle" (OuterVolumeSpecName: "bundle") pod "a7fcae42-848a-4578-a1c1-3d5ba380a135" (UID: "a7fcae42-848a-4578-a1c1-3d5ba380a135"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:04:42.375090 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:42.375041 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7fcae42-848a-4578-a1c1-3d5ba380a135-kube-api-access-tflhj" (OuterVolumeSpecName: "kube-api-access-tflhj") pod "a7fcae42-848a-4578-a1c1-3d5ba380a135" (UID: "a7fcae42-848a-4578-a1c1-3d5ba380a135"). InnerVolumeSpecName "kube-api-access-tflhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:04:42.377902 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:42.377879 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-util" (OuterVolumeSpecName: "util") pod "a7fcae42-848a-4578-a1c1-3d5ba380a135" (UID: "a7fcae42-848a-4578-a1c1-3d5ba380a135"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:04:42.473924 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:42.473886 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tflhj\" (UniqueName: \"kubernetes.io/projected/a7fcae42-848a-4578-a1c1-3d5ba380a135-kube-api-access-tflhj\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:04:42.473924 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:42.473917 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-util\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:04:42.473924 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:42.473928 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7fcae42-848a-4578-a1c1-3d5ba380a135-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:04:43.130341 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:43.130267 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" event={"ID":"a7fcae42-848a-4578-a1c1-3d5ba380a135","Type":"ContainerDied","Data":"1ff7e2e2bada203724996b71873ad8a61c81d0191054fe3e88d1c477a5044a03"} Jun 14 15:04:43.130341 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:43.130310 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ff7e2e2bada203724996b71873ad8a61c81d0191054fe3e88d1c477a5044a03" Jun 14 15:04:43.130341 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:43.130313 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06pd9qx" Jun 14 15:04:44.023800 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.023768 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mf8wk"] Jun 14 15:04:44.024160 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.024121 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7fcae42-848a-4578-a1c1-3d5ba380a135" containerName="util" Jun 14 15:04:44.024160 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.024132 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7fcae42-848a-4578-a1c1-3d5ba380a135" containerName="util" Jun 14 15:04:44.024160 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.024149 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7fcae42-848a-4578-a1c1-3d5ba380a135" containerName="extract" Jun 14 15:04:44.024160 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.024155 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7fcae42-848a-4578-a1c1-3d5ba380a135" containerName="extract" Jun 14 15:04:44.024282 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.024171 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7fcae42-848a-4578-a1c1-3d5ba380a135" containerName="pull" Jun 14 15:04:44.024282 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.024178 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7fcae42-848a-4578-a1c1-3d5ba380a135" containerName="pull" Jun 14 15:04:44.024282 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.024229 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7fcae42-848a-4578-a1c1-3d5ba380a135" containerName="extract" Jun 14 15:04:44.027514 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.027495 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" Jun 14 15:04:44.030818 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.030796 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gjg4k\"" Jun 14 15:04:44.030968 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.030950 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 14 15:04:44.041187 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.038416 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh"] Jun 14 15:04:44.043938 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.043914 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" Jun 14 15:04:44.045598 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.045553 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mf8wk"] Jun 14 15:04:44.046554 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.046534 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 14 15:04:44.046672 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.046583 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2lftm\"" Jun 14 15:04:44.056899 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.056877 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh"] Jun 14 15:04:44.093018 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.092973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4977c193-23b3-4818-a407-12b0ebe4013a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p9jgh\" (UID: \"4977c193-23b3-4818-a407-12b0ebe4013a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" Jun 14 15:04:44.093018 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.093017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcc6b\" (UniqueName: \"kubernetes.io/projected/4977c193-23b3-4818-a407-12b0ebe4013a-kube-api-access-zcc6b\") pod \"llmisvc-controller-manager-864bfd7bc9-p9jgh\" (UID: \"4977c193-23b3-4818-a407-12b0ebe4013a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" Jun 14 15:04:44.093209 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.093087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8a5844b-eadc-450e-acfe-2f4195158268-cert\") pod \"kserve-controller-manager-69fc866d76-mf8wk\" (UID: \"a8a5844b-eadc-450e-acfe-2f4195158268\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" Jun 14 15:04:44.093209 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.093117 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6xrx\" (UniqueName: \"kubernetes.io/projected/a8a5844b-eadc-450e-acfe-2f4195158268-kube-api-access-m6xrx\") pod \"kserve-controller-manager-69fc866d76-mf8wk\" (UID: \"a8a5844b-eadc-450e-acfe-2f4195158268\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" Jun 14 15:04:44.193911 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.193877 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4977c193-23b3-4818-a407-12b0ebe4013a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p9jgh\" (UID: \"4977c193-23b3-4818-a407-12b0ebe4013a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" Jun 14 15:04:44.194157 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.193931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcc6b\" (UniqueName: \"kubernetes.io/projected/4977c193-23b3-4818-a407-12b0ebe4013a-kube-api-access-zcc6b\") pod \"llmisvc-controller-manager-864bfd7bc9-p9jgh\" (UID: \"4977c193-23b3-4818-a407-12b0ebe4013a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" Jun 14 15:04:44.194157 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:04:44.193987 2572 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 14 15:04:44.194157 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:04:44.194056 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4977c193-23b3-4818-a407-12b0ebe4013a-cert podName:4977c193-23b3-4818-a407-12b0ebe4013a nodeName:}" failed. No retries permitted until 2026-06-14 15:04:44.69403511 +0000 UTC m=+582.345228461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4977c193-23b3-4818-a407-12b0ebe4013a-cert") pod "llmisvc-controller-manager-864bfd7bc9-p9jgh" (UID: "4977c193-23b3-4818-a407-12b0ebe4013a") : secret "llmisvc-webhook-server-cert" not found Jun 14 15:04:44.194157 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.194079 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8a5844b-eadc-450e-acfe-2f4195158268-cert\") pod \"kserve-controller-manager-69fc866d76-mf8wk\" (UID: \"a8a5844b-eadc-450e-acfe-2f4195158268\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" Jun 14 15:04:44.194157 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.194131 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xrx\" (UniqueName: \"kubernetes.io/projected/a8a5844b-eadc-450e-acfe-2f4195158268-kube-api-access-m6xrx\") pod \"kserve-controller-manager-69fc866d76-mf8wk\" (UID: \"a8a5844b-eadc-450e-acfe-2f4195158268\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" Jun 14 15:04:44.197354 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.197329 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8a5844b-eadc-450e-acfe-2f4195158268-cert\") pod \"kserve-controller-manager-69fc866d76-mf8wk\" (UID: \"a8a5844b-eadc-450e-acfe-2f4195158268\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" Jun 14 15:04:44.202790 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.202757 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xrx\" (UniqueName: \"kubernetes.io/projected/a8a5844b-eadc-450e-acfe-2f4195158268-kube-api-access-m6xrx\") pod \"kserve-controller-manager-69fc866d76-mf8wk\" (UID: \"a8a5844b-eadc-450e-acfe-2f4195158268\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" Jun 14 15:04:44.202900 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.202842 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcc6b\" (UniqueName: \"kubernetes.io/projected/4977c193-23b3-4818-a407-12b0ebe4013a-kube-api-access-zcc6b\") pod \"llmisvc-controller-manager-864bfd7bc9-p9jgh\" (UID: \"4977c193-23b3-4818-a407-12b0ebe4013a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" Jun 14 15:04:44.344629 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.344595 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" Jun 14 15:04:44.502830 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.502806 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mf8wk"] Jun 14 15:04:44.504924 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:04:44.504898 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a5844b_eadc_450e_acfe_2f4195158268.slice/crio-267de6d67294979b04096a45802f6aae20f961eb296ddd72a0078300d57eff5d WatchSource:0}: Error finding container 267de6d67294979b04096a45802f6aae20f961eb296ddd72a0078300d57eff5d: Status 404 returned error can't find the container with id 267de6d67294979b04096a45802f6aae20f961eb296ddd72a0078300d57eff5d Jun 14 15:04:44.698933 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.698858 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4977c193-23b3-4818-a407-12b0ebe4013a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p9jgh\" (UID: \"4977c193-23b3-4818-a407-12b0ebe4013a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" Jun 14 15:04:44.701422 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.701403 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4977c193-23b3-4818-a407-12b0ebe4013a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p9jgh\" (UID: \"4977c193-23b3-4818-a407-12b0ebe4013a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" Jun 14 15:04:44.954719 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:44.954630 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" Jun 14 15:04:45.109465 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:45.109438 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh"] Jun 14 15:04:45.111970 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:04:45.111942 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4977c193_23b3_4818_a407_12b0ebe4013a.slice/crio-cecee80384aa031c95d2d115b6c6be8cef93438ab0b4f4141047ecd5f369bdd1 WatchSource:0}: Error finding container cecee80384aa031c95d2d115b6c6be8cef93438ab0b4f4141047ecd5f369bdd1: Status 404 returned error can't find the container with id cecee80384aa031c95d2d115b6c6be8cef93438ab0b4f4141047ecd5f369bdd1 Jun 14 15:04:45.141410 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:45.141382 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" event={"ID":"4977c193-23b3-4818-a407-12b0ebe4013a","Type":"ContainerStarted","Data":"cecee80384aa031c95d2d115b6c6be8cef93438ab0b4f4141047ecd5f369bdd1"} Jun 14 15:04:45.142618 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:45.142592 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" event={"ID":"a8a5844b-eadc-450e-acfe-2f4195158268","Type":"ContainerStarted","Data":"267de6d67294979b04096a45802f6aae20f961eb296ddd72a0078300d57eff5d"} Jun 14 15:04:48.164354 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:48.164325 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" event={"ID":"a8a5844b-eadc-450e-acfe-2f4195158268","Type":"ContainerStarted","Data":"d67887ba6c3935da975dcb9bb01f46c1876f98acd1e38b898253a69b4a4f68ff"} Jun 14 15:04:48.164723 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:48.164465 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" Jun 14 15:04:48.183663 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:48.183622 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" podStartSLOduration=2.32260881 podStartE2EDuration="5.183607722s" totalImagesPullingTime="2.860998912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:48.181380141 +0000 UTC m=+585.832573514" watchObservedRunningTime="2026-06-14 15:04:48.183607722 +0000 UTC m=+585.834801092" Jun 14 15:04:49.171120 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.171069 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" event={"ID":"4977c193-23b3-4818-a407-12b0ebe4013a","Type":"ContainerStarted","Data":"e6ed8c029ee7df5643fc4497f7b9c6ec9c246770d7c6b11afe68210fc0d6cd7a"} Jun 14 15:04:49.171590 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.171143 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" Jun 14 15:04:49.224523 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.224476 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" podStartSLOduration=2.217566723 podStartE2EDuration="5.224462082s" totalImagesPullingTime="3.006895359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:04:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:49.220925107 +0000 UTC m=+586.872118475" watchObservedRunningTime="2026-06-14 15:04:49.224462082 +0000 UTC m=+586.875655816" Jun 14 15:04:49.823251 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.823217 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr"] Jun 14 15:04:49.827083 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.827068 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:49.829848 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.829824 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 15:04:49.829969 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.829824 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 15:04:49.829969 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.829827 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6sjq4\"" Jun 14 15:04:49.848096 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.848066 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr"] Jun 14 15:04:49.946115 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.946082 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flgh2\" (UniqueName: \"kubernetes.io/projected/698ed1e1-8bed-484f-940d-7361a22d611d-kube-api-access-flgh2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:49.946269 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.946121 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:49.946269 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:49.946142 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:50.047066 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.047026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flgh2\" (UniqueName: \"kubernetes.io/projected/698ed1e1-8bed-484f-940d-7361a22d611d-kube-api-access-flgh2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:50.047066 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.047067 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:50.047317 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.047089 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:50.047477 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.047455 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:50.047524 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.047513 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:50.067697 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.067664 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flgh2\" (UniqueName: \"kubernetes.io/projected/698ed1e1-8bed-484f-940d-7361a22d611d-kube-api-access-flgh2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:50.136948 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.136864 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:50.343833 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:04:50.343790 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698ed1e1_8bed_484f_940d_7361a22d611d.slice/crio-b29a81f7d40fc04df22e1c6f70a52c84881c2c33bb544234383207f28aa043fb WatchSource:0}: Error finding container b29a81f7d40fc04df22e1c6f70a52c84881c2c33bb544234383207f28aa043fb: Status 404 returned error can't find the container with id b29a81f7d40fc04df22e1c6f70a52c84881c2c33bb544234383207f28aa043fb Jun 14 15:04:50.344720 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.344682 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr"] Jun 14 15:04:50.562230 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.562192 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-f68ccfc94-hkbh8"] Jun 14 15:04:50.565724 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.565701 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f68ccfc94-hkbh8" Jun 14 15:04:50.568691 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.568662 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vgt2v\"" Jun 14 15:04:50.568799 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.568753 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 15:04:50.594125 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.594091 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f68ccfc94-hkbh8"] Jun 14 15:04:50.652655 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.652549 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdw4p\" (UniqueName: \"kubernetes.io/projected/bf8c11af-0505-4525-b142-70ff1e1c4efb-kube-api-access-mdw4p\") pod \"dashboard-redirect-f68ccfc94-hkbh8\" (UID: \"bf8c11af-0505-4525-b142-70ff1e1c4efb\") " pod="opendatahub/dashboard-redirect-f68ccfc94-hkbh8" Jun 14 15:04:50.652803 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.652679 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/bf8c11af-0505-4525-b142-70ff1e1c4efb-redirect-config\") pod \"dashboard-redirect-f68ccfc94-hkbh8\" (UID: \"bf8c11af-0505-4525-b142-70ff1e1c4efb\") " pod="opendatahub/dashboard-redirect-f68ccfc94-hkbh8" Jun 14 15:04:50.753972 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.753936 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdw4p\" (UniqueName: \"kubernetes.io/projected/bf8c11af-0505-4525-b142-70ff1e1c4efb-kube-api-access-mdw4p\") pod \"dashboard-redirect-f68ccfc94-hkbh8\" (UID: \"bf8c11af-0505-4525-b142-70ff1e1c4efb\") " pod="opendatahub/dashboard-redirect-f68ccfc94-hkbh8" Jun 14 15:04:50.754175 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.754002 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/bf8c11af-0505-4525-b142-70ff1e1c4efb-redirect-config\") pod \"dashboard-redirect-f68ccfc94-hkbh8\" (UID: \"bf8c11af-0505-4525-b142-70ff1e1c4efb\") " pod="opendatahub/dashboard-redirect-f68ccfc94-hkbh8" Jun 14 15:04:50.754683 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.754665 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/bf8c11af-0505-4525-b142-70ff1e1c4efb-redirect-config\") pod \"dashboard-redirect-f68ccfc94-hkbh8\" (UID: \"bf8c11af-0505-4525-b142-70ff1e1c4efb\") " pod="opendatahub/dashboard-redirect-f68ccfc94-hkbh8" Jun 14 15:04:50.765276 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.765251 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdw4p\" (UniqueName: \"kubernetes.io/projected/bf8c11af-0505-4525-b142-70ff1e1c4efb-kube-api-access-mdw4p\") pod \"dashboard-redirect-f68ccfc94-hkbh8\" (UID: \"bf8c11af-0505-4525-b142-70ff1e1c4efb\") " pod="opendatahub/dashboard-redirect-f68ccfc94-hkbh8" Jun 14 15:04:50.875760 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:50.875725 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f68ccfc94-hkbh8" Jun 14 15:04:51.033784 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.033760 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f68ccfc94-hkbh8"] Jun 14 15:04:51.035428 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:04:51.035402 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf8c11af_0505_4525_b142_70ff1e1c4efb.slice/crio-456e03507edec96f9e9ae8ccdcebcaa0f3e0d055e441aed8f8bc12302f016618 WatchSource:0}: Error finding container 456e03507edec96f9e9ae8ccdcebcaa0f3e0d055e441aed8f8bc12302f016618: Status 404 returned error can't find the container with id 456e03507edec96f9e9ae8ccdcebcaa0f3e0d055e441aed8f8bc12302f016618 Jun 14 15:04:51.122582 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.122542 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-h5knv" Jun 14 15:04:51.183974 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.183888 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f68ccfc94-hkbh8" event={"ID":"bf8c11af-0505-4525-b142-70ff1e1c4efb","Type":"ContainerStarted","Data":"456e03507edec96f9e9ae8ccdcebcaa0f3e0d055e441aed8f8bc12302f016618"} Jun 14 15:04:51.185807 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.185780 2572 generic.go:356] "Generic (PLEG): container finished" podID="698ed1e1-8bed-484f-940d-7361a22d611d" containerID="74a026b68e610b4582e42926344051eff00c7f5d5ad721071c171d1221d208e8" exitCode=0 Jun 14 15:04:51.185931 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.185862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" event={"ID":"698ed1e1-8bed-484f-940d-7361a22d611d","Type":"ContainerDied","Data":"74a026b68e610b4582e42926344051eff00c7f5d5ad721071c171d1221d208e8"} Jun 14 15:04:51.185931 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.185911 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" event={"ID":"698ed1e1-8bed-484f-940d-7361a22d611d","Type":"ContainerStarted","Data":"b29a81f7d40fc04df22e1c6f70a52c84881c2c33bb544234383207f28aa043fb"} Jun 14 15:04:51.352529 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.352492 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-z8278"] Jun 14 15:04:51.357142 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.357121 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" Jun 14 15:04:51.360479 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.360454 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 14 15:04:51.360638 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.360485 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 14 15:04:51.362819 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.362797 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-r4v7x\"" Jun 14 15:04:51.391295 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.385556 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-z8278"] Jun 14 15:04:51.460423 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.460328 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/03a83732-0fec-4930-ab5c-577cf83b3796-operator-config\") pod \"servicemesh-operator3-57f65f65fb-z8278\" (UID: \"03a83732-0fec-4930-ab5c-577cf83b3796\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" Jun 14 15:04:51.460423 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.460366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rnbx\" (UniqueName: \"kubernetes.io/projected/03a83732-0fec-4930-ab5c-577cf83b3796-kube-api-access-7rnbx\") pod \"servicemesh-operator3-57f65f65fb-z8278\" (UID: \"03a83732-0fec-4930-ab5c-577cf83b3796\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" Jun 14 15:04:51.561703 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.561665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/03a83732-0fec-4930-ab5c-577cf83b3796-operator-config\") pod \"servicemesh-operator3-57f65f65fb-z8278\" (UID: \"03a83732-0fec-4930-ab5c-577cf83b3796\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" Jun 14 15:04:51.561703 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.561704 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rnbx\" (UniqueName: \"kubernetes.io/projected/03a83732-0fec-4930-ab5c-577cf83b3796-kube-api-access-7rnbx\") pod \"servicemesh-operator3-57f65f65fb-z8278\" (UID: \"03a83732-0fec-4930-ab5c-577cf83b3796\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" Jun 14 15:04:51.564310 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.564289 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/03a83732-0fec-4930-ab5c-577cf83b3796-operator-config\") pod \"servicemesh-operator3-57f65f65fb-z8278\" (UID: \"03a83732-0fec-4930-ab5c-577cf83b3796\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" Jun 14 15:04:51.575639 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.575616 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rnbx\" (UniqueName: \"kubernetes.io/projected/03a83732-0fec-4930-ab5c-577cf83b3796-kube-api-access-7rnbx\") pod \"servicemesh-operator3-57f65f65fb-z8278\" (UID: \"03a83732-0fec-4930-ab5c-577cf83b3796\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" Jun 14 15:04:51.667250 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.667220 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" Jun 14 15:04:51.827759 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:51.827735 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-z8278"] Jun 14 15:04:51.831333 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:04:51.831301 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a83732_0fec_4930_ab5c_577cf83b3796.slice/crio-56f68fe01891c7a68c16ea354e494477bf1aee82e1d59fee11178ad6987160f0 WatchSource:0}: Error finding container 56f68fe01891c7a68c16ea354e494477bf1aee82e1d59fee11178ad6987160f0: Status 404 returned error can't find the container with id 56f68fe01891c7a68c16ea354e494477bf1aee82e1d59fee11178ad6987160f0 Jun 14 15:04:52.126337 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:52.126299 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-4wt7l" Jun 14 15:04:52.201078 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:52.197462 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" event={"ID":"03a83732-0fec-4930-ab5c-577cf83b3796","Type":"ContainerStarted","Data":"56f68fe01891c7a68c16ea354e494477bf1aee82e1d59fee11178ad6987160f0"} Jun 14 15:04:52.203806 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:52.203359 2572 generic.go:356] "Generic (PLEG): container finished" podID="698ed1e1-8bed-484f-940d-7361a22d611d" containerID="c7041bea9d7365f02a536dcb419551bf62daa0c03375ef886c957edbe02e94b1" exitCode=0 Jun 14 15:04:52.203806 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:52.203397 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" event={"ID":"698ed1e1-8bed-484f-940d-7361a22d611d","Type":"ContainerDied","Data":"c7041bea9d7365f02a536dcb419551bf62daa0c03375ef886c957edbe02e94b1"} Jun 14 15:04:53.213185 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:53.213138 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f68ccfc94-hkbh8" event={"ID":"bf8c11af-0505-4525-b142-70ff1e1c4efb","Type":"ContainerStarted","Data":"d7264f6f9b2a3b9565086b22a08a27d7b7956af51c2de781439920e84ad60683"} Jun 14 15:04:53.217466 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:53.217427 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" event={"ID":"698ed1e1-8bed-484f-940d-7361a22d611d","Type":"ContainerStarted","Data":"60fe483280d2a099aefcb92a5ab47456c286e8581d24444931c2d5ebe0884e63"} Jun 14 15:04:53.271883 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:53.271799 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-f68ccfc94-hkbh8" podStartSLOduration=1.250414807 podStartE2EDuration="3.271779199s" totalImagesPullingTime="2.021364392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:04:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:53.261152249 +0000 UTC m=+590.912345620" watchObservedRunningTime="2026-06-14 15:04:53.271779199 +0000 UTC m=+590.922972569" Jun 14 15:04:53.292788 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:53.291664 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" podStartSLOduration=3.658658799 podStartE2EDuration="4.291644291s" totalImagesPullingTime="632.985492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:53.290256688 +0000 UTC m=+590.941450052" watchObservedRunningTime="2026-06-14 15:04:53.291644291 +0000 UTC m=+590.942837661" Jun 14 15:04:54.226142 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:54.226101 2572 generic.go:356] "Generic (PLEG): container finished" podID="698ed1e1-8bed-484f-940d-7361a22d611d" containerID="60fe483280d2a099aefcb92a5ab47456c286e8581d24444931c2d5ebe0884e63" exitCode=0 Jun 14 15:04:54.226622 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:54.226192 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" event={"ID":"698ed1e1-8bed-484f-940d-7361a22d611d","Type":"ContainerDied","Data":"60fe483280d2a099aefcb92a5ab47456c286e8581d24444931c2d5ebe0884e63"} Jun 14 15:04:55.235515 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.235402 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" event={"ID":"03a83732-0fec-4930-ab5c-577cf83b3796","Type":"ContainerStarted","Data":"df9ef777b6646798378bebc1d4d6b03c1959e5428d404deb11bfc40df862b577"} Jun 14 15:04:55.235515 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.235488 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" Jun 14 15:04:55.262537 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.262477 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" podStartSLOduration=1.217329336 podStartE2EDuration="4.262456083s" totalImagesPullingTime="3.045126747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:55.2581232 +0000 UTC m=+592.909316580" watchObservedRunningTime="2026-06-14 15:04:55.262456083 +0000 UTC m=+592.913649454" Jun 14 15:04:55.396806 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.396776 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:55.501064 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.500349 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-bundle\") pod \"698ed1e1-8bed-484f-940d-7361a22d611d\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " Jun 14 15:04:55.501064 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.500412 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flgh2\" (UniqueName: \"kubernetes.io/projected/698ed1e1-8bed-484f-940d-7361a22d611d-kube-api-access-flgh2\") pod \"698ed1e1-8bed-484f-940d-7361a22d611d\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " Jun 14 15:04:55.501064 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.500504 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-util\") pod \"698ed1e1-8bed-484f-940d-7361a22d611d\" (UID: \"698ed1e1-8bed-484f-940d-7361a22d611d\") " Jun 14 15:04:55.502047 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.501427 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-bundle" (OuterVolumeSpecName: "bundle") pod "698ed1e1-8bed-484f-940d-7361a22d611d" (UID: "698ed1e1-8bed-484f-940d-7361a22d611d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:04:55.503489 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.503463 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698ed1e1-8bed-484f-940d-7361a22d611d-kube-api-access-flgh2" (OuterVolumeSpecName: "kube-api-access-flgh2") pod "698ed1e1-8bed-484f-940d-7361a22d611d" (UID: "698ed1e1-8bed-484f-940d-7361a22d611d"). InnerVolumeSpecName "kube-api-access-flgh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:04:55.507616 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.507586 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-util" (OuterVolumeSpecName: "util") pod "698ed1e1-8bed-484f-940d-7361a22d611d" (UID: "698ed1e1-8bed-484f-940d-7361a22d611d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:04:55.601863 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.601833 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-util\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:04:55.601863 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.601863 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/698ed1e1-8bed-484f-940d-7361a22d611d-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:04:55.602024 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:55.601877 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flgh2\" (UniqueName: \"kubernetes.io/projected/698ed1e1-8bed-484f-940d-7361a22d611d-kube-api-access-flgh2\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:04:56.242249 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:56.242220 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" Jun 14 15:04:56.242671 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:56.242219 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762at2bzr" event={"ID":"698ed1e1-8bed-484f-940d-7361a22d611d","Type":"ContainerDied","Data":"b29a81f7d40fc04df22e1c6f70a52c84881c2c33bb544234383207f28aa043fb"} Jun 14 15:04:56.242671 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:56.242392 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b29a81f7d40fc04df22e1c6f70a52c84881c2c33bb544234383207f28aa043fb" Jun 14 15:04:57.350063 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.350029 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bb7965ffc-wkhqc"] Jun 14 15:04:57.350607 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.350588 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698ed1e1-8bed-484f-940d-7361a22d611d" containerName="extract" Jun 14 15:04:57.350691 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.350609 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="698ed1e1-8bed-484f-940d-7361a22d611d" containerName="extract" Jun 14 15:04:57.350691 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.350631 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698ed1e1-8bed-484f-940d-7361a22d611d" containerName="util" Jun 14 15:04:57.350691 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.350640 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="698ed1e1-8bed-484f-940d-7361a22d611d" containerName="util" Jun 14 15:04:57.350691 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.350680 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698ed1e1-8bed-484f-940d-7361a22d611d" containerName="pull" Jun 14 15:04:57.350691 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.350689 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="698ed1e1-8bed-484f-940d-7361a22d611d" containerName="pull" Jun 14 15:04:57.350929 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.350784 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="698ed1e1-8bed-484f-940d-7361a22d611d" containerName="extract" Jun 14 15:04:57.354231 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.354207 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.388077 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.388047 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb7965ffc-wkhqc"] Jun 14 15:04:57.418965 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.418936 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-console-serving-cert\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.419152 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.418968 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-oauth-serving-cert\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.419152 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.418985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lzkx\" (UniqueName: \"kubernetes.io/projected/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-kube-api-access-5lzkx\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.419152 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.419034 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-trusted-ca-bundle\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.419152 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.419070 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-console-oauth-config\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.419152 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.419086 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-service-ca\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.419152 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.419104 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-console-config\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.520605 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.520540 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-console-serving-cert\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.520605 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.520604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-oauth-serving-cert\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.520835 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.520629 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lzkx\" (UniqueName: \"kubernetes.io/projected/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-kube-api-access-5lzkx\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.520835 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.520672 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-trusted-ca-bundle\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.520835 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.520710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-console-oauth-config\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.520835 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.520734 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-service-ca\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.520835 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.520816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-console-config\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.521587 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.521536 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-oauth-serving-cert\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.521730 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.521632 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-service-ca\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.521730 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.521654 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-console-config\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.521730 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.521697 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-trusted-ca-bundle\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.523308 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.523288 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-console-serving-cert\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.523308 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.523301 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-console-oauth-config\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.530026 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.530002 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lzkx\" (UniqueName: \"kubernetes.io/projected/a20fa96d-ba85-4d1e-a961-d8cf4bac7407-kube-api-access-5lzkx\") pod \"console-bb7965ffc-wkhqc\" (UID: \"a20fa96d-ba85-4d1e-a961-d8cf4bac7407\") " pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.663599 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.663496 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:04:57.808570 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:57.808531 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb7965ffc-wkhqc"] Jun 14 15:04:57.810255 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:04:57.810218 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20fa96d_ba85_4d1e_a961_d8cf4bac7407.slice/crio-25e99e9b03489e9bf03264f408a5a4ba81e6ff6116df4c98e6a2de07925113a7 WatchSource:0}: Error finding container 25e99e9b03489e9bf03264f408a5a4ba81e6ff6116df4c98e6a2de07925113a7: Status 404 returned error can't find the container with id 25e99e9b03489e9bf03264f408a5a4ba81e6ff6116df4c98e6a2de07925113a7 Jun 14 15:04:58.254521 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:58.254484 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb7965ffc-wkhqc" event={"ID":"a20fa96d-ba85-4d1e-a961-d8cf4bac7407","Type":"ContainerStarted","Data":"90ed4dbfd8727d287ff03f0370c2e2ae52180b7541057d07c124a09abc7bb9fb"} Jun 14 15:04:58.254715 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:58.254531 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb7965ffc-wkhqc" event={"ID":"a20fa96d-ba85-4d1e-a961-d8cf4bac7407","Type":"ContainerStarted","Data":"25e99e9b03489e9bf03264f408a5a4ba81e6ff6116df4c98e6a2de07925113a7"} Jun 14 15:04:58.278233 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:04:58.278157 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bb7965ffc-wkhqc" podStartSLOduration=1.27813688 podStartE2EDuration="1.27813688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:04:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:04:58.273614653 +0000 UTC m=+595.924808025" watchObservedRunningTime="2026-06-14 15:04:58.27813688 +0000 UTC m=+595.929330251" Jun 14 15:05:02.810011 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:02.809981 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:05:02.810972 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:02.810953 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:05:02.814972 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:02.814952 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:05:02.815717 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:02.815694 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:05:06.245241 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:06.245180 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-z8278" Jun 14 15:05:07.664048 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:07.664012 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:05:07.666323 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:07.664073 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:05:07.669763 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:07.669737 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:05:08.317026 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:08.316996 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bb7965ffc-wkhqc" Jun 14 15:05:08.417154 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:08.417123 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f75d786c8-57kpn"] Jun 14 15:05:11.233918 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.233877 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc"] Jun 14 15:05:11.304173 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.304138 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc"] Jun 14 15:05:11.304337 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.304256 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.307026 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.307004 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 14 15:05:11.307175 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.307010 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 15:05:11.307175 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.307041 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 14 15:05:11.307175 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.307043 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 14 15:05:11.307175 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.307057 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4b82m\"" Jun 14 15:05:11.450809 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.450770 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/13a9f168-a27d-4b43-87e9-518285ea6d8a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.450809 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.450811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.451041 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.450854 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.451041 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.450911 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.451041 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.450942 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/13a9f168-a27d-4b43-87e9-518285ea6d8a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.451041 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.450984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x9s2\" (UniqueName: \"kubernetes.io/projected/13a9f168-a27d-4b43-87e9-518285ea6d8a-kube-api-access-5x9s2\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.451236 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.451056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.552370 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.552330 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x9s2\" (UniqueName: \"kubernetes.io/projected/13a9f168-a27d-4b43-87e9-518285ea6d8a-kube-api-access-5x9s2\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.552557 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.552382 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.552557 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.552440 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/13a9f168-a27d-4b43-87e9-518285ea6d8a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.552557 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.552466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.552557 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.552542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.552803 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.552623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.552803 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.552679 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/13a9f168-a27d-4b43-87e9-518285ea6d8a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.553454 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.553425 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.555080 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.555051 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.555175 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.555127 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.555247 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.555226 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/13a9f168-a27d-4b43-87e9-518285ea6d8a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.555320 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.555302 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/13a9f168-a27d-4b43-87e9-518285ea6d8a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.560060 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.560037 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13a9f168-a27d-4b43-87e9-518285ea6d8a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.560149 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.560079 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x9s2\" (UniqueName: \"kubernetes.io/projected/13a9f168-a27d-4b43-87e9-518285ea6d8a-kube-api-access-5x9s2\") pod \"istiod-openshift-gateway-75c67f8887-fb6cc\" (UID: \"13a9f168-a27d-4b43-87e9-518285ea6d8a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.613653 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.613623 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:11.801594 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:11.801548 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc"] Jun 14 15:05:11.803320 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:05:11.803261 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a9f168_a27d_4b43_87e9_518285ea6d8a.slice/crio-fc93f7616751c7a5150bb99819efeaf3f9878749f44249d6b5d85f1ba9e5216d WatchSource:0}: Error finding container fc93f7616751c7a5150bb99819efeaf3f9878749f44249d6b5d85f1ba9e5216d: Status 404 returned error can't find the container with id fc93f7616751c7a5150bb99819efeaf3f9878749f44249d6b5d85f1ba9e5216d Jun 14 15:05:12.335655 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:12.335613 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" event={"ID":"13a9f168-a27d-4b43-87e9-518285ea6d8a","Type":"ContainerStarted","Data":"fc93f7616751c7a5150bb99819efeaf3f9878749f44249d6b5d85f1ba9e5216d"} Jun 14 15:05:15.553699 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:15.553654 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 14 15:05:15.553945 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:15.553727 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 14 15:05:16.365227 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:16.365191 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" event={"ID":"13a9f168-a27d-4b43-87e9-518285ea6d8a","Type":"ContainerStarted","Data":"bf48c0cac7b884aab9fadea09ea3c3e1104c8005e961c6a24a3a80fac0a1efd5"} Jun 14 15:05:16.366687 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:16.366660 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:16.368652 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:16.368616 2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-fb6cc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 14 15:05:16.368772 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:16.368688 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" podUID="13a9f168-a27d-4b43-87e9-518285ea6d8a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 15:05:16.391278 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:16.391217 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" podStartSLOduration=1.643343405 podStartE2EDuration="5.391197556s" totalImagesPullingTime="3.747854151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:05:16.389210169 +0000 UTC m=+614.040403539" watchObservedRunningTime="2026-06-14 15:05:16.391197556 +0000 UTC m=+614.042390931" Jun 14 15:05:17.371726 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:17.371695 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fb6cc" Jun 14 15:05:19.176039 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:19.176007 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mf8wk" Jun 14 15:05:20.178703 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:20.178668 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p9jgh" Jun 14 15:05:33.437333 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.437270 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f75d786c8-57kpn" podUID="0327348e-aaeb-4973-a56f-a438882b0c73" containerName="console" containerID="cri-o://39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5" gracePeriod=15 Jun 14 15:05:33.696634 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.696581 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:05:33.748255 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.748229 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-oauth-serving-cert\") pod \"0327348e-aaeb-4973-a56f-a438882b0c73\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " Jun 14 15:05:33.748414 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.748287 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-service-ca\") pod \"0327348e-aaeb-4973-a56f-a438882b0c73\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " Jun 14 15:05:33.748414 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.748311 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-serving-cert\") pod \"0327348e-aaeb-4973-a56f-a438882b0c73\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " Jun 14 15:05:33.748414 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.748339 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-oauth-config\") pod \"0327348e-aaeb-4973-a56f-a438882b0c73\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " Jun 14 15:05:33.748414 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.748412 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-console-config\") pod \"0327348e-aaeb-4973-a56f-a438882b0c73\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " Jun 14 15:05:33.748657 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.748442 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c85mm\" (UniqueName: \"kubernetes.io/projected/0327348e-aaeb-4973-a56f-a438882b0c73-kube-api-access-c85mm\") pod \"0327348e-aaeb-4973-a56f-a438882b0c73\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " Jun 14 15:05:33.748657 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.748469 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-trusted-ca-bundle\") pod \"0327348e-aaeb-4973-a56f-a438882b0c73\" (UID: \"0327348e-aaeb-4973-a56f-a438882b0c73\") " Jun 14 15:05:33.748770 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.748740 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0327348e-aaeb-4973-a56f-a438882b0c73" (UID: "0327348e-aaeb-4973-a56f-a438882b0c73"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:05:33.748859 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.748835 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-service-ca" (OuterVolumeSpecName: "service-ca") pod "0327348e-aaeb-4973-a56f-a438882b0c73" (UID: "0327348e-aaeb-4973-a56f-a438882b0c73"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:05:33.748859 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.748847 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-console-config" (OuterVolumeSpecName: "console-config") pod "0327348e-aaeb-4973-a56f-a438882b0c73" (UID: "0327348e-aaeb-4973-a56f-a438882b0c73"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:05:33.749206 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.749132 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0327348e-aaeb-4973-a56f-a438882b0c73" (UID: "0327348e-aaeb-4973-a56f-a438882b0c73"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:05:33.750793 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.750771 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0327348e-aaeb-4973-a56f-a438882b0c73" (UID: "0327348e-aaeb-4973-a56f-a438882b0c73"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:05:33.750793 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.750783 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0327348e-aaeb-4973-a56f-a438882b0c73-kube-api-access-c85mm" (OuterVolumeSpecName: "kube-api-access-c85mm") pod "0327348e-aaeb-4973-a56f-a438882b0c73" (UID: "0327348e-aaeb-4973-a56f-a438882b0c73"). InnerVolumeSpecName "kube-api-access-c85mm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:05:33.750928 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.750810 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0327348e-aaeb-4973-a56f-a438882b0c73" (UID: "0327348e-aaeb-4973-a56f-a438882b0c73"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:05:33.849838 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.849806 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-service-ca\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:33.849838 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.849831 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-serving-cert\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:33.849838 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.849840 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0327348e-aaeb-4973-a56f-a438882b0c73-console-oauth-config\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:33.850055 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.849849 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-console-config\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:33.850055 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.849857 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c85mm\" (UniqueName: \"kubernetes.io/projected/0327348e-aaeb-4973-a56f-a438882b0c73-kube-api-access-c85mm\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:33.850055 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.849872 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-trusted-ca-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:33.850055 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:33.849880 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0327348e-aaeb-4973-a56f-a438882b0c73-oauth-serving-cert\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:34.474078 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:34.474031 2572 generic.go:356] "Generic (PLEG): container finished" podID="0327348e-aaeb-4973-a56f-a438882b0c73" containerID="39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5" exitCode=0 Jun 14 15:05:34.474078 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:34.474061 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f75d786c8-57kpn" Jun 14 15:05:34.474527 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:34.474099 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f75d786c8-57kpn" event={"ID":"0327348e-aaeb-4973-a56f-a438882b0c73","Type":"ContainerDied","Data":"39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5"} Jun 14 15:05:34.474527 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:34.474147 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f75d786c8-57kpn" event={"ID":"0327348e-aaeb-4973-a56f-a438882b0c73","Type":"ContainerDied","Data":"22716314c6ae6f0e45b0594467a93299ae4cd738a0fab01bf336803b4425a222"} Jun 14 15:05:34.474527 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:34.474167 2572 scope.go:117] "RemoveContainer" containerID="39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5" Jun 14 15:05:34.483706 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:34.483691 2572 scope.go:117] "RemoveContainer" containerID="39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5" Jun 14 15:05:34.483986 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:05:34.483968 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5\": container with ID starting with 39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5 not found: ID does not exist" containerID="39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5" Jun 14 15:05:34.484031 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:34.483996 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5"} err="failed to get container status \"39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5\": rpc error: code = NotFound desc = could not find container \"39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5\": container with ID starting with 39ccd417aad0eb1786a88da05ed489193fbe887346498993a002b7d7556503c5 not found: ID does not exist" Jun 14 15:05:34.496179 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:05:34.496145 2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0327348e_aaeb_4973_a56f_a438882b0c73.slice\": RecentStats: unable to find data in memory cache]" Jun 14 15:05:34.499003 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:34.498979 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f75d786c8-57kpn"] Jun 14 15:05:34.502723 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:34.502701 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f75d786c8-57kpn"] Jun 14 15:05:34.807337 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:34.807304 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0327348e-aaeb-4973-a56f-a438882b0c73" path="/var/lib/kubelet/pods/0327348e-aaeb-4973-a56f-a438882b0c73/volumes" Jun 14 15:05:51.810417 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.810384 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845"] Jun 14 15:05:51.810875 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.810805 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0327348e-aaeb-4973-a56f-a438882b0c73" containerName="console" Jun 14 15:05:51.810875 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.810818 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0327348e-aaeb-4973-a56f-a438882b0c73" containerName="console" Jun 14 15:05:51.810949 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.810889 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0327348e-aaeb-4973-a56f-a438882b0c73" containerName="console" Jun 14 15:05:51.813263 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.813246 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:51.815775 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.815755 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 15:05:51.816690 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.816675 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gm2s6\"" Jun 14 15:05:51.816784 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.816677 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 15:05:51.822643 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.822619 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845"] Jun 14 15:05:51.903276 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.903238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:51.903456 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.903310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:51.903456 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:51.903381 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68p6m\" (UniqueName: \"kubernetes.io/projected/14ae425b-9d65-4cf0-a251-a2399ff773a6-kube-api-access-68p6m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:52.003790 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.003750 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:52.003976 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.003894 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68p6m\" (UniqueName: \"kubernetes.io/projected/14ae425b-9d65-4cf0-a251-a2399ff773a6-kube-api-access-68p6m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:52.003976 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.003952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:52.004154 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.004134 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:52.004269 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.004252 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:52.012937 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.012912 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68p6m\" (UniqueName: \"kubernetes.io/projected/14ae425b-9d65-4cf0-a251-a2399ff773a6-kube-api-access-68p6m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:52.123736 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.123639 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:52.219299 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.219271 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2"] Jun 14 15:05:52.222186 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.222167 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:52.233365 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.231852 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2"] Jun 14 15:05:52.265283 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.265259 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845"] Jun 14 15:05:52.266933 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:05:52.266902 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ae425b_9d65_4cf0_a251_a2399ff773a6.slice/crio-59acb35bf9f435d7ebc8b3cc66a259e1562cad57cfb29fefe8f13297cac0bd35 WatchSource:0}: Error finding container 59acb35bf9f435d7ebc8b3cc66a259e1562cad57cfb29fefe8f13297cac0bd35: Status 404 returned error can't find the container with id 59acb35bf9f435d7ebc8b3cc66a259e1562cad57cfb29fefe8f13297cac0bd35 Jun 14 15:05:52.306615 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.306590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:52.306763 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.306740 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:52.306836 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.306808 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g7xz\" (UniqueName: \"kubernetes.io/projected/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-kube-api-access-7g7xz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:52.407658 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.407584 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:52.407658 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.407633 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g7xz\" (UniqueName: \"kubernetes.io/projected/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-kube-api-access-7g7xz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:52.407822 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.407666 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:52.407947 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.407929 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:52.408009 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.407989 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:52.417114 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.417088 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g7xz\" (UniqueName: \"kubernetes.io/projected/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-kube-api-access-7g7xz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:52.534147 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.534118 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:52.570937 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.570900 2572 generic.go:356] "Generic (PLEG): container finished" podID="14ae425b-9d65-4cf0-a251-a2399ff773a6" containerID="4a3cae8511d8a077e4f47cc9b4e3136f1b45334c03f1c27668a631fe225eb133" exitCode=0 Jun 14 15:05:52.571119 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.570977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" event={"ID":"14ae425b-9d65-4cf0-a251-a2399ff773a6","Type":"ContainerDied","Data":"4a3cae8511d8a077e4f47cc9b4e3136f1b45334c03f1c27668a631fe225eb133"} Jun 14 15:05:52.571119 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.571024 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" event={"ID":"14ae425b-9d65-4cf0-a251-a2399ff773a6","Type":"ContainerStarted","Data":"59acb35bf9f435d7ebc8b3cc66a259e1562cad57cfb29fefe8f13297cac0bd35"} Jun 14 15:05:52.607097 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.607057 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk"] Jun 14 15:05:52.610459 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.610441 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:52.619225 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.619204 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk"] Jun 14 15:05:52.675210 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.675185 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2"] Jun 14 15:05:52.676556 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:05:52.676530 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb037bb3c_a5d2_4d8a_a28b_550ed98ca13f.slice/crio-4c3b560c45217e9708919b595d001d33e140d8e2702fc94965b13933bbb747c1 WatchSource:0}: Error finding container 4c3b560c45217e9708919b595d001d33e140d8e2702fc94965b13933bbb747c1: Status 404 returned error can't find the container with id 4c3b560c45217e9708919b595d001d33e140d8e2702fc94965b13933bbb747c1 Jun 14 15:05:52.709545 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.709522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:52.709676 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.709631 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dwfb\" (UniqueName: \"kubernetes.io/projected/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-kube-api-access-4dwfb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:52.709738 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.709676 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:52.810684 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.810653 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:52.810684 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.810686 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dwfb\" (UniqueName: \"kubernetes.io/projected/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-kube-api-access-4dwfb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:52.811042 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.810710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:52.811042 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.811009 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:52.811042 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.811022 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:52.818723 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.818702 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dwfb\" (UniqueName: \"kubernetes.io/projected/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-kube-api-access-4dwfb\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:52.921125 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:52.921091 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:53.013992 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.013960 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s"] Jun 14 15:05:53.018281 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.018258 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:53.027603 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.027531 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s"] Jun 14 15:05:53.068223 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.068193 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk"] Jun 14 15:05:53.068924 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:05:53.068902 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb789b6_db2b_4fd3_b20c_e4ec6ddc15cf.slice/crio-8b78ed06657df5e38dc3d674673dd229ea2282c0aea283ace3d99118bdd3ad66 WatchSource:0}: Error finding container 8b78ed06657df5e38dc3d674673dd229ea2282c0aea283ace3d99118bdd3ad66: Status 404 returned error can't find the container with id 8b78ed06657df5e38dc3d674673dd229ea2282c0aea283ace3d99118bdd3ad66 Jun 14 15:05:53.113308 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.113286 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:53.113404 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.113318 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsqjq\" (UniqueName: \"kubernetes.io/projected/43d7860c-baee-4637-afee-352c983c3ad8-kube-api-access-dsqjq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:53.113404 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.113352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:53.214437 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.214412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:53.214510 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.214460 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsqjq\" (UniqueName: \"kubernetes.io/projected/43d7860c-baee-4637-afee-352c983c3ad8-kube-api-access-dsqjq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:53.214546 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.214517 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:53.214779 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.214761 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:53.214871 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.214853 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:53.224772 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.224745 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsqjq\" (UniqueName: \"kubernetes.io/projected/43d7860c-baee-4637-afee-352c983c3ad8-kube-api-access-dsqjq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:53.342660 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.342626 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:53.477434 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.477410 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s"] Jun 14 15:05:53.479284 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:05:53.479260 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d7860c_baee_4637_afee_352c983c3ad8.slice/crio-9d826c7de066368e7c4b2398bde351309657fcf0aee66bc524ea2cba88d6bce4 WatchSource:0}: Error finding container 9d826c7de066368e7c4b2398bde351309657fcf0aee66bc524ea2cba88d6bce4: Status 404 returned error can't find the container with id 9d826c7de066368e7c4b2398bde351309657fcf0aee66bc524ea2cba88d6bce4 Jun 14 15:05:53.579016 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.578985 2572 generic.go:356] "Generic (PLEG): container finished" podID="6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" containerID="020d5b15801465bf35b78512ae7f84721fb86e6fe695243075b4688437148d3c" exitCode=0 Jun 14 15:05:53.579123 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.579061 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" event={"ID":"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf","Type":"ContainerDied","Data":"020d5b15801465bf35b78512ae7f84721fb86e6fe695243075b4688437148d3c"} Jun 14 15:05:53.579123 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.579115 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" event={"ID":"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf","Type":"ContainerStarted","Data":"8b78ed06657df5e38dc3d674673dd229ea2282c0aea283ace3d99118bdd3ad66"} Jun 14 15:05:53.580874 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.580848 2572 generic.go:356] "Generic (PLEG): container finished" podID="b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" containerID="45c33d6fdb2958bbd7b16364274dd800cd50d81139f90c3706795b8cfd00cfff" exitCode=0 Jun 14 15:05:53.580975 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.580926 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" event={"ID":"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f","Type":"ContainerDied","Data":"45c33d6fdb2958bbd7b16364274dd800cd50d81139f90c3706795b8cfd00cfff"} Jun 14 15:05:53.581040 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.581000 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" event={"ID":"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f","Type":"ContainerStarted","Data":"4c3b560c45217e9708919b595d001d33e140d8e2702fc94965b13933bbb747c1"} Jun 14 15:05:53.582549 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.582523 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" event={"ID":"43d7860c-baee-4637-afee-352c983c3ad8","Type":"ContainerStarted","Data":"c30c44424294be4daff328f3a4cc10b38d6ef81c2730a82d13f1a409143fca45"} Jun 14 15:05:53.582667 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.582598 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" event={"ID":"43d7860c-baee-4637-afee-352c983c3ad8","Type":"ContainerStarted","Data":"9d826c7de066368e7c4b2398bde351309657fcf0aee66bc524ea2cba88d6bce4"} Jun 14 15:05:53.585085 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.585055 2572 generic.go:356] "Generic (PLEG): container finished" podID="14ae425b-9d65-4cf0-a251-a2399ff773a6" containerID="bc1cf5adab17ec2d29c643064989efc3c0237ff5302c16874b4a4877ccdff783" exitCode=0 Jun 14 15:05:53.585193 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:53.585134 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" event={"ID":"14ae425b-9d65-4cf0-a251-a2399ff773a6","Type":"ContainerDied","Data":"bc1cf5adab17ec2d29c643064989efc3c0237ff5302c16874b4a4877ccdff783"} Jun 14 15:05:54.592760 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:54.592729 2572 generic.go:356] "Generic (PLEG): container finished" podID="6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" containerID="8d7909b27960be7eaf6c26813af167b2a25ce48950d7b207b3108bcd46885e18" exitCode=0 Jun 14 15:05:54.593169 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:54.592799 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" event={"ID":"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf","Type":"ContainerDied","Data":"8d7909b27960be7eaf6c26813af167b2a25ce48950d7b207b3108bcd46885e18"} Jun 14 15:05:54.594628 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:54.594609 2572 generic.go:356] "Generic (PLEG): container finished" podID="b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" containerID="25532a8f7e058b41d6dfd1a4983f92deb6d03b001a17b386af5505eed30cabd9" exitCode=0 Jun 14 15:05:54.594727 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:54.594702 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" event={"ID":"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f","Type":"ContainerDied","Data":"25532a8f7e058b41d6dfd1a4983f92deb6d03b001a17b386af5505eed30cabd9"} Jun 14 15:05:54.596229 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:54.596210 2572 generic.go:356] "Generic (PLEG): container finished" podID="43d7860c-baee-4637-afee-352c983c3ad8" containerID="c30c44424294be4daff328f3a4cc10b38d6ef81c2730a82d13f1a409143fca45" exitCode=0 Jun 14 15:05:54.596324 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:54.596297 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" event={"ID":"43d7860c-baee-4637-afee-352c983c3ad8","Type":"ContainerDied","Data":"c30c44424294be4daff328f3a4cc10b38d6ef81c2730a82d13f1a409143fca45"} Jun 14 15:05:54.598486 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:54.598467 2572 generic.go:356] "Generic (PLEG): container finished" podID="14ae425b-9d65-4cf0-a251-a2399ff773a6" containerID="9e4319f91b83c3e8daa2eb3eecc1141a96794120e205edafadc47a8511777cfa" exitCode=0 Jun 14 15:05:54.598629 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:54.598516 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" event={"ID":"14ae425b-9d65-4cf0-a251-a2399ff773a6","Type":"ContainerDied","Data":"9e4319f91b83c3e8daa2eb3eecc1141a96794120e205edafadc47a8511777cfa"} Jun 14 15:05:55.606153 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.606113 2572 generic.go:356] "Generic (PLEG): container finished" podID="6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" containerID="bfe181a84610b67efd5cccb370093f8840f10bb580034d1ac9518000f89f9910" exitCode=0 Jun 14 15:05:55.606607 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.606201 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" event={"ID":"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf","Type":"ContainerDied","Data":"bfe181a84610b67efd5cccb370093f8840f10bb580034d1ac9518000f89f9910"} Jun 14 15:05:55.608280 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.608249 2572 generic.go:356] "Generic (PLEG): container finished" podID="b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" containerID="cf00b5c99524b4d034e5e0579e1c34301196c72faad476a9c6c51d8d1527c196" exitCode=0 Jun 14 15:05:55.608392 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.608309 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" event={"ID":"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f","Type":"ContainerDied","Data":"cf00b5c99524b4d034e5e0579e1c34301196c72faad476a9c6c51d8d1527c196"} Jun 14 15:05:55.610133 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.610110 2572 generic.go:356] "Generic (PLEG): container finished" podID="43d7860c-baee-4637-afee-352c983c3ad8" containerID="5273d78e901c3a082bef8a3432fb23bb1cf0192bd8f10ce756a563843d518b99" exitCode=0 Jun 14 15:05:55.610261 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.610188 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" event={"ID":"43d7860c-baee-4637-afee-352c983c3ad8","Type":"ContainerDied","Data":"5273d78e901c3a082bef8a3432fb23bb1cf0192bd8f10ce756a563843d518b99"} Jun 14 15:05:55.754367 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.754338 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:55.837297 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.837262 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-util\") pod \"14ae425b-9d65-4cf0-a251-a2399ff773a6\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " Jun 14 15:05:55.837458 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.837316 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-bundle\") pod \"14ae425b-9d65-4cf0-a251-a2399ff773a6\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " Jun 14 15:05:55.837458 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.837347 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68p6m\" (UniqueName: \"kubernetes.io/projected/14ae425b-9d65-4cf0-a251-a2399ff773a6-kube-api-access-68p6m\") pod \"14ae425b-9d65-4cf0-a251-a2399ff773a6\" (UID: \"14ae425b-9d65-4cf0-a251-a2399ff773a6\") " Jun 14 15:05:55.837952 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.837924 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-bundle" (OuterVolumeSpecName: "bundle") pod "14ae425b-9d65-4cf0-a251-a2399ff773a6" (UID: "14ae425b-9d65-4cf0-a251-a2399ff773a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:05:55.839716 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.839690 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ae425b-9d65-4cf0-a251-a2399ff773a6-kube-api-access-68p6m" (OuterVolumeSpecName: "kube-api-access-68p6m") pod "14ae425b-9d65-4cf0-a251-a2399ff773a6" (UID: "14ae425b-9d65-4cf0-a251-a2399ff773a6"). InnerVolumeSpecName "kube-api-access-68p6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:05:55.842628 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.842605 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-util" (OuterVolumeSpecName: "util") pod "14ae425b-9d65-4cf0-a251-a2399ff773a6" (UID: "14ae425b-9d65-4cf0-a251-a2399ff773a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:05:55.938620 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.938533 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-util\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:55.938620 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.938559 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14ae425b-9d65-4cf0-a251-a2399ff773a6-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:55.938620 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:55.938588 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68p6m\" (UniqueName: \"kubernetes.io/projected/14ae425b-9d65-4cf0-a251-a2399ff773a6-kube-api-access-68p6m\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:56.618230 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.618198 2572 generic.go:356] "Generic (PLEG): container finished" podID="43d7860c-baee-4637-afee-352c983c3ad8" containerID="c9b3b8ad0e0950651b68c49253a8ba4e9147464b2648b6ca6a2b5d924717f37d" exitCode=0 Jun 14 15:05:56.618679 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.618273 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" event={"ID":"43d7860c-baee-4637-afee-352c983c3ad8","Type":"ContainerDied","Data":"c9b3b8ad0e0950651b68c49253a8ba4e9147464b2648b6ca6a2b5d924717f37d"} Jun 14 15:05:56.620194 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.620175 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" Jun 14 15:05:56.620305 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.620208 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845" event={"ID":"14ae425b-9d65-4cf0-a251-a2399ff773a6","Type":"ContainerDied","Data":"59acb35bf9f435d7ebc8b3cc66a259e1562cad57cfb29fefe8f13297cac0bd35"} Jun 14 15:05:56.620305 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.620242 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59acb35bf9f435d7ebc8b3cc66a259e1562cad57cfb29fefe8f13297cac0bd35" Jun 14 15:05:56.787069 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.787041 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:56.789793 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.789774 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:56.948772 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.948676 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-util\") pod \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " Jun 14 15:05:56.948772 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.948723 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g7xz\" (UniqueName: \"kubernetes.io/projected/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-kube-api-access-7g7xz\") pod \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " Jun 14 15:05:56.948995 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.948789 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dwfb\" (UniqueName: \"kubernetes.io/projected/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-kube-api-access-4dwfb\") pod \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " Jun 14 15:05:56.948995 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.948815 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-bundle\") pod \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " Jun 14 15:05:56.948995 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.948837 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-util\") pod \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\" (UID: \"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf\") " Jun 14 15:05:56.948995 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.948902 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-bundle\") pod \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\" (UID: \"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f\") " Jun 14 15:05:56.949423 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.949389 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-bundle" (OuterVolumeSpecName: "bundle") pod "6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" (UID: "6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:05:56.949528 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.949506 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-bundle" (OuterVolumeSpecName: "bundle") pod "b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" (UID: "b037bb3c-a5d2-4d8a-a28b-550ed98ca13f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:05:56.951198 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.951177 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-kube-api-access-4dwfb" (OuterVolumeSpecName: "kube-api-access-4dwfb") pod "6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" (UID: "6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf"). InnerVolumeSpecName "kube-api-access-4dwfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:05:56.951531 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.951515 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-kube-api-access-7g7xz" (OuterVolumeSpecName: "kube-api-access-7g7xz") pod "b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" (UID: "b037bb3c-a5d2-4d8a-a28b-550ed98ca13f"). InnerVolumeSpecName "kube-api-access-7g7xz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:05:56.954106 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.954076 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-util" (OuterVolumeSpecName: "util") pod "b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" (UID: "b037bb3c-a5d2-4d8a-a28b-550ed98ca13f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:05:56.955537 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:56.955517 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-util" (OuterVolumeSpecName: "util") pod "6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" (UID: "6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:05:57.050046 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.050011 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dwfb\" (UniqueName: \"kubernetes.io/projected/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-kube-api-access-4dwfb\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:57.050046 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.050040 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:57.050046 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.050049 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf-util\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:57.050046 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.050057 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:57.050278 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.050065 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-util\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:57.050278 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.050073 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g7xz\" (UniqueName: \"kubernetes.io/projected/b037bb3c-a5d2-4d8a-a28b-550ed98ca13f-kube-api-access-7g7xz\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:57.628282 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.628247 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" Jun 14 15:05:57.628675 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.628246 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk" event={"ID":"6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf","Type":"ContainerDied","Data":"8b78ed06657df5e38dc3d674673dd229ea2282c0aea283ace3d99118bdd3ad66"} Jun 14 15:05:57.628675 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.628381 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b78ed06657df5e38dc3d674673dd229ea2282c0aea283ace3d99118bdd3ad66" Jun 14 15:05:57.630142 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.630122 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" Jun 14 15:05:57.630249 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.630150 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2" event={"ID":"b037bb3c-a5d2-4d8a-a28b-550ed98ca13f","Type":"ContainerDied","Data":"4c3b560c45217e9708919b595d001d33e140d8e2702fc94965b13933bbb747c1"} Jun 14 15:05:57.630249 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.630183 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c3b560c45217e9708919b595d001d33e140d8e2702fc94965b13933bbb747c1" Jun 14 15:05:57.769754 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.769731 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:57.856920 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.856884 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsqjq\" (UniqueName: \"kubernetes.io/projected/43d7860c-baee-4637-afee-352c983c3ad8-kube-api-access-dsqjq\") pod \"43d7860c-baee-4637-afee-352c983c3ad8\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " Jun 14 15:05:57.857088 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.857001 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-bundle\") pod \"43d7860c-baee-4637-afee-352c983c3ad8\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " Jun 14 15:05:57.857088 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.857053 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-util\") pod \"43d7860c-baee-4637-afee-352c983c3ad8\" (UID: \"43d7860c-baee-4637-afee-352c983c3ad8\") " Jun 14 15:05:57.857437 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.857412 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-bundle" (OuterVolumeSpecName: "bundle") pod "43d7860c-baee-4637-afee-352c983c3ad8" (UID: "43d7860c-baee-4637-afee-352c983c3ad8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:05:57.859202 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.859181 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43d7860c-baee-4637-afee-352c983c3ad8-kube-api-access-dsqjq" (OuterVolumeSpecName: "kube-api-access-dsqjq") pod "43d7860c-baee-4637-afee-352c983c3ad8" (UID: "43d7860c-baee-4637-afee-352c983c3ad8"). InnerVolumeSpecName "kube-api-access-dsqjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:05:57.862224 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.862193 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-util" (OuterVolumeSpecName: "util") pod "43d7860c-baee-4637-afee-352c983c3ad8" (UID: "43d7860c-baee-4637-afee-352c983c3ad8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:05:57.958233 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.958156 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:57.958233 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.958182 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43d7860c-baee-4637-afee-352c983c3ad8-util\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:57.958233 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:57.958191 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsqjq\" (UniqueName: \"kubernetes.io/projected/43d7860c-baee-4637-afee-352c983c3ad8-kube-api-access-dsqjq\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:05:58.638160 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:58.638130 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" Jun 14 15:05:58.638512 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:58.638166 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s" event={"ID":"43d7860c-baee-4637-afee-352c983c3ad8","Type":"ContainerDied","Data":"9d826c7de066368e7c4b2398bde351309657fcf0aee66bc524ea2cba88d6bce4"} Jun 14 15:05:58.638512 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:05:58.638231 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d826c7de066368e7c4b2398bde351309657fcf0aee66bc524ea2cba88d6bce4" Jun 14 15:06:11.414835 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.414798 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc"] Jun 14 15:06:11.415231 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415200 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ae425b-9d65-4cf0-a251-a2399ff773a6" containerName="pull" Jun 14 15:06:11.415231 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415212 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ae425b-9d65-4cf0-a251-a2399ff773a6" containerName="pull" Jun 14 15:06:11.415231 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415220 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" containerName="pull" Jun 14 15:06:11.415231 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415226 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" containerName="pull" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415241 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" containerName="util" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415247 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" containerName="util" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415260 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ae425b-9d65-4cf0-a251-a2399ff773a6" containerName="extract" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415265 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ae425b-9d65-4cf0-a251-a2399ff773a6" containerName="extract" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415271 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" containerName="pull" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415276 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" containerName="pull" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415285 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" containerName="util" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415290 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" containerName="util" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415297 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43d7860c-baee-4637-afee-352c983c3ad8" containerName="util" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415301 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="43d7860c-baee-4637-afee-352c983c3ad8" containerName="util" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415309 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ae425b-9d65-4cf0-a251-a2399ff773a6" containerName="util" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415314 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ae425b-9d65-4cf0-a251-a2399ff773a6" containerName="util" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415321 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43d7860c-baee-4637-afee-352c983c3ad8" containerName="pull" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415326 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="43d7860c-baee-4637-afee-352c983c3ad8" containerName="pull" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415333 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43d7860c-baee-4637-afee-352c983c3ad8" containerName="extract" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415337 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="43d7860c-baee-4637-afee-352c983c3ad8" containerName="extract" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415343 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" containerName="extract" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415349 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" containerName="extract" Jun 14 15:06:11.415349 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415354 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" containerName="extract" Jun 14 15:06:11.415889 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415359 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" containerName="extract" Jun 14 15:06:11.415889 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415417 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="14ae425b-9d65-4cf0-a251-a2399ff773a6" containerName="extract" Jun 14 15:06:11.415889 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415428 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="43d7860c-baee-4637-afee-352c983c3ad8" containerName="extract" Jun 14 15:06:11.415889 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415435 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf" containerName="extract" Jun 14 15:06:11.415889 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.415440 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b037bb3c-a5d2-4d8a-a28b-550ed98ca13f" containerName="extract" Jun 14 15:06:11.424065 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.424035 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc" Jun 14 15:06:11.427902 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.427877 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 14 15:06:11.428052 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.427888 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 15:06:11.429024 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.428993 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc"] Jun 14 15:06:11.429134 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.429063 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ms7zr\"" Jun 14 15:06:11.429258 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.429240 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 15:06:11.485317 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.485284 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dszjr\" (UniqueName: \"kubernetes.io/projected/29bc74a5-8741-43af-8992-76b4d9d94f4b-kube-api-access-dszjr\") pod \"dns-operator-controller-manager-864dd78c4c-jx7wc\" (UID: \"29bc74a5-8741-43af-8992-76b4d9d94f4b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc" Jun 14 15:06:11.586576 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.586535 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dszjr\" (UniqueName: \"kubernetes.io/projected/29bc74a5-8741-43af-8992-76b4d9d94f4b-kube-api-access-dszjr\") pod \"dns-operator-controller-manager-864dd78c4c-jx7wc\" (UID: \"29bc74a5-8741-43af-8992-76b4d9d94f4b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc" Jun 14 15:06:11.597225 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.597192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dszjr\" (UniqueName: \"kubernetes.io/projected/29bc74a5-8741-43af-8992-76b4d9d94f4b-kube-api-access-dszjr\") pod \"dns-operator-controller-manager-864dd78c4c-jx7wc\" (UID: \"29bc74a5-8741-43af-8992-76b4d9d94f4b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc" Jun 14 15:06:11.736695 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.736612 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc" Jun 14 15:06:11.908859 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.908831 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc"] Jun 14 15:06:11.911667 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:06:11.911626 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bc74a5_8741_43af_8992_76b4d9d94f4b.slice/crio-b6e8e568a241a6605b54c2a37f13e6718d0bfbf07a7bed232e5640857fd8a629 WatchSource:0}: Error finding container b6e8e568a241a6605b54c2a37f13e6718d0bfbf07a7bed232e5640857fd8a629: Status 404 returned error can't find the container with id b6e8e568a241a6605b54c2a37f13e6718d0bfbf07a7bed232e5640857fd8a629 Jun 14 15:06:11.914415 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:11.914394 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:06:12.721282 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:12.721237 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc" event={"ID":"29bc74a5-8741-43af-8992-76b4d9d94f4b","Type":"ContainerStarted","Data":"b6e8e568a241a6605b54c2a37f13e6718d0bfbf07a7bed232e5640857fd8a629"} Jun 14 15:06:14.735354 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:14.735322 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc" event={"ID":"29bc74a5-8741-43af-8992-76b4d9d94f4b","Type":"ContainerStarted","Data":"b8a8de09bfa1f70e8e4fc03134b1456de0dd2e7038cb1be4eae77f43899b9f4b"} Jun 14 15:06:14.735737 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:14.735381 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc" Jun 14 15:06:15.615378 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.615320 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc" podStartSLOduration=2.544790178 podStartE2EDuration="4.615302291s" totalImagesPullingTime="2.070512113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:06:14.759147791 +0000 UTC m=+672.410341171" watchObservedRunningTime="2026-06-14 15:06:15.615302291 +0000 UTC m=+673.266495660" Jun 14 15:06:15.617781 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.617753 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj"] Jun 14 15:06:15.620333 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.620317 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:15.622999 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.622981 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lpknv\"" Jun 14 15:06:15.634996 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.634975 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj"] Jun 14 15:06:15.728172 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.728139 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcfmz\" (UniqueName: \"kubernetes.io/projected/a1480281-3946-461e-b9aa-c8b5a719c4f1-kube-api-access-hcfmz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5bkj\" (UID: \"a1480281-3946-461e-b9aa-c8b5a719c4f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:15.728315 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.728188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1480281-3946-461e-b9aa-c8b5a719c4f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5bkj\" (UID: \"a1480281-3946-461e-b9aa-c8b5a719c4f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:15.828968 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.828931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcfmz\" (UniqueName: \"kubernetes.io/projected/a1480281-3946-461e-b9aa-c8b5a719c4f1-kube-api-access-hcfmz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5bkj\" (UID: \"a1480281-3946-461e-b9aa-c8b5a719c4f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:15.829340 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.828985 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1480281-3946-461e-b9aa-c8b5a719c4f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5bkj\" (UID: \"a1480281-3946-461e-b9aa-c8b5a719c4f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:15.829477 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.829458 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1480281-3946-461e-b9aa-c8b5a719c4f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5bkj\" (UID: \"a1480281-3946-461e-b9aa-c8b5a719c4f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:15.842498 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.842471 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcfmz\" (UniqueName: \"kubernetes.io/projected/a1480281-3946-461e-b9aa-c8b5a719c4f1-kube-api-access-hcfmz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m5bkj\" (UID: \"a1480281-3946-461e-b9aa-c8b5a719c4f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:15.930786 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:15.930721 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:16.092777 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:16.091646 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj"] Jun 14 15:06:16.749048 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:16.749015 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" event={"ID":"a1480281-3946-461e-b9aa-c8b5a719c4f1","Type":"ContainerStarted","Data":"e1cfdddcde608363739c1ea41bc59a37f4ba4533d4f4448cd503bb85b79e3d90"} Jun 14 15:06:24.796944 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:24.796897 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" event={"ID":"a1480281-3946-461e-b9aa-c8b5a719c4f1","Type":"ContainerStarted","Data":"a996f62084ad66a71a33aae3f3468f8a8e6c32ba2b3ffa889639ee1ccdbaf1b7"} Jun 14 15:06:24.797341 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:24.796960 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:24.820993 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:24.820944 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" podStartSLOduration=1.54832798 podStartE2EDuration="9.820929486s" totalImagesPullingTime="8.272601506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:06:24.818981717 +0000 UTC m=+682.470175086" watchObservedRunningTime="2026-06-14 15:06:24.820929486 +0000 UTC m=+682.472122855" Jun 14 15:06:25.744091 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:25.744055 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jx7wc" Jun 14 15:06:35.805900 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:35.805873 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:37.457260 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.457224 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4"] Jun 14 15:06:37.462270 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.462243 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:37.504404 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.504378 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4"] Jun 14 15:06:37.529513 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.529484 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kkwg4\" (UID: \"b1a0159d-ffbe-4b29-ab51-1db1603d70d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:37.529693 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.529534 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgtjf\" (UniqueName: \"kubernetes.io/projected/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-kube-api-access-qgtjf\") pod \"kuadrant-operator-controller-manager-86878c769f-kkwg4\" (UID: \"b1a0159d-ffbe-4b29-ab51-1db1603d70d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:37.630822 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.630783 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgtjf\" (UniqueName: \"kubernetes.io/projected/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-kube-api-access-qgtjf\") pod \"kuadrant-operator-controller-manager-86878c769f-kkwg4\" (UID: \"b1a0159d-ffbe-4b29-ab51-1db1603d70d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:37.631021 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.630892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kkwg4\" (UID: \"b1a0159d-ffbe-4b29-ab51-1db1603d70d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:37.631258 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.631239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kkwg4\" (UID: \"b1a0159d-ffbe-4b29-ab51-1db1603d70d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:37.646148 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.646110 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgtjf\" (UniqueName: \"kubernetes.io/projected/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-kube-api-access-qgtjf\") pod \"kuadrant-operator-controller-manager-86878c769f-kkwg4\" (UID: \"b1a0159d-ffbe-4b29-ab51-1db1603d70d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:37.652113 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.652081 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj"] Jun 14 15:06:37.652303 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.652282 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" podUID="a1480281-3946-461e-b9aa-c8b5a719c4f1" containerName="manager" containerID="cri-o://a996f62084ad66a71a33aae3f3468f8a8e6c32ba2b3ffa889639ee1ccdbaf1b7" gracePeriod=2 Jun 14 15:06:37.674954 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.674925 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj"] Jun 14 15:06:37.690503 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:06:37.690450 2572 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a1480281-3946-461e-b9aa-c8b5a719c4f1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-m5bkj\": pods \"kuadrant-operator-controller-manager-8684c9ff49-m5bkj\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:37.698342 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.698309 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4"] Jun 14 15:06:37.698742 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.698721 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:37.702634 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.702550 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4"] Jun 14 15:06:37.746156 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.746120 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn"] Jun 14 15:06:37.746600 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.746583 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1480281-3946-461e-b9aa-c8b5a719c4f1" containerName="manager" Jun 14 15:06:37.746600 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.746600 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1480281-3946-461e-b9aa-c8b5a719c4f1" containerName="manager" Jun 14 15:06:37.746757 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.746673 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1480281-3946-461e-b9aa-c8b5a719c4f1" containerName="manager" Jun 14 15:06:37.750048 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.750029 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:06:37.787291 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.787262 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn"] Jun 14 15:06:37.819861 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:06:37.819820 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5bkj\" is forbidden: User \"system:node:ip-10-0-133-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-52.ec2.internal' and this object" podUID="a1480281-3946-461e-b9aa-c8b5a719c4f1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:37.833307 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.833276 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmrdn\" (UniqueName: \"kubernetes.io/projected/61a52397-5a80-4ff1-9632-2f773282e3d1-kube-api-access-xmrdn\") pod \"kuadrant-operator-controller-manager-86878c769f-hwtvn\" (UID: \"61a52397-5a80-4ff1-9632-2f773282e3d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:06:37.833458 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.833372 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61a52397-5a80-4ff1-9632-2f773282e3d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hwtvn\" (UID: \"61a52397-5a80-4ff1-9632-2f773282e3d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:06:37.872985 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.872955 2572 generic.go:356] "Generic (PLEG): container finished" podID="a1480281-3946-461e-b9aa-c8b5a719c4f1" containerID="a996f62084ad66a71a33aae3f3468f8a8e6c32ba2b3ffa889639ee1ccdbaf1b7" exitCode=0 Jun 14 15:06:37.921848 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.921825 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:37.924650 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:06:37.924624 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-m5bkj\" is forbidden: User \"system:node:ip-10-0-133-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-52.ec2.internal' and this object" podUID="a1480281-3946-461e-b9aa-c8b5a719c4f1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:37.933988 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.933966 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61a52397-5a80-4ff1-9632-2f773282e3d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hwtvn\" (UID: \"61a52397-5a80-4ff1-9632-2f773282e3d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:06:37.934166 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.934146 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmrdn\" (UniqueName: \"kubernetes.io/projected/61a52397-5a80-4ff1-9632-2f773282e3d1-kube-api-access-xmrdn\") pod \"kuadrant-operator-controller-manager-86878c769f-hwtvn\" (UID: \"61a52397-5a80-4ff1-9632-2f773282e3d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:06:37.934382 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.934362 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61a52397-5a80-4ff1-9632-2f773282e3d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hwtvn\" (UID: \"61a52397-5a80-4ff1-9632-2f773282e3d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:06:37.954775 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:37.954748 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmrdn\" (UniqueName: \"kubernetes.io/projected/61a52397-5a80-4ff1-9632-2f773282e3d1-kube-api-access-xmrdn\") pod \"kuadrant-operator-controller-manager-86878c769f-hwtvn\" (UID: \"61a52397-5a80-4ff1-9632-2f773282e3d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:06:38.034865 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.034787 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1480281-3946-461e-b9aa-c8b5a719c4f1-extensions-socket-volume\") pod \"a1480281-3946-461e-b9aa-c8b5a719c4f1\" (UID: \"a1480281-3946-461e-b9aa-c8b5a719c4f1\") " Jun 14 15:06:38.035002 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.034916 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcfmz\" (UniqueName: \"kubernetes.io/projected/a1480281-3946-461e-b9aa-c8b5a719c4f1-kube-api-access-hcfmz\") pod \"a1480281-3946-461e-b9aa-c8b5a719c4f1\" (UID: \"a1480281-3946-461e-b9aa-c8b5a719c4f1\") " Jun 14 15:06:38.035290 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.035253 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1480281-3946-461e-b9aa-c8b5a719c4f1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a1480281-3946-461e-b9aa-c8b5a719c4f1" (UID: "a1480281-3946-461e-b9aa-c8b5a719c4f1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:06:38.037045 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.037024 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1480281-3946-461e-b9aa-c8b5a719c4f1-kube-api-access-hcfmz" (OuterVolumeSpecName: "kube-api-access-hcfmz") pod "a1480281-3946-461e-b9aa-c8b5a719c4f1" (UID: "a1480281-3946-461e-b9aa-c8b5a719c4f1"). InnerVolumeSpecName "kube-api-access-hcfmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:06:38.064208 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.064180 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:06:38.136443 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.136415 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcfmz\" (UniqueName: \"kubernetes.io/projected/a1480281-3946-461e-b9aa-c8b5a719c4f1-kube-api-access-hcfmz\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:06:38.136443 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.136442 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1480281-3946-461e-b9aa-c8b5a719c4f1-extensions-socket-volume\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:06:38.223898 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.223873 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn"] Jun 14 15:06:38.226087 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:06:38.226059 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a52397_5a80_4ff1_9632_2f773282e3d1.slice/crio-26db322ee5d64b4c8163b924170cb688dc2c739406bcbe48b35fb90c8ad28206 WatchSource:0}: Error finding container 26db322ee5d64b4c8163b924170cb688dc2c739406bcbe48b35fb90c8ad28206: Status 404 returned error can't find the container with id 26db322ee5d64b4c8163b924170cb688dc2c739406bcbe48b35fb90c8ad28206 Jun 14 15:06:38.807963 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.807925 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1480281-3946-461e-b9aa-c8b5a719c4f1" path="/var/lib/kubelet/pods/a1480281-3946-461e-b9aa-c8b5a719c4f1/volumes" Jun 14 15:06:38.880982 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.880919 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" event={"ID":"61a52397-5a80-4ff1-9632-2f773282e3d1","Type":"ContainerStarted","Data":"03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370"} Jun 14 15:06:38.881144 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.881015 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" event={"ID":"61a52397-5a80-4ff1-9632-2f773282e3d1","Type":"ContainerStarted","Data":"26db322ee5d64b4c8163b924170cb688dc2c739406bcbe48b35fb90c8ad28206"} Jun 14 15:06:38.881144 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.881046 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:06:38.882579 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.882545 2572 scope.go:117] "RemoveContainer" containerID="a996f62084ad66a71a33aae3f3468f8a8e6c32ba2b3ffa889639ee1ccdbaf1b7" Jun 14 15:06:38.882688 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.882590 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m5bkj" Jun 14 15:06:38.915806 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:38.915716 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" podStartSLOduration=1.9157003179999998 podStartE2EDuration="1.915700318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:06:38.914650711 +0000 UTC m=+696.565844080" watchObservedRunningTime="2026-06-14 15:06:38.915700318 +0000 UTC m=+696.566893691" Jun 14 15:06:40.254922 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:06:40.254882 2572 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-86878c769f-kkwg4_kuadrant-system_b1a0159d-ffbe-4b29-ab51-1db1603d70d5_0(83dc7cbf89f4dcaf3bdafbbc87b661c0748c168dec422414795e687c7cb9e494): error adding pod kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kkwg4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 14 15:06:40.255219 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:06:40.254950 2572 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-86878c769f-kkwg4_kuadrant-system_b1a0159d-ffbe-4b29-ab51-1db1603d70d5_0(83dc7cbf89f4dcaf3bdafbbc87b661c0748c168dec422414795e687c7cb9e494): error adding pod kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kkwg4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:40.895558 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:40.895515 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:40.904092 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:40.904069 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:40.907031 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:06:40.907007 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kkwg4\" is forbidden: User \"system:node:ip-10-0-133-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-52.ec2.internal' and this object" podUID="b1a0159d-ffbe-4b29-ab51-1db1603d70d5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:41.063286 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:41.063247 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgtjf\" (UniqueName: \"kubernetes.io/projected/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-kube-api-access-qgtjf\") pod \"b1a0159d-ffbe-4b29-ab51-1db1603d70d5\" (UID: \"b1a0159d-ffbe-4b29-ab51-1db1603d70d5\") " Jun 14 15:06:41.063286 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:41.063292 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-extensions-socket-volume\") pod \"b1a0159d-ffbe-4b29-ab51-1db1603d70d5\" (UID: \"b1a0159d-ffbe-4b29-ab51-1db1603d70d5\") " Jun 14 15:06:41.063622 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:41.063599 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b1a0159d-ffbe-4b29-ab51-1db1603d70d5" (UID: "b1a0159d-ffbe-4b29-ab51-1db1603d70d5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:06:41.065620 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:41.065596 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-kube-api-access-qgtjf" (OuterVolumeSpecName: "kube-api-access-qgtjf") pod "b1a0159d-ffbe-4b29-ab51-1db1603d70d5" (UID: "b1a0159d-ffbe-4b29-ab51-1db1603d70d5"). InnerVolumeSpecName "kube-api-access-qgtjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:06:41.164916 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:41.164822 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgtjf\" (UniqueName: \"kubernetes.io/projected/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-kube-api-access-qgtjf\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:06:41.164916 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:41.164856 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1a0159d-ffbe-4b29-ab51-1db1603d70d5-extensions-socket-volume\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:06:41.901455 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:41.901422 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:41.904257 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:06:41.904232 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kkwg4\" is forbidden: User \"system:node:ip-10-0-133-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-52.ec2.internal' and this object" podUID="b1a0159d-ffbe-4b29-ab51-1db1603d70d5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:41.909739 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:06:41.909711 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kkwg4\" is forbidden: User \"system:node:ip-10-0-133-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-52.ec2.internal' and this object" podUID="b1a0159d-ffbe-4b29-ab51-1db1603d70d5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:42.806506 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:06:42.806469 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-kkwg4\" is forbidden: User \"system:node:ip-10-0-133-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-52.ec2.internal' and this object" podUID="b1a0159d-ffbe-4b29-ab51-1db1603d70d5" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kkwg4" Jun 14 15:06:42.807748 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:42.807729 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1a0159d-ffbe-4b29-ab51-1db1603d70d5" path="/var/lib/kubelet/pods/b1a0159d-ffbe-4b29-ab51-1db1603d70d5/volumes" Jun 14 15:06:49.892981 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:06:49.892910 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:07:09.413638 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.413600 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:07:09.417412 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.417378 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" Jun 14 15:07:09.420151 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.420129 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 15:07:09.420278 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.420241 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gm2s6\"" Jun 14 15:07:09.435756 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.435731 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:07:09.498224 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.498188 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:07:09.509826 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.509796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdttz\" (UniqueName: \"kubernetes.io/projected/39492a27-bf91-4b96-9d7c-f67c813b159d-kube-api-access-mdttz\") pod \"limitador-limitador-54d6d988d5-gsmvx\" (UID: \"39492a27-bf91-4b96-9d7c-f67c813b159d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" Jun 14 15:07:09.510009 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.509837 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39492a27-bf91-4b96-9d7c-f67c813b159d-config-file\") pod \"limitador-limitador-54d6d988d5-gsmvx\" (UID: \"39492a27-bf91-4b96-9d7c-f67c813b159d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" Jun 14 15:07:09.611283 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.611246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdttz\" (UniqueName: \"kubernetes.io/projected/39492a27-bf91-4b96-9d7c-f67c813b159d-kube-api-access-mdttz\") pod \"limitador-limitador-54d6d988d5-gsmvx\" (UID: \"39492a27-bf91-4b96-9d7c-f67c813b159d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" Jun 14 15:07:09.611464 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.611294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39492a27-bf91-4b96-9d7c-f67c813b159d-config-file\") pod \"limitador-limitador-54d6d988d5-gsmvx\" (UID: \"39492a27-bf91-4b96-9d7c-f67c813b159d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" Jun 14 15:07:09.611950 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.611931 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/39492a27-bf91-4b96-9d7c-f67c813b159d-config-file\") pod \"limitador-limitador-54d6d988d5-gsmvx\" (UID: \"39492a27-bf91-4b96-9d7c-f67c813b159d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" Jun 14 15:07:09.623928 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.623907 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdttz\" (UniqueName: \"kubernetes.io/projected/39492a27-bf91-4b96-9d7c-f67c813b159d-kube-api-access-mdttz\") pod \"limitador-limitador-54d6d988d5-gsmvx\" (UID: \"39492a27-bf91-4b96-9d7c-f67c813b159d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" Jun 14 15:07:09.727982 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.727894 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" Jun 14 15:07:09.881089 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:09.881059 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:07:09.882346 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:07:09.882320 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39492a27_bf91_4b96_9d7c_f67c813b159d.slice/crio-414cff9ecc9e47012507bf9c0b767d2574ebe6166c2446439f4ac536611ca280 WatchSource:0}: Error finding container 414cff9ecc9e47012507bf9c0b767d2574ebe6166c2446439f4ac536611ca280: Status 404 returned error can't find the container with id 414cff9ecc9e47012507bf9c0b767d2574ebe6166c2446439f4ac536611ca280 Jun 14 15:07:10.072380 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:10.072341 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" event={"ID":"39492a27-bf91-4b96-9d7c-f67c813b159d","Type":"ContainerStarted","Data":"414cff9ecc9e47012507bf9c0b767d2574ebe6166c2446439f4ac536611ca280"} Jun 14 15:07:13.096307 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:13.096275 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" event={"ID":"39492a27-bf91-4b96-9d7c-f67c813b159d","Type":"ContainerStarted","Data":"1acaacdc887ecdce1b8b5a193036485f7772e2ac601acc2eebfd8be23184aee8"} Jun 14 15:07:13.096716 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:13.096380 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" Jun 14 15:07:13.123883 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:13.123831 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" podStartSLOduration=1.738181338 podStartE2EDuration="4.123814572s" totalImagesPullingTime="2.385633234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:07:13.120552166 +0000 UTC m=+730.771745540" watchObservedRunningTime="2026-06-14 15:07:13.123814572 +0000 UTC m=+730.775008017" Jun 14 15:07:24.108971 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:24.108938 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gsmvx" Jun 14 15:07:43.188790 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.188755 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj"] Jun 14 15:07:43.194918 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.194895 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:43.201378 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.201352 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6sjq4\"" Jun 14 15:07:43.202119 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.202101 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 15:07:43.202204 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.202154 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 15:07:43.215552 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.215520 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfhpc\" (UniqueName: \"kubernetes.io/projected/c7465318-4ac0-43cf-82de-cd27c6ba5412-kube-api-access-wfhpc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:43.215678 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.215633 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:43.215678 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.215672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:43.238326 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.238295 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj"] Jun 14 15:07:43.317057 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.317015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:43.317239 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.317068 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:43.317239 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.317102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfhpc\" (UniqueName: \"kubernetes.io/projected/c7465318-4ac0-43cf-82de-cd27c6ba5412-kube-api-access-wfhpc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:43.317439 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.317419 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:43.317488 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.317461 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:43.332615 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.332586 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfhpc\" (UniqueName: \"kubernetes.io/projected/c7465318-4ac0-43cf-82de-cd27c6ba5412-kube-api-access-wfhpc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:43.504474 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.504364 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:43.663000 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:43.662965 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj"] Jun 14 15:07:43.664732 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:07:43.664686 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7465318_4ac0_43cf_82de_cd27c6ba5412.slice/crio-8a41783e6684d62943a65580ac1ace920f50293ff7f1488a1bf9eca0b22c0bb8 WatchSource:0}: Error finding container 8a41783e6684d62943a65580ac1ace920f50293ff7f1488a1bf9eca0b22c0bb8: Status 404 returned error can't find the container with id 8a41783e6684d62943a65580ac1ace920f50293ff7f1488a1bf9eca0b22c0bb8 Jun 14 15:07:44.292196 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:44.292158 2572 generic.go:356] "Generic (PLEG): container finished" podID="c7465318-4ac0-43cf-82de-cd27c6ba5412" containerID="5c1ea70f0ef2e0abf99dd39a38d4d7e701797e9760154a70ba7395dca9d41213" exitCode=0 Jun 14 15:07:44.292559 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:44.292219 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" event={"ID":"c7465318-4ac0-43cf-82de-cd27c6ba5412","Type":"ContainerDied","Data":"5c1ea70f0ef2e0abf99dd39a38d4d7e701797e9760154a70ba7395dca9d41213"} Jun 14 15:07:44.292559 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:44.292270 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" event={"ID":"c7465318-4ac0-43cf-82de-cd27c6ba5412","Type":"ContainerStarted","Data":"8a41783e6684d62943a65580ac1ace920f50293ff7f1488a1bf9eca0b22c0bb8"} Jun 14 15:07:45.300245 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:45.300204 2572 generic.go:356] "Generic (PLEG): container finished" podID="c7465318-4ac0-43cf-82de-cd27c6ba5412" containerID="690c4d89d69215fda77f948d7f06b3a05ac16e89dd790f8fe9c227adcfaff004" exitCode=0 Jun 14 15:07:45.300639 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:45.300273 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" event={"ID":"c7465318-4ac0-43cf-82de-cd27c6ba5412","Type":"ContainerDied","Data":"690c4d89d69215fda77f948d7f06b3a05ac16e89dd790f8fe9c227adcfaff004"} Jun 14 15:07:46.308673 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:46.308637 2572 generic.go:356] "Generic (PLEG): container finished" podID="c7465318-4ac0-43cf-82de-cd27c6ba5412" containerID="5ef3d61ff62647523d24396f611c6991c6e1b2fb26b4a98769a07eacc787cffd" exitCode=0 Jun 14 15:07:46.309048 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:46.308723 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" event={"ID":"c7465318-4ac0-43cf-82de-cd27c6ba5412","Type":"ContainerDied","Data":"5ef3d61ff62647523d24396f611c6991c6e1b2fb26b4a98769a07eacc787cffd"} Jun 14 15:07:47.466319 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:47.466293 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:47.555726 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:47.555685 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-util\") pod \"c7465318-4ac0-43cf-82de-cd27c6ba5412\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " Jun 14 15:07:47.555726 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:47.555727 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-bundle\") pod \"c7465318-4ac0-43cf-82de-cd27c6ba5412\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " Jun 14 15:07:47.555937 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:47.555762 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfhpc\" (UniqueName: \"kubernetes.io/projected/c7465318-4ac0-43cf-82de-cd27c6ba5412-kube-api-access-wfhpc\") pod \"c7465318-4ac0-43cf-82de-cd27c6ba5412\" (UID: \"c7465318-4ac0-43cf-82de-cd27c6ba5412\") " Jun 14 15:07:47.556275 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:47.556245 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-bundle" (OuterVolumeSpecName: "bundle") pod "c7465318-4ac0-43cf-82de-cd27c6ba5412" (UID: "c7465318-4ac0-43cf-82de-cd27c6ba5412"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:07:47.558046 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:47.558019 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7465318-4ac0-43cf-82de-cd27c6ba5412-kube-api-access-wfhpc" (OuterVolumeSpecName: "kube-api-access-wfhpc") pod "c7465318-4ac0-43cf-82de-cd27c6ba5412" (UID: "c7465318-4ac0-43cf-82de-cd27c6ba5412"). InnerVolumeSpecName "kube-api-access-wfhpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:07:47.562175 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:47.562135 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-util" (OuterVolumeSpecName: "util") pod "c7465318-4ac0-43cf-82de-cd27c6ba5412" (UID: "c7465318-4ac0-43cf-82de-cd27c6ba5412"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:07:47.657170 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:47.657074 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfhpc\" (UniqueName: \"kubernetes.io/projected/c7465318-4ac0-43cf-82de-cd27c6ba5412-kube-api-access-wfhpc\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:07:47.657170 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:47.657111 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-util\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:07:47.657170 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:47.657120 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7465318-4ac0-43cf-82de-cd27c6ba5412-bundle\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:07:48.327253 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:48.327219 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" Jun 14 15:07:48.327253 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:48.327248 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748sm9cj" event={"ID":"c7465318-4ac0-43cf-82de-cd27c6ba5412","Type":"ContainerDied","Data":"8a41783e6684d62943a65580ac1ace920f50293ff7f1488a1bf9eca0b22c0bb8"} Jun 14 15:07:48.327507 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:07:48.327323 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a41783e6684d62943a65580ac1ace920f50293ff7f1488a1bf9eca0b22c0bb8" Jun 14 15:09:20.739611 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.739558 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-xm56f"] Jun 14 15:09:20.740077 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.739995 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7465318-4ac0-43cf-82de-cd27c6ba5412" containerName="util" Jun 14 15:09:20.740077 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.740007 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7465318-4ac0-43cf-82de-cd27c6ba5412" containerName="util" Jun 14 15:09:20.740077 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.740016 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7465318-4ac0-43cf-82de-cd27c6ba5412" containerName="extract" Jun 14 15:09:20.740077 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.740021 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7465318-4ac0-43cf-82de-cd27c6ba5412" containerName="extract" Jun 14 15:09:20.740077 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.740030 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7465318-4ac0-43cf-82de-cd27c6ba5412" containerName="pull" Jun 14 15:09:20.740077 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.740036 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7465318-4ac0-43cf-82de-cd27c6ba5412" containerName="pull" Jun 14 15:09:20.740265 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.740111 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7465318-4ac0-43cf-82de-cd27c6ba5412" containerName="extract" Jun 14 15:09:20.743276 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.743259 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-xm56f" Jun 14 15:09:20.745992 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.745967 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 14 15:09:20.745992 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.745979 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5zr2v\"" Jun 14 15:09:20.759549 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.759524 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-xm56f"] Jun 14 15:09:20.771538 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.771514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dtft\" (UniqueName: \"kubernetes.io/projected/0268755f-e126-4a92-91f5-325eed18f9e3-kube-api-access-9dtft\") pod \"payload-processing-699b6cd6c-xm56f\" (UID: \"0268755f-e126-4a92-91f5-325eed18f9e3\") " pod="openshift-ingress/payload-processing-699b6cd6c-xm56f" Jun 14 15:09:20.774123 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.774101 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7qbr7"] Jun 14 15:09:20.777836 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.777820 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-7qbr7" Jun 14 15:09:20.790482 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.790456 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7qbr7"] Jun 14 15:09:20.872450 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.872410 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppctw\" (UniqueName: \"kubernetes.io/projected/e5a57c51-a511-4831-bc81-c25720271277-kube-api-access-ppctw\") pod \"payload-pre-processing-579785bc64-7qbr7\" (UID: \"e5a57c51-a511-4831-bc81-c25720271277\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7qbr7" Jun 14 15:09:20.872650 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.872478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dtft\" (UniqueName: \"kubernetes.io/projected/0268755f-e126-4a92-91f5-325eed18f9e3-kube-api-access-9dtft\") pod \"payload-processing-699b6cd6c-xm56f\" (UID: \"0268755f-e126-4a92-91f5-325eed18f9e3\") " pod="openshift-ingress/payload-processing-699b6cd6c-xm56f" Jun 14 15:09:20.884391 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.884358 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dtft\" (UniqueName: \"kubernetes.io/projected/0268755f-e126-4a92-91f5-325eed18f9e3-kube-api-access-9dtft\") pod \"payload-processing-699b6cd6c-xm56f\" (UID: \"0268755f-e126-4a92-91f5-325eed18f9e3\") " pod="openshift-ingress/payload-processing-699b6cd6c-xm56f" Jun 14 15:09:20.916859 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.916812 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:09:20.973269 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.973231 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppctw\" (UniqueName: \"kubernetes.io/projected/e5a57c51-a511-4831-bc81-c25720271277-kube-api-access-ppctw\") pod \"payload-pre-processing-579785bc64-7qbr7\" (UID: \"e5a57c51-a511-4831-bc81-c25720271277\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7qbr7" Jun 14 15:09:20.981977 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:20.981947 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppctw\" (UniqueName: \"kubernetes.io/projected/e5a57c51-a511-4831-bc81-c25720271277-kube-api-access-ppctw\") pod \"payload-pre-processing-579785bc64-7qbr7\" (UID: \"e5a57c51-a511-4831-bc81-c25720271277\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7qbr7" Jun 14 15:09:21.053702 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:21.053676 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-xm56f" Jun 14 15:09:21.088931 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:21.088898 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-7qbr7" Jun 14 15:09:21.209670 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:21.209638 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-xm56f"] Jun 14 15:09:21.210536 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:09:21.210506 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0268755f_e126_4a92_91f5_325eed18f9e3.slice/crio-d3ca7e49894ed1068b68edfadff35b3a9c874f826efa7f0aa8a11cb5c26b8aed WatchSource:0}: Error finding container d3ca7e49894ed1068b68edfadff35b3a9c874f826efa7f0aa8a11cb5c26b8aed: Status 404 returned error can't find the container with id d3ca7e49894ed1068b68edfadff35b3a9c874f826efa7f0aa8a11cb5c26b8aed Jun 14 15:09:21.253887 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:21.253858 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7qbr7"] Jun 14 15:09:21.254748 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:09:21.254723 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a57c51_a511_4831_bc81_c25720271277.slice/crio-6639cb9f74a152e17479b8a84b8782a68278215e5292cb029670b096f1b60643 WatchSource:0}: Error finding container 6639cb9f74a152e17479b8a84b8782a68278215e5292cb029670b096f1b60643: Status 404 returned error can't find the container with id 6639cb9f74a152e17479b8a84b8782a68278215e5292cb029670b096f1b60643 Jun 14 15:09:21.894097 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:21.894015 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-7qbr7" event={"ID":"e5a57c51-a511-4831-bc81-c25720271277","Type":"ContainerStarted","Data":"6639cb9f74a152e17479b8a84b8782a68278215e5292cb029670b096f1b60643"} Jun 14 15:09:21.895715 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:21.895680 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-xm56f" event={"ID":"0268755f-e126-4a92-91f5-325eed18f9e3","Type":"ContainerStarted","Data":"d3ca7e49894ed1068b68edfadff35b3a9c874f826efa7f0aa8a11cb5c26b8aed"} Jun 14 15:09:23.911743 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:23.911707 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-7qbr7" event={"ID":"e5a57c51-a511-4831-bc81-c25720271277","Type":"ContainerStarted","Data":"6ec7e5303b1bac6a0957a2973276ca8818bd607b1c82043e54f5100d14072e2b"} Jun 14 15:09:23.912179 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:23.911828 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-7qbr7" Jun 14 15:09:23.913687 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:23.913659 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-xm56f" event={"ID":"0268755f-e126-4a92-91f5-325eed18f9e3","Type":"ContainerStarted","Data":"a2e845eb3c380e4a2c8ad08fe5338d87fd049ed3c1d71c9165f685da10ae6403"} Jun 14 15:09:23.913822 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:23.913707 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-xm56f" Jun 14 15:09:23.928792 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:23.928750 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-7qbr7" podStartSLOduration=1.486225758 podStartE2EDuration="3.928735999s" totalImagesPullingTime="2.442510241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:09:23.92814972 +0000 UTC m=+861.579343089" watchObservedRunningTime="2026-06-14 15:09:23.928735999 +0000 UTC m=+861.579929368" Jun 14 15:09:23.946540 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:23.946456 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-xm56f" podStartSLOduration=1.466373991 podStartE2EDuration="3.946448859s" totalImagesPullingTime="2.480074868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:09:23.945612254 +0000 UTC m=+861.596805625" watchObservedRunningTime="2026-06-14 15:09:23.946448859 +0000 UTC m=+861.597642228" Jun 14 15:09:34.921552 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:34.921520 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-xm56f" Jun 14 15:09:34.922048 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:09:34.921615 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-7qbr7" Jun 14 15:10:02.855133 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:10:02.855045 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:10:02.857506 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:10:02.857481 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:10:02.860808 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:10:02.860786 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:10:02.869908 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:10:02.869874 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:12:27.960848 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.960812 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz"] Jun 14 15:12:27.964325 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.964304 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:27.970678 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.970644 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 15:12:27.972257 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.971864 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 15:12:27.972257 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.971968 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 14 15:12:27.972257 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.972084 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lxjd7\"" Jun 14 15:12:27.986857 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.986836 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz"] Jun 14 15:12:27.993829 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.993801 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:27.993957 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.993867 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:27.993957 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.993932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:27.994116 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.993988 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:27.994116 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.994042 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:27.994116 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:27.994071 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn8fd\" (UniqueName: \"kubernetes.io/projected/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-kube-api-access-cn8fd\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.094697 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.094662 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.094892 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.094709 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.094892 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.094745 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.094892 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.094761 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn8fd\" (UniqueName: \"kubernetes.io/projected/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-kube-api-access-cn8fd\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.094892 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.094823 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.094892 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.094853 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.095165 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.095120 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.095236 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.095161 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.095236 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.095201 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.097309 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.097283 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.097429 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.097412 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.104665 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.104644 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn8fd\" (UniqueName: \"kubernetes.io/projected/43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3-kube-api-access-cn8fd\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz\" (UID: \"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.276363 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.276277 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:12:28.428676 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.428644 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz"] Jun 14 15:12:28.431802 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:12:28.431776 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f2ccff_4bf5_4aee_bb2a_5c0d43324ed3.slice/crio-01136c11b117fc1c4b02ca233704dfc2f862e54441e5eb0040a6ee8f0f613df2 WatchSource:0}: Error finding container 01136c11b117fc1c4b02ca233704dfc2f862e54441e5eb0040a6ee8f0f613df2: Status 404 returned error can't find the container with id 01136c11b117fc1c4b02ca233704dfc2f862e54441e5eb0040a6ee8f0f613df2 Jun 14 15:12:28.434070 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.434053 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:12:28.561331 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:28.561296 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:12:29.037754 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:29.037654 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" event={"ID":"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3","Type":"ContainerStarted","Data":"01136c11b117fc1c4b02ca233704dfc2f862e54441e5eb0040a6ee8f0f613df2"} Jun 14 15:12:33.063929 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:33.063896 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" event={"ID":"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3","Type":"ContainerStarted","Data":"28f034d657f89e97de43b510773fef8c51171ffaf4b9b659a89d945a93513864"} Jun 14 15:12:41.741450 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:41.741417 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:12:54.228190 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.228113 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc"] Jun 14 15:12:54.233192 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.233168 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.235994 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.235970 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 14 15:12:54.245361 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.245324 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc"] Jun 14 15:12:54.341662 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.341630 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.341851 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.341716 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59pc6\" (UniqueName: \"kubernetes.io/projected/8ae70dcb-c45c-4575-bc51-f287287eacf0-kube-api-access-59pc6\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.341851 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.341747 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.341851 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.341764 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ae70dcb-c45c-4575-bc51-f287287eacf0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.341851 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.341789 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.342000 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.341897 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.443454 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.443422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59pc6\" (UniqueName: \"kubernetes.io/projected/8ae70dcb-c45c-4575-bc51-f287287eacf0-kube-api-access-59pc6\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.443748 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.443716 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.443863 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.443762 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ae70dcb-c45c-4575-bc51-f287287eacf0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.443863 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.443811 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.443863 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.443850 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.444027 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.443921 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.444466 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.444443 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.444652 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.444467 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.444783 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.444690 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.446703 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.446683 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ae70dcb-c45c-4575-bc51-f287287eacf0-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.448082 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.448064 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ae70dcb-c45c-4575-bc51-f287287eacf0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.452803 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.452778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59pc6\" (UniqueName: \"kubernetes.io/projected/8ae70dcb-c45c-4575-bc51-f287287eacf0-kube-api-access-59pc6\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc\" (UID: \"8ae70dcb-c45c-4575-bc51-f287287eacf0\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.543162 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.543076 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:12:54.546683 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.546663 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" Jun 14 15:12:54.698909 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:54.698869 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc"] Jun 14 15:12:54.700418 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:12:54.700389 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae70dcb_c45c_4575_bc51_f287287eacf0.slice/crio-7556db7bb39b112b94de3d9584843efcced7afee36eb84270adc50977fb52772 WatchSource:0}: Error finding container 7556db7bb39b112b94de3d9584843efcced7afee36eb84270adc50977fb52772: Status 404 returned error can't find the container with id 7556db7bb39b112b94de3d9584843efcced7afee36eb84270adc50977fb52772 Jun 14 15:12:55.201719 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:55.201685 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" event={"ID":"8ae70dcb-c45c-4575-bc51-f287287eacf0","Type":"ContainerStarted","Data":"a1096516f62961977c50761a0eeee07b589213476bd7cbd421ecc65adffc9778"} Jun 14 15:12:55.201891 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:55.201739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc" event={"ID":"8ae70dcb-c45c-4575-bc51-f287287eacf0","Type":"ContainerStarted","Data":"7556db7bb39b112b94de3d9584843efcced7afee36eb84270adc50977fb52772"} Jun 14 15:12:57.553730 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.553692 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4"] Jun 14 15:12:57.558180 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.558157 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.560530 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.560510 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 14 15:12:57.566894 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.566874 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4"] Jun 14 15:12:57.677762 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.677719 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw4gm\" (UniqueName: \"kubernetes.io/projected/290dfcb6-f8b7-4973-a800-bc52b7357bb0-kube-api-access-pw4gm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.677935 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.677772 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.677935 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.677858 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/290dfcb6-f8b7-4973-a800-bc52b7357bb0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.677935 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.677890 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.677935 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.677921 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.678121 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.677984 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.778877 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.778834 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/290dfcb6-f8b7-4973-a800-bc52b7357bb0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.778877 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.778884 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.779154 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.778908 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.779154 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.778960 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.779154 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.779014 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw4gm\" (UniqueName: \"kubernetes.io/projected/290dfcb6-f8b7-4973-a800-bc52b7357bb0-kube-api-access-pw4gm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.779154 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.779120 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.779383 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.779325 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.779429 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.779391 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.779498 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.779476 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.781526 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.781498 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/290dfcb6-f8b7-4973-a800-bc52b7357bb0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.781757 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.781738 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/290dfcb6-f8b7-4973-a800-bc52b7357bb0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.787132 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.787101 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw4gm\" (UniqueName: \"kubernetes.io/projected/290dfcb6-f8b7-4973-a800-bc52b7357bb0-kube-api-access-pw4gm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4\" (UID: \"290dfcb6-f8b7-4973-a800-bc52b7357bb0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:57.871593 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:57.871479 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:12:58.018200 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:58.018162 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4"] Jun 14 15:12:58.019709 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:12:58.019681 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290dfcb6_f8b7_4973_a800_bc52b7357bb0.slice/crio-04fa4e313044edc5c370a0517ccd9d263110301eeb3851a0d572a5496be056a2 WatchSource:0}: Error finding container 04fa4e313044edc5c370a0517ccd9d263110301eeb3851a0d572a5496be056a2: Status 404 returned error can't find the container with id 04fa4e313044edc5c370a0517ccd9d263110301eeb3851a0d572a5496be056a2 Jun 14 15:12:58.230084 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:58.229972 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" event={"ID":"290dfcb6-f8b7-4973-a800-bc52b7357bb0","Type":"ContainerStarted","Data":"df7fd650ffeddb89407d56fd46ea6c2db3694e42538a90a6c24537170f770c83"} Jun 14 15:12:58.230084 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:58.230071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" event={"ID":"290dfcb6-f8b7-4973-a800-bc52b7357bb0","Type":"ContainerStarted","Data":"04fa4e313044edc5c370a0517ccd9d263110301eeb3851a0d572a5496be056a2"} Jun 14 15:12:58.544953 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:12:58.544862 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:13:00.244463 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:13:00.244427 2572 generic.go:356] "Generic (PLEG): container finished" podID="290dfcb6-f8b7-4973-a800-bc52b7357bb0" containerID="df7fd650ffeddb89407d56fd46ea6c2db3694e42538a90a6c24537170f770c83" exitCode=0 Jun 14 15:13:00.244892 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:13:00.244482 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" event={"ID":"290dfcb6-f8b7-4973-a800-bc52b7357bb0","Type":"ContainerDied","Data":"df7fd650ffeddb89407d56fd46ea6c2db3694e42538a90a6c24537170f770c83"} Jun 14 15:13:02.262472 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:13:02.262438 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" event={"ID":"290dfcb6-f8b7-4973-a800-bc52b7357bb0","Type":"ContainerStarted","Data":"b1d74fb7a12f5f1312acaabf4e2f9240f76a61b2ad0dfad9499f9ef89774a1b9"} Jun 14 15:13:02.284483 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:13:02.284432 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" podStartSLOduration=2.819948477 podStartE2EDuration="5.284416276s" totalImagesPullingTime="1.083327374s" totalInitContainerRuntime="1.381140425s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:13:02.281967655 +0000 UTC m=+1079.933161038" watchObservedRunningTime="2026-06-14 15:13:02.284416276 +0000 UTC m=+1079.935609643" Jun 14 15:13:07.871819 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:13:07.871767 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:13:07.872222 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:13:07.871841 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:13:07.884350 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:13:07.884326 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:13:08.310185 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:13:08.310156 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4" Jun 14 15:13:14.053998 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:13:14.053957 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:13:19.039674 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:13:19.039634 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:14:21.747028 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:14:21.746988 2572 generic.go:356] "Generic (PLEG): container finished" podID="43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3" containerID="28f034d657f89e97de43b510773fef8c51171ffaf4b9b659a89d945a93513864" exitCode=0 Jun 14 15:14:21.747483 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:14:21.747045 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" event={"ID":"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3","Type":"ContainerDied","Data":"28f034d657f89e97de43b510773fef8c51171ffaf4b9b659a89d945a93513864"} Jun 14 15:14:22.755008 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:14:22.754970 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" event={"ID":"43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3","Type":"ContainerStarted","Data":"67e5d57588ae8edca9285e0cb2cf946d89a81e26af9d7b9770301ab4a0ab7856"} Jun 14 15:14:22.774298 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:14:22.774243 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" podStartSLOduration=2.4181586680000002 podStartE2EDuration="1m55.774224718s" totalImagesPullingTime="4.213027001s" totalInitContainerRuntime="1m49.143039049s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:12:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:14:22.773541481 +0000 UTC m=+1160.424734851" watchObservedRunningTime="2026-06-14 15:14:22.774224718 +0000 UTC m=+1160.425418088" Jun 14 15:14:28.277116 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:14:28.277081 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:14:28.277603 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:14:28.277139 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:14:28.290469 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:14:28.290443 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:14:28.810980 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:14:28.810931 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz" Jun 14 15:15:02.907444 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:15:02.907417 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:15:02.911159 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:15:02.911137 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:15:02.912624 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:15:02.912600 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:15:02.915770 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:15:02.915752 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:16:53.950985 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:16:53.950952 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:17:04.463829 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:17:04.463798 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:17:13.044553 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:17:13.044513 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:17:23.644474 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:17:23.644398 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:17:32.180961 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:17:32.180921 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:17:42.739670 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:17:42.739626 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:18:55.555944 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:18:55.555868 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:19:11.661014 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:19:11.660976 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:19:50.755357 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:19:50.755317 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:20:02.951276 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:20:02.951245 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:20:02.959838 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:20:02.959810 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:20:02.960443 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:20:02.960424 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:20:02.965270 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:20:02.965253 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:20:07.056716 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:20:07.056681 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:20:23.150296 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:20:23.150221 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:20:39.252307 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:20:39.252271 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:21:38.543853 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:21:38.543812 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:21:47.494277 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:21:47.494234 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:22:04.356704 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:22:04.356630 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:22:12.656758 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:22:12.656718 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:22:30.246407 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:22:30.246370 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:22:37.947616 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:22:37.947583 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:23:11.139163 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:23:11.139125 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:23:19.145263 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:23:19.145226 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:23:22.596766 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:23:22.596731 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:23:29.052139 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:23:29.052094 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:23:36.554033 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:23:36.553993 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:23:45.166628 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:23:45.166590 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:24:11.342707 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:24:11.342672 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:24:24.575294 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:24:24.575259 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:24:53.193139 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:24:53.193048 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:24:55.855040 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:24:55.854998 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:25:03.009471 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:25:03.009439 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:25:03.014579 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:25:03.014539 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:25:03.018120 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:25:03.018099 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:25:03.024788 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:25:03.024766 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:25:12.637427 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:25:12.637390 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:25:20.146798 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:25:20.146762 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:25:39.340694 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:25:39.340654 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:25:47.838757 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:25:47.838720 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:25:56.943732 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:25:56.943694 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:26:05.653933 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:26:05.653895 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:26:14.750976 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:26:14.750934 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:26:23.643906 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:26:23.643822 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:26:32.152676 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:26:32.152640 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:26:40.740102 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:26:40.740064 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:26:48.942497 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:26:48.942457 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:26:57.134979 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:26:57.134942 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:27:58.939891 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:58.939773 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn"] Jun 14 15:27:58.940455 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:58.940043 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" podUID="61a52397-5a80-4ff1-9632-2f773282e3d1" containerName="manager" containerID="cri-o://03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370" gracePeriod=10 Jun 14 15:27:59.206460 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.206434 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:27:59.270004 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.269971 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61a52397-5a80-4ff1-9632-2f773282e3d1-extensions-socket-volume\") pod \"61a52397-5a80-4ff1-9632-2f773282e3d1\" (UID: \"61a52397-5a80-4ff1-9632-2f773282e3d1\") " Jun 14 15:27:59.270191 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.270019 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmrdn\" (UniqueName: \"kubernetes.io/projected/61a52397-5a80-4ff1-9632-2f773282e3d1-kube-api-access-xmrdn\") pod \"61a52397-5a80-4ff1-9632-2f773282e3d1\" (UID: \"61a52397-5a80-4ff1-9632-2f773282e3d1\") " Jun 14 15:27:59.270327 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.270305 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61a52397-5a80-4ff1-9632-2f773282e3d1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "61a52397-5a80-4ff1-9632-2f773282e3d1" (UID: "61a52397-5a80-4ff1-9632-2f773282e3d1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:27:59.272209 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.272184 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61a52397-5a80-4ff1-9632-2f773282e3d1-kube-api-access-xmrdn" (OuterVolumeSpecName: "kube-api-access-xmrdn") pod "61a52397-5a80-4ff1-9632-2f773282e3d1" (UID: "61a52397-5a80-4ff1-9632-2f773282e3d1"). InnerVolumeSpecName "kube-api-access-xmrdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:27:59.371144 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.371117 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61a52397-5a80-4ff1-9632-2f773282e3d1-extensions-socket-volume\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:27:59.371144 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.371142 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmrdn\" (UniqueName: \"kubernetes.io/projected/61a52397-5a80-4ff1-9632-2f773282e3d1-kube-api-access-xmrdn\") on node \"ip-10-0-133-52.ec2.internal\" DevicePath \"\"" Jun 14 15:27:59.943832 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.943796 2572 generic.go:356] "Generic (PLEG): container finished" podID="61a52397-5a80-4ff1-9632-2f773282e3d1" containerID="03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370" exitCode=0 Jun 14 15:27:59.944305 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.943837 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" Jun 14 15:27:59.944305 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.943883 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" event={"ID":"61a52397-5a80-4ff1-9632-2f773282e3d1","Type":"ContainerDied","Data":"03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370"} Jun 14 15:27:59.944305 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.943952 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn" event={"ID":"61a52397-5a80-4ff1-9632-2f773282e3d1","Type":"ContainerDied","Data":"26db322ee5d64b4c8163b924170cb688dc2c739406bcbe48b35fb90c8ad28206"} Jun 14 15:27:59.944305 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.943990 2572 scope.go:117] "RemoveContainer" containerID="03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370" Jun 14 15:27:59.955252 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.955235 2572 scope.go:117] "RemoveContainer" containerID="03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370" Jun 14 15:27:59.955552 ip-10-0-133-52 kubenswrapper[2572]: E0614 15:27:59.955535 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370\": container with ID starting with 03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370 not found: ID does not exist" containerID="03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370" Jun 14 15:27:59.955641 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.955583 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370"} err="failed to get container status \"03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370\": rpc error: code = NotFound desc = could not find container \"03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370\": container with ID starting with 03b5b28502655dac0ffb2a6182bb0d6ce991ac8594a6b00d22b64cf5f00bb370 not found: ID does not exist" Jun 14 15:27:59.968799 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.968770 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn"] Jun 14 15:27:59.971835 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:27:59.971814 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hwtvn"] Jun 14 15:28:00.807719 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:28:00.807688 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61a52397-5a80-4ff1-9632-2f773282e3d1" path="/var/lib/kubelet/pods/61a52397-5a80-4ff1-9632-2f773282e3d1/volumes" Jun 14 15:29:05.083993 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.083929 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg"] Jun 14 15:29:05.084700 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.084678 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a52397-5a80-4ff1-9632-2f773282e3d1" containerName="manager" Jun 14 15:29:05.084795 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.084702 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a52397-5a80-4ff1-9632-2f773282e3d1" containerName="manager" Jun 14 15:29:05.084851 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.084826 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="61a52397-5a80-4ff1-9632-2f773282e3d1" containerName="manager" Jun 14 15:29:05.088111 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.088085 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" Jun 14 15:29:05.091794 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.091763 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lpknv\"" Jun 14 15:29:05.110253 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.110213 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg"] Jun 14 15:29:05.186214 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.186150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzc6j\" (UniqueName: \"kubernetes.io/projected/b35d9f17-358b-4722-80e2-f6f8b636d440-kube-api-access-nzc6j\") pod \"kuadrant-operator-controller-manager-86878c769f-mmxtg\" (UID: \"b35d9f17-358b-4722-80e2-f6f8b636d440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" Jun 14 15:29:05.186440 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.186361 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b35d9f17-358b-4722-80e2-f6f8b636d440-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mmxtg\" (UID: \"b35d9f17-358b-4722-80e2-f6f8b636d440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" Jun 14 15:29:05.287420 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.287366 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzc6j\" (UniqueName: \"kubernetes.io/projected/b35d9f17-358b-4722-80e2-f6f8b636d440-kube-api-access-nzc6j\") pod \"kuadrant-operator-controller-manager-86878c769f-mmxtg\" (UID: \"b35d9f17-358b-4722-80e2-f6f8b636d440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" Jun 14 15:29:05.287677 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.287458 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b35d9f17-358b-4722-80e2-f6f8b636d440-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mmxtg\" (UID: \"b35d9f17-358b-4722-80e2-f6f8b636d440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" Jun 14 15:29:05.287911 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.287888 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b35d9f17-358b-4722-80e2-f6f8b636d440-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mmxtg\" (UID: \"b35d9f17-358b-4722-80e2-f6f8b636d440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" Jun 14 15:29:05.297622 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.297588 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzc6j\" (UniqueName: \"kubernetes.io/projected/b35d9f17-358b-4722-80e2-f6f8b636d440-kube-api-access-nzc6j\") pod \"kuadrant-operator-controller-manager-86878c769f-mmxtg\" (UID: \"b35d9f17-358b-4722-80e2-f6f8b636d440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" Jun 14 15:29:05.399969 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.399873 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" Jun 14 15:29:05.571182 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:05.571148 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg"] Jun 14 15:29:05.573367 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:29:05.573335 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb35d9f17_358b_4722_80e2_f6f8b636d440.slice/crio-f34b8de1a3072f2452230edd79d9a59ad551a2bc47e0eaa675bac944d6e0874e WatchSource:0}: Error finding container f34b8de1a3072f2452230edd79d9a59ad551a2bc47e0eaa675bac944d6e0874e: Status 404 returned error can't find the container with id f34b8de1a3072f2452230edd79d9a59ad551a2bc47e0eaa675bac944d6e0874e Jun 14 15:29:06.375660 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:06.375609 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" event={"ID":"b35d9f17-358b-4722-80e2-f6f8b636d440","Type":"ContainerStarted","Data":"b277067a706ace9243b107568f89722b6c3964c189f534cfc305b58dd1311607"} Jun 14 15:29:06.376138 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:06.375680 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" event={"ID":"b35d9f17-358b-4722-80e2-f6f8b636d440","Type":"ContainerStarted","Data":"f34b8de1a3072f2452230edd79d9a59ad551a2bc47e0eaa675bac944d6e0874e"} Jun 14 15:29:06.376138 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:06.375709 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" Jun 14 15:29:06.399058 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:06.399000 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" podStartSLOduration=1.398983082 podStartE2EDuration="1.398983082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:29:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:29:06.396830738 +0000 UTC m=+2044.048024109" watchObservedRunningTime="2026-06-14 15:29:06.398983082 +0000 UTC m=+2044.050176451" Jun 14 15:29:17.384423 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:17.384390 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mmxtg" Jun 14 15:29:45.838900 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:45.838866 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:29:49.250765 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:29:49.250722 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:30:00.042697 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:30:00.042659 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:30:03.054998 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:30:03.054969 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:30:03.059950 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:30:03.059925 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:30:03.065530 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:30:03.065510 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:30:03.069996 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:30:03.069979 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:30:09.345295 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:30:09.345252 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:30:19.545971 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:30:19.545924 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:30:29.155418 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:30:29.155372 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:30:38.942743 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:30:38.942706 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:30:48.543008 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:30:48.542971 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:30:57.950256 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:30:57.950169 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:31:08.039511 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:31:08.039472 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:31:16.849240 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:31:16.849207 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:31:22.049503 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:31:22.049461 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:31:49.446091 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:31:49.446055 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:32:32.356045 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:32:32.355943 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:32:40.943299 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:32:40.943257 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:32:49.753175 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:32:49.753134 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:32:58.856255 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:32:58.856223 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:33:08.135773 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:33:08.135728 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:33:18.954955 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:33:18.954918 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:33:23.241331 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:33:23.241299 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:33:29.538965 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:33:29.538918 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:33:33.686509 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:33:33.686423 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:33:42.976313 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:33:42.976262 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:33:51.447761 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:33:51.447674 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:33:59.436230 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:33:59.436186 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:34:09.936090 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:34:09.936050 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:34:29.241477 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:34:29.241440 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:34:35.775089 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:34:35.775048 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:34:46.549090 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:34:46.549047 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:34:53.745726 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:34:53.745688 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:35:03.102939 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:35:03.102912 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:35:03.107811 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:35:03.107768 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:35:03.115067 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:35:03.115047 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:35:03.119766 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:35:03.119748 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:35:11.735287 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:35:11.735247 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:35:19.244603 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:35:19.244551 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:35:28.043370 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:35:28.043332 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:35:35.547384 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:35:35.547345 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:35:46.549347 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:35:46.549310 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:35:54.241827 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:35:54.241783 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:36:02.742758 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:36:02.742718 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:36:13.447984 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:36:13.447948 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:36:23.741290 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:36:23.741247 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:36:35.835940 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:36:35.835899 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:36:46.423084 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:36:46.423045 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:36:50.639966 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:36:50.639881 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:37:01.400515 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:37:01.400474 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:37:05.448669 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:37:05.448630 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:37:23.740422 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:37:23.740383 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:37:37.048973 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:37:37.048923 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gsmvx"] Jun 14 15:40:03.146230 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:40:03.146142 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:40:03.151546 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:40:03.151510 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:40:03.160939 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:40:03.160916 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:40:03.165936 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:40:03.165912 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:44:34.880368 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:34.880341 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f68ccfc94-hkbh8_bf8c11af-0505-4525-b142-70ff1e1c4efb/nginx/0.log" Jun 14 15:44:35.103099 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:35.103070 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mf8wk_a8a5844b-eadc-450e-acfe-2f4195158268/manager/0.log" Jun 14 15:44:35.223254 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:35.223179 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-p9jgh_4977c193-23b3-4818-a407-12b0ebe4013a/manager/0.log" Jun 14 15:44:35.789554 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:35.789521 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-h5knv_d3e51be3-6a53-441a-b495-ec6a4a2778e9/server/0.log" Jun 14 15:44:35.916813 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:35.916783 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4wt7l_ec082ef1-80c3-4f0b-a9ba-60ef08738e8f/manager/0.log" Jun 14 15:44:36.032645 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:36.032617 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-22wtb_6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62/copy-manifests/0.log" Jun 14 15:44:36.040578 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:36.040469 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-22wtb_6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62/manager/0.log" Jun 14 15:44:37.193845 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.193815 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s_43d7860c-baee-4637-afee-352c983c3ad8/util/0.log" Jun 14 15:44:37.201765 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.201743 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s_43d7860c-baee-4637-afee-352c983c3ad8/pull/0.log" Jun 14 15:44:37.211524 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.211504 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s_43d7860c-baee-4637-afee-352c983c3ad8/extract/0.log" Jun 14 15:44:37.340092 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.340068 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk_6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf/extract/0.log" Jun 14 15:44:37.352280 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.352261 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk_6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf/util/0.log" Jun 14 15:44:37.366103 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.366078 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk_6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf/pull/0.log" Jun 14 15:44:37.477316 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.477224 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845_14ae425b-9d65-4cf0-a251-a2399ff773a6/extract/0.log" Jun 14 15:44:37.484407 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.484380 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845_14ae425b-9d65-4cf0-a251-a2399ff773a6/util/0.log" Jun 14 15:44:37.491312 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.491281 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845_14ae425b-9d65-4cf0-a251-a2399ff773a6/pull/0.log" Jun 14 15:44:37.599851 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.599819 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2_b037bb3c-a5d2-4d8a-a28b-550ed98ca13f/util/0.log" Jun 14 15:44:37.606905 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.606883 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2_b037bb3c-a5d2-4d8a-a28b-550ed98ca13f/pull/0.log" Jun 14 15:44:37.613666 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.613640 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2_b037bb3c-a5d2-4d8a-a28b-550ed98ca13f/extract/0.log" Jun 14 15:44:37.977299 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:37.977269 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jx7wc_29bc74a5-8741-43af-8992-76b4d9d94f4b/manager/0.log" Jun 14 15:44:38.334105 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:38.334063 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mmxtg_b35d9f17-358b-4722-80e2-f6f8b636d440/manager/0.log" Jun 14 15:44:38.468388 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:38.468348 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gsmvx_39492a27-bf91-4b96-9d7c-f67c813b159d/limitador/0.log" Jun 14 15:44:39.044282 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:39.044252 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fb6cc_13a9f168-a27d-4b43-87e9-518285ea6d8a/discovery/0.log" Jun 14 15:44:39.152203 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:39.152169 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cfd86dcb-frkjz_fd039da6-3ec2-4371-8aad-afef9ca665b9/kube-auth-proxy/0.log" Jun 14 15:44:39.497706 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:39.497667 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7qbr7_e5a57c51-a511-4831-bc81-c25720271277/payload-pre-processing/0.log" Jun 14 15:44:39.616695 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:39.616665 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-xm56f_0268755f-e126-4a92-91f5-325eed18f9e3/payload-processing/0.log" Jun 14 15:44:39.728283 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:39.728240 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f859595b-bwxg8_65558665-5b69-4003-b6d6-c90ced0698ab/router/0.log" Jun 14 15:44:40.068874 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:40.068845 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz_43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3/storage-initializer/0.log" Jun 14 15:44:40.077171 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:40.077147 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jscvz_43f2ccff-4bf5-4aee-bb2a-5c0d43324ed3/main/0.log" Jun 14 15:44:40.318764 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:40.318732 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-v7pfc_8ae70dcb-c45c-4575-bc51-f287287eacf0/storage-initializer/0.log" Jun 14 15:44:40.442364 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:40.442280 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4_290dfcb6-f8b7-4973-a800-bc52b7357bb0/main/0.log" Jun 14 15:44:40.450121 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:40.450096 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjzrq4_290dfcb6-f8b7-4973-a800-bc52b7357bb0/storage-initializer/0.log" Jun 14 15:44:48.337781 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:48.337750 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k4qgj_a96cd2e4-53eb-48b5-b3f7-b903b797c60c/global-pull-secret-syncer/0.log" Jun 14 15:44:48.473666 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:48.473638 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xjtcd_55ffa0e4-b658-4c7f-b31e-a30360bf405a/konnectivity-agent/0.log" Jun 14 15:44:48.497863 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:48.497830 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-52.ec2.internal_e20e21bef33d0fe9c39c7011fd989107/haproxy/0.log" Jun 14 15:44:51.637636 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:51.637602 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-z8278_03a83732-0fec-4930-ab5c-577cf83b3796/sail-operator/0.log" Jun 14 15:44:53.046421 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.046392 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s_43d7860c-baee-4637-afee-352c983c3ad8/extract/0.log" Jun 14 15:44:53.072087 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.072058 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s_43d7860c-baee-4637-afee-352c983c3ad8/util/0.log" Jun 14 15:44:53.102979 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.102950 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594bx6s_43d7860c-baee-4637-afee-352c983c3ad8/pull/0.log" Jun 14 15:44:53.136472 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.136434 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk_6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf/extract/0.log" Jun 14 15:44:53.168690 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.168665 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk_6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf/util/0.log" Jun 14 15:44:53.202738 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.202710 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0td6bk_6eb789b6-db2b-4fd3-b20c-e4ec6ddc15cf/pull/0.log" Jun 14 15:44:53.252968 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.252939 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845_14ae425b-9d65-4cf0-a251-a2399ff773a6/extract/0.log" Jun 14 15:44:53.296018 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.295991 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845_14ae425b-9d65-4cf0-a251-a2399ff773a6/util/0.log" Jun 14 15:44:53.322874 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.322783 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j5845_14ae425b-9d65-4cf0-a251-a2399ff773a6/pull/0.log" Jun 14 15:44:53.361914 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.361884 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2_b037bb3c-a5d2-4d8a-a28b-550ed98ca13f/extract/0.log" Jun 14 15:44:53.388378 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.388352 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2_b037bb3c-a5d2-4d8a-a28b-550ed98ca13f/util/0.log" Jun 14 15:44:53.416119 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.416091 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kzml2_b037bb3c-a5d2-4d8a-a28b-550ed98ca13f/pull/0.log" Jun 14 15:44:53.834750 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:53.834711 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jx7wc_29bc74a5-8741-43af-8992-76b4d9d94f4b/manager/0.log" Jun 14 15:44:54.027579 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:54.027529 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mmxtg_b35d9f17-358b-4722-80e2-f6f8b636d440/manager/0.log" Jun 14 15:44:54.053518 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:54.053481 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gsmvx_39492a27-bf91-4b96-9d7c-f67c813b159d/limitador/0.log" Jun 14 15:44:55.667228 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:55.667198 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69548512-e6a7-403e-b062-cf5867b6cbf0/alertmanager/0.log" Jun 14 15:44:55.703469 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:55.703436 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69548512-e6a7-403e-b062-cf5867b6cbf0/config-reloader/0.log" Jun 14 15:44:55.730518 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:55.730485 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69548512-e6a7-403e-b062-cf5867b6cbf0/kube-rbac-proxy-web/0.log" Jun 14 15:44:55.763666 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:55.763634 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69548512-e6a7-403e-b062-cf5867b6cbf0/kube-rbac-proxy/0.log" Jun 14 15:44:55.790498 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:55.790471 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69548512-e6a7-403e-b062-cf5867b6cbf0/kube-rbac-proxy-metric/0.log" Jun 14 15:44:55.827447 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:55.827412 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69548512-e6a7-403e-b062-cf5867b6cbf0/prom-label-proxy/0.log" Jun 14 15:44:55.856192 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:55.856160 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_69548512-e6a7-403e-b062-cf5867b6cbf0/init-config-reloader/0.log" Jun 14 15:44:56.054815 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.054787 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-8djcf_2aa6e792-a2c2-4542-8444-f1bc11207de7/monitoring-plugin/0.log" Jun 14 15:44:56.201161 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.201114 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcnx9_042ecb39-d8a7-431e-b301-5dd5896712ba/node-exporter/0.log" Jun 14 15:44:56.239425 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.239401 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcnx9_042ecb39-d8a7-431e-b301-5dd5896712ba/kube-rbac-proxy/0.log" Jun 14 15:44:56.270428 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.270354 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcnx9_042ecb39-d8a7-431e-b301-5dd5896712ba/init-textfile/0.log" Jun 14 15:44:56.729187 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.729155 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-d2tfm_2755e9c6-5e62-4af8-aa67-b7b941a8291d/prometheus-operator/0.log" Jun 14 15:44:56.749541 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.749508 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-d2tfm_2755e9c6-5e62-4af8-aa67-b7b941a8291d/kube-rbac-proxy/0.log" Jun 14 15:44:56.777266 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.777241 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-mv5zv_f2dfec55-ead9-4f57-854e-b71f7a3cb85b/prometheus-operator-admission-webhook/0.log" Jun 14 15:44:56.822205 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.822176 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8556b87877-9xbm6_f7164ded-d87b-4067-8e2c-3827e66f579c/telemeter-client/0.log" Jun 14 15:44:56.849302 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.849274 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8556b87877-9xbm6_f7164ded-d87b-4067-8e2c-3827e66f579c/reload/0.log" Jun 14 15:44:56.872500 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.872470 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8556b87877-9xbm6_f7164ded-d87b-4067-8e2c-3827e66f579c/kube-rbac-proxy/0.log" Jun 14 15:44:56.906176 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.906148 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6984986fd6-spxg7_3dd8732b-bb2c-4bb1-99df-a39fcc84cd72/thanos-query/0.log" Jun 14 15:44:56.934100 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.934076 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6984986fd6-spxg7_3dd8732b-bb2c-4bb1-99df-a39fcc84cd72/kube-rbac-proxy-web/0.log" Jun 14 15:44:56.957722 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.957682 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6984986fd6-spxg7_3dd8732b-bb2c-4bb1-99df-a39fcc84cd72/kube-rbac-proxy/0.log" Jun 14 15:44:56.982255 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:56.982181 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6984986fd6-spxg7_3dd8732b-bb2c-4bb1-99df-a39fcc84cd72/prom-label-proxy/0.log" Jun 14 15:44:57.005749 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:57.005720 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6984986fd6-spxg7_3dd8732b-bb2c-4bb1-99df-a39fcc84cd72/kube-rbac-proxy-rules/0.log" Jun 14 15:44:57.032557 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:57.032527 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6984986fd6-spxg7_3dd8732b-bb2c-4bb1-99df-a39fcc84cd72/kube-rbac-proxy-metrics/0.log" Jun 14 15:44:58.933904 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:58.933872 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:44:58.943502 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:58.943452 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/2.log" Jun 14 15:44:59.504113 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:59.504082 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bb7965ffc-wkhqc_a20fa96d-ba85-4d1e-a961-d8cf4bac7407/console/0.log" Jun 14 15:44:59.547138 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:44:59.547101 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-6dpx8_2b6db696-87b4-406e-9754-204eee61f87f/download-server/0.log" Jun 14 15:45:00.118747 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.118709 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv"] Jun 14 15:45:00.123034 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.123018 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.125716 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.125694 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z9pc6\"/\"kube-root-ca.crt\"" Jun 14 15:45:00.126747 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.126730 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z9pc6\"/\"default-dockercfg-fng5t\"" Jun 14 15:45:00.126747 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.126741 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z9pc6\"/\"openshift-service-ca.crt\"" Jun 14 15:45:00.134461 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.134438 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv"] Jun 14 15:45:00.237774 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.237733 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-lib-modules\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.237948 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.237795 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-proc\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.237948 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.237858 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-podres\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.237948 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.237891 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-sys\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.237948 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.237921 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhwrx\" (UniqueName: \"kubernetes.io/projected/4f5bc206-34e8-4864-ac20-0cec8761b90f-kube-api-access-nhwrx\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.339502 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.339465 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-lib-modules\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.339696 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.339513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-proc\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.339696 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.339656 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-proc\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.339696 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.339655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-podres\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.339799 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.339697 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-lib-modules\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.339799 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.339705 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-sys\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.339799 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.339761 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhwrx\" (UniqueName: \"kubernetes.io/projected/4f5bc206-34e8-4864-ac20-0cec8761b90f-kube-api-access-nhwrx\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.339799 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.339780 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-podres\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.339923 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.339780 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f5bc206-34e8-4864-ac20-0cec8761b90f-sys\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.348046 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.348014 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhwrx\" (UniqueName: \"kubernetes.io/projected/4f5bc206-34e8-4864-ac20-0cec8761b90f-kube-api-access-nhwrx\") pod \"perf-node-gather-daemonset-ncplv\" (UID: \"4f5bc206-34e8-4864-ac20-0cec8761b90f\") " pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.433905 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.433805 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:00.572755 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:00.572730 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv"] Jun 14 15:45:00.574465 ip-10-0-133-52 kubenswrapper[2572]: W0614 15:45:00.574438 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4f5bc206_34e8_4864_ac20_0cec8761b90f.slice/crio-017f712d9583499b2018cbad65922574a7badcf103332ed54c54b1793fc76569 WatchSource:0}: Error finding container 017f712d9583499b2018cbad65922574a7badcf103332ed54c54b1793fc76569: Status 404 returned error can't find the container with id 017f712d9583499b2018cbad65922574a7badcf103332ed54c54b1793fc76569 Jun 14 15:45:01.373178 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:01.373121 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" event={"ID":"4f5bc206-34e8-4864-ac20-0cec8761b90f","Type":"ContainerStarted","Data":"7a49aa4e412a790f085aebcc05688c10ff27ee1f1fea2fb142c169010328efb2"} Jun 14 15:45:01.373548 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:01.373197 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" event={"ID":"4f5bc206-34e8-4864-ac20-0cec8761b90f","Type":"ContainerStarted","Data":"017f712d9583499b2018cbad65922574a7badcf103332ed54c54b1793fc76569"} Jun 14 15:45:01.373548 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:01.373311 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:01.393711 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:01.393659 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" podStartSLOduration=1.393641487 podStartE2EDuration="1.393641487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:45:01.391984074 +0000 UTC m=+2999.043177444" watchObservedRunningTime="2026-06-14 15:45:01.393641487 +0000 UTC m=+2999.044834856" Jun 14 15:45:01.769777 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:01.769691 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s8tjb_20409142-101a-45b7-81e9-70f3a62939ab/dns/0.log" Jun 14 15:45:01.803389 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:01.803361 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s8tjb_20409142-101a-45b7-81e9-70f3a62939ab/kube-rbac-proxy/0.log" Jun 14 15:45:01.890861 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:01.890834 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ff8ft_261cff16-3b72-49bc-8d5c-0f0adc1f6b41/dns-node-resolver/0.log" Jun 14 15:45:02.558788 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:02.558759 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mlskw_56ea1beb-5880-4c72-bfb2-b57784851c0f/node-ca/0.log" Jun 14 15:45:03.190710 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:03.190677 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:45:03.196080 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:03.196051 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:45:03.211308 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:03.211283 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-8g46n_52970f42-ef4e-4211-a90e-9180254d82b4/console-operator/1.log" Jun 14 15:45:03.215987 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:03.215965 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vrfxm_7965caed-3f5d-4864-a069-ca3f44b2b6f8/ovn-acl-logging/0.log" Jun 14 15:45:03.693013 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:03.692974 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fb6cc_13a9f168-a27d-4b43-87e9-518285ea6d8a/discovery/0.log" Jun 14 15:45:03.715258 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:03.715226 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cfd86dcb-frkjz_fd039da6-3ec2-4371-8aad-afef9ca665b9/kube-auth-proxy/0.log" Jun 14 15:45:03.846837 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:03.846801 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7qbr7_e5a57c51-a511-4831-bc81-c25720271277/payload-pre-processing/0.log" Jun 14 15:45:03.946222 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:03.946133 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-xm56f_0268755f-e126-4a92-91f5-325eed18f9e3/payload-processing/0.log" Jun 14 15:45:03.975021 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:03.974988 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f859595b-bwxg8_65558665-5b69-4003-b6d6-c90ced0698ab/router/0.log" Jun 14 15:45:04.655557 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:04.655524 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w9slm_7f47767f-8df8-4ab4-aefb-7333d61ddf0f/serve-healthcheck-canary/0.log" Jun 14 15:45:05.500654 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:05.500622 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8h9s_7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20/kube-rbac-proxy/0.log" Jun 14 15:45:05.531989 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:05.531955 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8h9s_7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20/exporter/0.log" Jun 14 15:45:05.561486 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:05.561457 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8h9s_7ef3d01c-2a7f-4b9f-9095-8f2d31d2fa20/extractor/0.log" Jun 14 15:45:07.391240 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:07.391215 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z9pc6/perf-node-gather-daemonset-ncplv" Jun 14 15:45:07.962662 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:07.962624 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f68ccfc94-hkbh8_bf8c11af-0505-4525-b142-70ff1e1c4efb/nginx/0.log" Jun 14 15:45:08.016048 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:08.016013 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mf8wk_a8a5844b-eadc-450e-acfe-2f4195158268/manager/0.log" Jun 14 15:45:08.135260 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:08.135225 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-p9jgh_4977c193-23b3-4818-a407-12b0ebe4013a/manager/0.log" Jun 14 15:45:08.366465 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:08.366436 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-h5knv_d3e51be3-6a53-441a-b495-ec6a4a2778e9/server/0.log" Jun 14 15:45:08.446249 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:08.446214 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4wt7l_ec082ef1-80c3-4f0b-a9ba-60ef08738e8f/manager/0.log" Jun 14 15:45:08.471604 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:08.471553 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-22wtb_6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62/manager/0.log" Jun 14 15:45:08.495060 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:08.495035 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8b6c5698-22wtb_6807c0ff-cdb1-4cc5-a7a5-10a90c3cde62/copy-manifests/0.log" Jun 14 15:45:10.563086 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:10.563053 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cl87t_09816be2-ca69-40b2-a254-9b5ba6f6fb8a/openshift-lws-operator/0.log" Jun 14 15:45:13.460711 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:13.460677 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fb6cc_13a9f168-a27d-4b43-87e9-518285ea6d8a/discovery/0.log" Jun 14 15:45:13.487814 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:13.487786 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cfd86dcb-frkjz_fd039da6-3ec2-4371-8aad-afef9ca665b9/kube-auth-proxy/0.log" Jun 14 15:45:13.607640 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:13.607612 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7qbr7_e5a57c51-a511-4831-bc81-c25720271277/payload-pre-processing/0.log" Jun 14 15:45:13.714689 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:13.714595 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-xm56f_0268755f-e126-4a92-91f5-325eed18f9e3/payload-processing/0.log" Jun 14 15:45:13.740088 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:13.740050 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f859595b-bwxg8_65558665-5b69-4003-b6d6-c90ced0698ab/router/0.log" Jun 14 15:45:15.074149 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:15.074112 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fb6cc_13a9f168-a27d-4b43-87e9-518285ea6d8a/discovery/0.log" Jun 14 15:45:15.119802 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:15.119768 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cfd86dcb-frkjz_fd039da6-3ec2-4371-8aad-afef9ca665b9/kube-auth-proxy/0.log" Jun 14 15:45:15.253555 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:15.253523 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7qbr7_e5a57c51-a511-4831-bc81-c25720271277/payload-pre-processing/0.log" Jun 14 15:45:15.348182 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:15.348098 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-xm56f_0268755f-e126-4a92-91f5-325eed18f9e3/payload-processing/0.log" Jun 14 15:45:15.368515 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:15.368485 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56f859595b-bwxg8_65558665-5b69-4003-b6d6-c90ced0698ab/router/0.log" Jun 14 15:45:15.948887 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:15.948858 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-w7jc7_0a765b3d-c90f-4987-8180-b4aa90dcfe1d/migrator/0.log" Jun 14 15:45:15.977937 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:15.977837 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-w7jc7_0a765b3d-c90f-4987-8180-b4aa90dcfe1d/graceful-termination/0.log" Jun 14 15:45:17.300788 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:17.300757 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fb6cc_13a9f168-a27d-4b43-87e9-518285ea6d8a/discovery/0.log" Jun 14 15:45:17.388425 ip-10-0-133-52 kubenswrapper[2572]: I0614 15:45:17.388389 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cfd86dcb-frkjz_fd039da6-3ec2-4371-8aad-afef9ca665b9/kube-auth-proxy/0.log"