Jul 15 20:47:43.225078 ip-10-0-138-248 systemd[1]: Starting Kubernetes Kubelet... Jul 15 20:47:43.591364 ip-10-0-138-248 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 20:47:43.591364 ip-10-0-138-248 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 20:47:43.591364 ip-10-0-138-248 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 20:47:43.591364 ip-10-0-138-248 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 20:47:43.591364 ip-10-0-138-248 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 20:47:43.592212 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.592129 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 20:47:43.596977 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.596951 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 20:47:43.596977 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.596970 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 20:47:43.596977 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.596974 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 20:47:43.596977 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.596978 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 20:47:43.596977 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.596990 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.596994 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.596997 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597000 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597003 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597005 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597008 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597010 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597014 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597016 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597019 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597021 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597024 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597026 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597029 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597032 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597035 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597037 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597041 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597043 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 20:47:43.597183 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597047 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597049 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597052 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597054 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597058 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597062 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597066 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597069 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597072 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597075 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597078 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597082 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597084 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597086 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597090 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597093 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597095 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597098 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597100 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597103 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 20:47:43.597652 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597106 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597108 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597111 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597114 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597117 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597121 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597125 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597127 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597130 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597134 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597138 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597141 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597144 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597147 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597150 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597154 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597158 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597161 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597163 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 20:47:43.598159 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597166 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597168 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597171 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597174 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597176 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597179 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597183 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597186 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597189 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597192 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597195 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597197 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597200 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597203 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597207 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597210 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597213 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597215 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597218 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597220 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 20:47:43.598612 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597224 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597227 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597229 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597232 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597235 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597239 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597243 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597246 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597248 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597251 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597253 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597256 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597259 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597261 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597264 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 20:47:43.599100 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.597267 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599364 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599373 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599376 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599380 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599382 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599385 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599388 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599390 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599393 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599395 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599398 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599401 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599403 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599406 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599408 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599411 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599413 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599417 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599419 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 20:47:43.599454 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599422 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599424 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599427 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599429 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599432 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599434 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599437 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599439 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599442 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599444 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599447 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599449 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599451 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599454 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599458 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599461 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599464 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599467 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599469 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599472 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 20:47:43.599950 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599474 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599477 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599479 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599482 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599485 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599489 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599491 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599494 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599496 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599499 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599501 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599504 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599507 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599510 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599514 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599519 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599522 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599525 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599528 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 20:47:43.600431 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599530 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599533 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599536 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599539 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599541 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599544 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599547 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599550 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599553 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599556 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599559 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599562 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599564 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599567 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599571 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599573 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599576 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599578 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599580 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 20:47:43.600904 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599584 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599588 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599591 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599593 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599596 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599599 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599602 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599605 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599608 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599611 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599613 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599616 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599618 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599621 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599624 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599626 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599628 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599631 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599633 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599636 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 20:47:43.601379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599639 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.599641 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600076 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600083 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600086 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600089 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600092 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600094 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600097 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600100 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600103 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600107 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600110 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600113 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600116 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600118 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600122 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600125 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600127 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600130 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 20:47:43.601966 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600133 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600136 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600138 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600141 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600144 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600146 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600149 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600151 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600153 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600156 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600158 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600161 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600163 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600166 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600170 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600173 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600176 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600178 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600181 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 20:47:43.602476 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600183 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600186 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600188 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600191 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600193 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600196 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600198 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600201 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600203 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600205 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600208 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600210 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600213 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600217 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600219 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600221 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600224 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600227 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600229 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600231 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 20:47:43.602957 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600234 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600236 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600239 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600241 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600243 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600247 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600249 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600252 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600254 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600257 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600259 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600262 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600264 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600266 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600269 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600271 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600274 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600277 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600279 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 20:47:43.603432 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600281 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600284 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600286 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600289 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600291 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600294 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600297 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600300 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600302 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600306 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600310 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600313 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600316 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600319 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600322 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600324 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600327 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600329 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600331 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 20:47:43.603929 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600334 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600336 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600338 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.600341 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600407 2553 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600414 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600420 2553 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600425 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600436 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600441 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600447 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600453 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600456 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600459 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600462 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600465 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600468 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600471 2553 flags.go:64] FLAG: --cgroup-root="" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600474 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600477 2553 flags.go:64] FLAG: --client-ca-file="" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600481 2553 flags.go:64] FLAG: --cloud-provider="external" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600484 2553 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600489 2553 flags.go:64] FLAG: --cluster-domain="" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600492 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 20:47:43.604379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600495 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600498 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600501 2553 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600505 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600508 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600511 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600514 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600517 2553 flags.go:64] FLAG: --contention-profiling="false" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600520 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600522 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600525 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600528 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600532 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600535 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600538 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600541 2553 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600544 2553 flags.go:64] FLAG: --enable-server="true" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600547 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600551 2553 flags.go:64] FLAG: --event-burst="100" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600554 2553 flags.go:64] FLAG: --event-qps="50" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600557 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600560 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600563 2553 flags.go:64] FLAG: --eviction-hard="" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600567 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 20:47:43.604992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600569 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600572 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600575 2553 flags.go:64] FLAG: --eviction-soft="" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600581 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600584 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600587 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600590 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600593 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600596 2553 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600599 2553 flags.go:64] FLAG: --feature-gates="" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600602 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600605 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600608 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600611 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600614 2553 flags.go:64] FLAG: --healthz-port="10248" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600617 2553 flags.go:64] FLAG: --help="false" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600620 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-138-248.ec2.internal" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600623 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600625 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600629 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600632 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600635 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600638 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 20:47:43.605552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600641 2553 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600645 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600648 2553 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600651 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600654 2553 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600656 2553 flags.go:64] FLAG: --kube-reserved="" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600659 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600662 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600665 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600668 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600670 2553 flags.go:64] FLAG: --lock-file="" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600673 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600677 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600680 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600685 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600689 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600692 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600694 2553 flags.go:64] FLAG: --logging-format="text" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600697 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600700 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600703 2553 flags.go:64] FLAG: --manifest-url="" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600706 2553 flags.go:64] FLAG: --manifest-url-header="" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600710 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600713 2553 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600717 2553 flags.go:64] FLAG: --max-pods="110" Jul 15 20:47:43.606201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600719 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600722 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600725 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600728 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600731 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600734 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600736 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600744 2553 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600748 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600752 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600754 2553 flags.go:64] FLAG: --pod-cidr="" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600757 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600762 2553 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600765 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600784 2553 flags.go:64] FLAG: --pods-per-core="0" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600788 2553 flags.go:64] FLAG: --port="10250" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600793 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600795 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c4d8b7fdeec3d56b" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600799 2553 flags.go:64] FLAG: --qos-reserved="" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600803 2553 flags.go:64] FLAG: --read-only-port="10255" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600806 2553 flags.go:64] FLAG: --register-node="true" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600809 2553 flags.go:64] FLAG: --register-with-taints="" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600813 2553 flags.go:64] FLAG: --registry-burst="10" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600816 2553 flags.go:64] FLAG: --registry-qps="5" Jul 15 20:47:43.606824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600819 2553 flags.go:64] FLAG: --reserved-cpus="" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600822 2553 flags.go:64] FLAG: --reserved-memory="" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600825 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600828 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600831 2553 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600834 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600837 2553 flags.go:64] FLAG: --runonce="false" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600840 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600843 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600846 2553 flags.go:64] FLAG: --seccomp-default="false" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600848 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600851 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600854 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600857 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600860 2553 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600863 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600866 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600870 2553 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600873 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600876 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600879 2553 flags.go:64] FLAG: --system-cgroups="" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600882 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600887 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600890 2553 flags.go:64] FLAG: --tls-cert-file="" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600892 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 20:47:43.607396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600897 2553 flags.go:64] FLAG: --tls-min-version="" Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600900 2553 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600905 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600908 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600911 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600914 2553 flags.go:64] FLAG: --v="2" Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600918 2553 flags.go:64] FLAG: --version="false" Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600922 2553 flags.go:64] FLAG: --vmodule="" Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600926 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.600929 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601071 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601075 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601078 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601081 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601084 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601087 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601090 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601092 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601095 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601097 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601099 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 20:47:43.608013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601103 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601107 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601110 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601115 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601118 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601121 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601124 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601127 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601129 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601132 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601135 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601137 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601140 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601144 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601146 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601149 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601153 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601157 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601160 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601163 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 20:47:43.608555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601166 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601168 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601171 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601174 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601176 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601179 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601181 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601184 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601186 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601189 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601191 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601194 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601196 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601198 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601201 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601205 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601207 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601210 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601212 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 20:47:43.609058 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601215 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601219 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601222 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601225 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601228 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601230 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601234 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601236 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601239 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601242 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601244 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601247 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601250 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601253 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601255 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601258 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601260 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601263 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601265 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601268 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 20:47:43.609509 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601270 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601273 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601275 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601278 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601281 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601283 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601286 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601288 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601292 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601295 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601298 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601300 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601303 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601305 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601308 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601310 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601313 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601315 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601319 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601321 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 20:47:43.610006 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601324 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601327 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601329 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601331 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601334 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601336 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601339 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601342 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.601344 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.601922 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.608717 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.608732 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.608751 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.608756 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608823 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 20:47:43.610483 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608829 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608832 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608836 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608839 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608842 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608845 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608848 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608851 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608854 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608856 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608859 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608862 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608864 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608868 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608871 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608873 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608876 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608878 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608881 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 20:47:43.610931 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608884 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608886 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608889 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608891 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608894 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608897 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608900 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608902 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608905 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608908 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608911 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608913 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608916 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608918 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608921 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608923 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608926 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608928 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608931 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608934 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 20:47:43.611382 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608936 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608939 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608941 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608944 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608946 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608949 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608952 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608954 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608957 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608959 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608962 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608964 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608967 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608969 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608972 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608976 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608979 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608994 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608997 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.608999 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 20:47:43.611873 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609002 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609005 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609008 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609010 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609013 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609015 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609019 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609022 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609025 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609028 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609031 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609034 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609037 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609039 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609042 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609044 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609047 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609049 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609052 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609055 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 20:47:43.612345 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609057 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609060 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609062 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609065 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609068 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609070 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609073 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609075 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609078 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609080 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609083 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609086 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609089 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609091 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609095 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609098 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609101 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609104 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 20:47:43.612824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609107 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.609112 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609231 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609236 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609239 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609242 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609246 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609250 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609253 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609256 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609259 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609262 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609264 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609267 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609269 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 20:47:43.613281 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609272 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609274 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609277 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609279 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609282 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609285 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609287 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609289 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609292 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609295 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609298 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609300 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609303 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609305 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609307 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609310 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609312 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609315 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609317 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 20:47:43.613644 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609320 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609322 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609325 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609327 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609330 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609332 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609335 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609337 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609339 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609343 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609347 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609349 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609352 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609354 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609357 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609359 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609362 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609365 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609367 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609370 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 20:47:43.614109 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609372 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609374 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609377 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609379 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609382 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609385 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609387 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609390 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609393 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609395 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609397 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609400 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609402 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609405 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609407 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609410 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609412 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609414 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609417 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609419 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 20:47:43.614575 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609422 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609424 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609427 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609429 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609432 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609435 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609437 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609440 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609442 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609445 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609447 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609450 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609452 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609454 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609457 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609459 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609463 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609466 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609469 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 20:47:43.615119 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609472 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609475 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609477 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609482 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609485 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609488 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609491 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:43.609494 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.609498 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.609597 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.611673 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.612941 2553 server.go:1019] "Starting client certificate rotation" Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.613039 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 20:47:43.615576 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.613075 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 20:47:43.615921 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.615158 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 20:47:43.616352 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.616336 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 20:47:43.625888 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.625871 2553 log.go:25] "Validated CRI v1 runtime API" Jul 15 20:47:43.627900 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.627885 2553 log.go:25] "Validated CRI v1 image API" Jul 15 20:47:43.628744 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.628729 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 20:47:43.633534 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.633510 2553 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8d3845ca-b173-4a1d-96b4-6220997054e1:/dev/nvme0n1p4 c0ef220f-51d4-499d-b2b4-089a981b855f:/dev/nvme0n1p3] Jul 15 20:47:43.633586 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.633534 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 20:47:43.638441 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.638335 2553 manager.go:216] Machine: {Timestamp:2026-07-15 20:47:43.637159999 +0000 UTC m=+0.312649223 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106050 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f494e2aa0597e8312b1d150dc883e SystemUUID:ec2f494e-2aa0-597e-8312-b1d150dc883e BootID:aa1d0386-2ceb-44b8-b1e8-13a8cf394075 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:29:ae:8a:a9:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:29:ae:8a:a9:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:71:49:5a:3c:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 20:47:43.638441 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.638440 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 20:47:43.638542 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.638514 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 20:47:43.640661 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.640641 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 20:47:43.640800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.640663 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-248.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 20:47:43.641923 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.641912 2553 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 20:47:43.641956 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.641926 2553 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 20:47:43.641956 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.641934 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 20:47:43.642549 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.642528 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 20:47:43.644031 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.644020 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 20:47:43.646042 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.646023 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 20:47:43.648010 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.647998 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 15 20:47:43.648123 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.648113 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 20:47:43.648157 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.648143 2553 kubelet.go:486] "Attempting to sync node with API server" Jul 15 20:47:43.648157 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.648154 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 20:47:43.648211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.648169 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 20:47:43.648211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.648179 2553 kubelet.go:398] "Adding apiserver pod source" Jul 15 20:47:43.648211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.648188 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 20:47:43.648525 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.648514 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 20:47:43.648569 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.648532 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 20:47:43.650464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.650444 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 20:47:43.652393 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.652375 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 20:47:43.652485 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.652414 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 20:47:43.653347 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653334 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 20:47:43.653421 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653357 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 20:47:43.653421 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653366 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 20:47:43.653421 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653375 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 20:47:43.653421 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653386 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 20:47:43.653421 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653395 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 20:47:43.653421 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653406 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 20:47:43.653421 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653419 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 20:47:43.653681 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653432 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 20:47:43.653681 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653441 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 20:47:43.653681 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653459 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 20:47:43.653681 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.653468 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 20:47:43.654167 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.654155 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 20:47:43.654225 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.654170 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 20:47:43.658040 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.658021 2553 server.go:1268] "Started kubelet" Jul 15 20:47:43.658207 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.658148 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 20:47:43.658292 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.658233 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 20:47:43.658292 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.658254 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 20:47:43.658936 ip-10-0-138-248 systemd[1]: Started Kubernetes Kubelet. Jul 15 20:47:43.659244 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.659224 2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-248.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 20:47:43.659424 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.659391 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 20:47:43.659513 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.659424 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 20:47:43.660393 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.660373 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 20:47:43.661643 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.661323 2553 server.go:310] "Adding debug handlers to kubelet server" Jul 15 20:47:43.666148 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.666126 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 20:47:43.666824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.666809 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 20:47:43.666904 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.666886 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 20:47:43.666957 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.666901 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:43.667560 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.667479 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 20:47:43.667560 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.667490 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 20:47:43.667560 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.667500 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 20:47:43.667715 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.667606 2553 reconstruct.go:97] "Volume reconstruction finished" Jul 15 20:47:43.667715 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.667611 2553 reconciler.go:29] "Reconciler: start to sync state" Jul 15 20:47:43.667715 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.667653 2553 factory.go:55] Registering systemd factory Jul 15 20:47:43.667715 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.667668 2553 factory.go:223] Registration of the systemd container factory successfully Jul 15 20:47:43.667980 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.667959 2553 factory.go:153] Registering CRI-O factory Jul 15 20:47:43.667980 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.667980 2553 factory.go:223] Registration of the crio container factory successfully Jul 15 20:47:43.668121 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.668033 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 20:47:43.668121 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.668059 2553 factory.go:103] Registering Raw factory Jul 15 20:47:43.668121 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.668073 2553 manager.go:1196] Started watching for new ooms in manager Jul 15 20:47:43.668447 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.668434 2553 manager.go:349] Starting recovery of all containers Jul 15 20:47:43.669872 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.668720 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-248.ec2.internal.18c291932ae4a4ed default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-248.ec2.internal,UID:ip-10-0-138-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-248.ec2.internal,},FirstTimestamp:2026-07-15 20:47:43.657985261 +0000 UTC m=+0.333474485,LastTimestamp:2026-07-15 20:47:43.657985261 +0000 UTC m=+0.333474485,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-248.ec2.internal,}" Jul 15 20:47:43.670129 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.670098 2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 20:47:43.670228 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.670186 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 20:47:43.678141 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.678127 2553 manager.go:354] Recovery completed Jul 15 20:47:43.683306 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.683292 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 20:47:43.684998 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.684974 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientMemory" Jul 15 20:47:43.685047 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.685010 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 20:47:43.685047 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.685022 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientPID" Jul 15 20:47:43.685496 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.685481 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 20:47:43.685496 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.685494 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 20:47:43.685601 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.685497 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 20:47:43.685601 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.685516 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 15 20:47:43.686225 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.686212 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientMemory" Jul 15 20:47:43.686292 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.686236 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 20:47:43.686292 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.686248 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientPID" Jul 15 20:47:43.687079 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.687017 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-248.ec2.internal.18c291932c80d2f6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-248.ec2.internal,UID:ip-10-0-138-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-248.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-248.ec2.internal,},FirstTimestamp:2026-07-15 20:47:43.684997878 +0000 UTC m=+0.360487104,LastTimestamp:2026-07-15 20:47:43.684997878 +0000 UTC m=+0.360487104,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-248.ec2.internal,}" Jul 15 20:47:43.687663 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.687651 2553 policy_none.go:49] "None policy: Start" Jul 15 20:47:43.687703 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.687667 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 20:47:43.687703 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.687677 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 20:47:43.689725 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.689714 2553 policy_none.go:47] "Start" Jul 15 20:47:43.697523 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.697379 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-248.ec2.internal.18c291932c811759 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-248.ec2.internal,UID:ip-10-0-138-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-248.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-248.ec2.internal,},FirstTimestamp:2026-07-15 20:47:43.685015385 +0000 UTC m=+0.360504609,LastTimestamp:2026-07-15 20:47:43.685015385 +0000 UTC m=+0.360504609,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-248.ec2.internal,}" Jul 15 20:47:43.708276 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.708260 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h48xw" Jul 15 20:47:43.710592 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.710523 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-248.ec2.internal.18c291932c814636 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-248.ec2.internal,UID:ip-10-0-138-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-248.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-248.ec2.internal,},FirstTimestamp:2026-07-15 20:47:43.685027382 +0000 UTC m=+0.360516607,LastTimestamp:2026-07-15 20:47:43.685027382 +0000 UTC m=+0.360516607,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-248.ec2.internal,}" Jul 15 20:47:43.714526 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.714509 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h48xw" Jul 15 20:47:43.729307 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.729293 2553 manager.go:337] "Starting Device Plugin manager" Jul 15 20:47:43.729375 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.729330 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 20:47:43.729375 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.729343 2553 server.go:87] "Starting device plugin registration server" Jul 15 20:47:43.729583 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.729572 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 20:47:43.729618 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.729585 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 20:47:43.729682 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.729667 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 20:47:43.729757 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.729747 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 20:47:43.729832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.729758 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 20:47:43.730257 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.730238 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 20:47:43.730318 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.730293 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:43.830015 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.829985 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 20:47:43.832127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.830906 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientMemory" Jul 15 20:47:43.832127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.830932 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 20:47:43.832127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.830942 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientPID" Jul 15 20:47:43.832127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.830970 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-248.ec2.internal" Jul 15 20:47:43.839724 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.839710 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-248.ec2.internal" Jul 15 20:47:43.839783 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.839731 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-248.ec2.internal\": node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:43.866063 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.866015 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:43.873469 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.873436 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 20:47:43.874695 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.874675 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 20:47:43.874801 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.874708 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 20:47:43.874801 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.874725 2553 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 20:47:43.874801 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.874753 2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 20:47:43.876889 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.876873 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 20:47:43.966163 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.966120 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:43.975456 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.975428 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-248.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal"] Jul 15 20:47:43.975551 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.975514 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 20:47:43.976718 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.976704 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientMemory" Jul 15 20:47:43.976815 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.976737 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 20:47:43.976815 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.976755 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientPID" Jul 15 20:47:43.979125 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.979109 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 20:47:43.979223 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.979206 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-248.ec2.internal" Jul 15 20:47:43.979285 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.979235 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 20:47:43.980124 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.980104 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientMemory" Jul 15 20:47:43.980276 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.980132 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 20:47:43.980276 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.980143 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientPID" Jul 15 20:47:43.980276 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.980171 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientMemory" Jul 15 20:47:43.980276 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.980189 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 20:47:43.980276 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.980198 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientPID" Jul 15 20:47:43.982386 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.982370 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" Jul 15 20:47:43.982475 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.982396 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 20:47:43.985970 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.985955 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientMemory" Jul 15 20:47:43.986047 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.985975 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 20:47:43.986047 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:43.985985 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientPID" Jul 15 20:47:43.997304 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:43.997282 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-248.ec2.internal\" not found" node="ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.002897 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:44.002883 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-248.ec2.internal\" not found" node="ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.067007 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:44.066975 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:44.069233 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.069214 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2a10535261cd6acdc45b882f26431ac-config\") pod \"kube-apiserver-proxy-ip-10-0-138-248.ec2.internal\" (UID: \"d2a10535261cd6acdc45b882f26431ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.069300 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.069240 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65bab2fb0f34ea38c2e1ddd6d5b0dc0a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal\" (UID: \"65bab2fb0f34ea38c2e1ddd6d5b0dc0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.069300 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.069259 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65bab2fb0f34ea38c2e1ddd6d5b0dc0a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal\" (UID: \"65bab2fb0f34ea38c2e1ddd6d5b0dc0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.167417 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:44.167324 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:44.169554 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.169538 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2a10535261cd6acdc45b882f26431ac-config\") pod \"kube-apiserver-proxy-ip-10-0-138-248.ec2.internal\" (UID: \"d2a10535261cd6acdc45b882f26431ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.169640 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.169567 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65bab2fb0f34ea38c2e1ddd6d5b0dc0a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal\" (UID: \"65bab2fb0f34ea38c2e1ddd6d5b0dc0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.169640 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.169594 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65bab2fb0f34ea38c2e1ddd6d5b0dc0a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal\" (UID: \"65bab2fb0f34ea38c2e1ddd6d5b0dc0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.169735 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.169644 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2a10535261cd6acdc45b882f26431ac-config\") pod \"kube-apiserver-proxy-ip-10-0-138-248.ec2.internal\" (UID: \"d2a10535261cd6acdc45b882f26431ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.169735 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.169682 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65bab2fb0f34ea38c2e1ddd6d5b0dc0a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal\" (UID: \"65bab2fb0f34ea38c2e1ddd6d5b0dc0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.169735 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.169645 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65bab2fb0f34ea38c2e1ddd6d5b0dc0a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal\" (UID: \"65bab2fb0f34ea38c2e1ddd6d5b0dc0a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.267735 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:44.267703 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:44.299069 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.299046 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.306116 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.306100 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.367934 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:44.367893 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:44.468409 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:44.468342 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:44.568783 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:44.568740 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:44.612181 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.612154 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 20:47:44.612618 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.612303 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 20:47:44.669142 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:44.669116 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:44.705985 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.705969 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 20:47:44.706805 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.706789 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientMemory" Jul 15 20:47:44.706870 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.706820 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 20:47:44.706870 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.706830 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeHasSufficientPID" Jul 15 20:47:44.719292 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.719235 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 20:42:44 +0000 UTC" deadline="2028-02-18 22:33:10.43097104 +0000 UTC" Jul 15 20:47:44.719292 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.719265 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13993h45m25.711708943s" Jul 15 20:47:44.769690 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:44.769671 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-248.ec2.internal\" not found" Jul 15 20:47:44.820015 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.819992 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 20:47:44.867701 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.867667 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.876169 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.876148 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 20:47:44.877893 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.877714 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" Jul 15 20:47:44.890812 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.890794 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 20:47:44.910185 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.910165 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 20:47:44.955451 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:44.955420 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65bab2fb0f34ea38c2e1ddd6d5b0dc0a.slice/crio-21085bc783e3c7454561f096a6a63a9258a5afe188c3a011fe3ded43e0453bcb WatchSource:0}: Error finding container 21085bc783e3c7454561f096a6a63a9258a5afe188c3a011fe3ded43e0453bcb: Status 404 returned error can't find the container with id 21085bc783e3c7454561f096a6a63a9258a5afe188c3a011fe3ded43e0453bcb Jul 15 20:47:44.962978 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:44.962959 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 20:47:44.969515 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:44.969462 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a10535261cd6acdc45b882f26431ac.slice/crio-6a7eec6cb692fee1d77a80c8a74270a9c3ec62cbff8ead0b5ac3a573a286a634 WatchSource:0}: Error finding container 6a7eec6cb692fee1d77a80c8a74270a9c3ec62cbff8ead0b5ac3a573a286a634: Status 404 returned error can't find the container with id 6a7eec6cb692fee1d77a80c8a74270a9c3ec62cbff8ead0b5ac3a573a286a634 Jul 15 20:47:45.139321 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.139291 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 20:47:45.649252 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.648967 2553 apiserver.go:52] "Watching apiserver" Jul 15 20:47:45.662220 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.662190 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 20:47:45.662815 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.662783 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6","openshift-cluster-node-tuning-operator/tuned-fc2pc","openshift-image-registry/node-ca-k4wxn","openshift-multus/multus-additional-cni-plugins-gm9gc","kube-system/konnectivity-agent-bqdbw","openshift-dns/node-resolver-8gqgn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal","openshift-multus/multus-6swgz","openshift-multus/network-metrics-daemon-7gxbt","openshift-network-diagnostics/network-check-target-rswbn","openshift-network-operator/iptables-alerter-vhdz7","openshift-ovn-kubernetes/ovnkube-node-zxk2g","kube-system/global-pull-secret-syncer-wc5wg","kube-system/kube-apiserver-proxy-ip-10-0-138-248.ec2.internal"] Jul 15 20:47:45.665656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.665631 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:45.665765 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:45.665737 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:47:45.667965 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.667900 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 20:47:45.668074 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.668007 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:45.668138 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:45.668074 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:47:45.670922 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.670443 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k4wxn" Jul 15 20:47:45.674156 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.672953 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.674156 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.673426 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ft2pv\"" Jul 15 20:47:45.674156 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.673716 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 20:47:45.674156 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.674045 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 20:47:45.674156 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.674143 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 20:47:45.675722 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.675472 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:47:45.676458 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.676212 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2xxw\" (UniqueName: \"kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw\") pod \"network-check-target-rswbn\" (UID: \"b8a0f4c5-66fc-41fe-9e40-be137c051c68\") " pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:45.676458 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.676248 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ebbda4f-407d-4093-9a52-90a25e0345cb-kubelet-config\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:45.676458 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.676275 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ebbda4f-407d-4093-9a52-90a25e0345cb-dbus\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:45.676458 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.676301 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:45.677898 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.677794 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 20:47:45.677898 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.677835 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8gqgn" Jul 15 20:47:45.678119 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.678098 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vxg4d\"" Jul 15 20:47:45.678436 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.678418 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 20:47:45.678915 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.678653 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 20:47:45.678915 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.678686 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 20:47:45.682464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.679722 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 20:47:45.682464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.680265 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 20:47:45.682464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.680485 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 20:47:45.682464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.680815 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wn45h\"" Jul 15 20:47:45.682464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.681135 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 20:47:45.682464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.681271 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rnmn2\"" Jul 15 20:47:45.682464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.681514 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 20:47:45.682464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.682307 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:45.682464 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:45.682371 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:47:45.684524 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.684113 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.687398 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.686991 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 20:47:45.687398 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.687062 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.688062 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.688028 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f8wqk\"" Jul 15 20:47:45.691687 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.691466 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 20:47:45.692690 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.691768 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 20:47:45.692690 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.691910 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7l685\"" Jul 15 20:47:45.692690 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.691962 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.695764 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.695090 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 20:47:45.696672 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.696652 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhdz7" Jul 15 20:47:45.699169 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.699148 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 20:47:45.699511 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.699494 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.699912 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.699898 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 20:47:45.700094 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.700072 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-djkxp\"" Jul 15 20:47:45.700160 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.700128 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 20:47:45.700222 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.700210 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 20:47:45.700277 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.699976 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 20:47:45.700428 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.700353 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 20:47:45.701152 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.701011 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j29r7\"" Jul 15 20:47:45.702087 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.702066 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v5f2t\"" Jul 15 20:47:45.703219 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.703093 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 20:47:45.703219 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.703139 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 20:47:45.703375 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.703322 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 20:47:45.703749 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.703666 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 20:47:45.703910 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.703891 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 20:47:45.704252 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.704233 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 20:47:45.711156 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.711137 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6mh4p" Jul 15 20:47:45.720990 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.720969 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6mh4p" Jul 15 20:47:45.768617 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.768587 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 20:47:45.777099 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777058 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.777218 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777110 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zctsm\" (UniqueName: \"kubernetes.io/projected/622e20ce-f096-4f57-a661-2905fca8ff90-kube-api-access-zctsm\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.777218 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777171 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57186567-8d5d-4c5b-9d34-6248a420c405-konnectivity-ca\") pod \"konnectivity-agent-bqdbw\" (UID: \"57186567-8d5d-4c5b-9d34-6248a420c405\") " pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:47:45.777218 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777210 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-hostroot\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.777377 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777236 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-sysconfig\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.777377 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777260 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-kubelet\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.777377 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777284 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-run-systemd\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.777377 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777310 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-var-lib-openvswitch\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.777377 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777336 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.777377 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777361 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-run-k8s-cni-cncf-io\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.777656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777386 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-var-lib-kubelet\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.777656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777410 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqhxl\" (UniqueName: \"kubernetes.io/projected/e1e307b3-eabc-490d-ab81-efe2b6197afa-kube-api-access-xqhxl\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.777656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777434 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-etc-openvswitch\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.777656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777458 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a871f20-0680-4ebf-945b-40aa62b39577-ovnkube-config\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.777656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777490 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:45.777656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777536 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqfjw\" (UniqueName: \"kubernetes.io/projected/c238bf35-7bb4-4231-b8dc-e8f0f794425e-kube-api-access-mqfjw\") pod \"node-resolver-8gqgn\" (UID: \"c238bf35-7bb4-4231-b8dc-e8f0f794425e\") " pod="openshift-dns/node-resolver-8gqgn" Jul 15 20:47:45.777656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777562 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:45.777656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777587 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-var-lib-cni-bin\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.777656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777611 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-conf-dir\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.777656 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:45.777632 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 20:47:45.777656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777645 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-etc-kubernetes\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777666 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-tuned\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:45.777722 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret podName:4ebbda4f-407d-4093-9a52-90a25e0345cb nodeName:}" failed. No retries permitted until 2026-07-15 20:47:46.277679511 +0000 UTC m=+2.953168739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret") pod "global-pull-secret-syncer-wc5wg" (UID: "4ebbda4f-407d-4093-9a52-90a25e0345cb") : object "kube-system"/"original-pull-secret" not registered Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777749 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2xxw\" (UniqueName: \"kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw\") pod \"network-check-target-rswbn\" (UID: \"b8a0f4c5-66fc-41fe-9e40-be137c051c68\") " pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777784 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777842 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-var-lib-cni-multus\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777869 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-daemon-config\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777892 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1e307b3-eabc-490d-ab81-efe2b6197afa-tmp\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777917 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/243268d0-64f8-44f1-b410-46e4105d7f01-iptables-alerter-script\") pod \"iptables-alerter-vhdz7\" (UID: \"243268d0-64f8-44f1-b410-46e4105d7f01\") " pod="openshift-network-operator/iptables-alerter-vhdz7" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777952 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-slash\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.777978 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-log-socket\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778009 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57186567-8d5d-4c5b-9d34-6248a420c405-agent-certs\") pod \"konnectivity-agent-bqdbw\" (UID: \"57186567-8d5d-4c5b-9d34-6248a420c405\") " pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778065 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243268d0-64f8-44f1-b410-46e4105d7f01-host-slash\") pod \"iptables-alerter-vhdz7\" (UID: \"243268d0-64f8-44f1-b410-46e4105d7f01\") " pod="openshift-network-operator/iptables-alerter-vhdz7" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778095 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a871f20-0680-4ebf-945b-40aa62b39577-ovn-node-metrics-cert\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778132 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc50d127-1a8d-4a89-8a69-5eb54bef09f4-serviceca\") pod \"node-ca-k4wxn\" (UID: \"bc50d127-1a8d-4a89-8a69-5eb54bef09f4\") " pod="openshift-image-registry/node-ca-k4wxn" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778174 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c238bf35-7bb4-4231-b8dc-e8f0f794425e-hosts-file\") pod \"node-resolver-8gqgn\" (UID: \"c238bf35-7bb4-4231-b8dc-e8f0f794425e\") " pod="openshift-dns/node-resolver-8gqgn" Jul 15 20:47:45.778211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778200 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87g9\" (UniqueName: \"kubernetes.io/projected/7d738b72-dca3-4336-bb48-495adea2fb5d-kube-api-access-r87g9\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778224 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a871f20-0680-4ebf-945b-40aa62b39577-env-overrides\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778250 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrwgw\" (UniqueName: \"kubernetes.io/projected/6a871f20-0680-4ebf-945b-40aa62b39577-kube-api-access-jrwgw\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778276 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-os-release\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778301 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-system-cni-dir\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778325 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-systemd\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778349 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778374 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp5j8\" (UniqueName: \"kubernetes.io/projected/243268d0-64f8-44f1-b410-46e4105d7f01-kube-api-access-jp5j8\") pod \"iptables-alerter-vhdz7\" (UID: \"243268d0-64f8-44f1-b410-46e4105d7f01\") " pod="openshift-network-operator/iptables-alerter-vhdz7" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778411 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-cnibin\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778451 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-var-lib-kubelet\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778491 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a871f20-0680-4ebf-945b-40aa62b39577-ovnkube-script-lib\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778512 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-cnibin\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778538 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-sysctl-d\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778603 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-lib-modules\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778628 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-etc-selinux\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778658 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-node-log\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.779026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778686 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ebbda4f-407d-4093-9a52-90a25e0345cb-kubelet-config\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778712 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d738b72-dca3-4336-bb48-495adea2fb5d-cni-binary-copy\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778765 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-run-netns\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778790 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc50d127-1a8d-4a89-8a69-5eb54bef09f4-host\") pod \"node-ca-k4wxn\" (UID: \"bc50d127-1a8d-4a89-8a69-5eb54bef09f4\") " pod="openshift-image-registry/node-ca-k4wxn" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778817 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-socket-dir-parent\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.778856 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npg84\" (UniqueName: \"kubernetes.io/projected/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-kube-api-access-npg84\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779321 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ebbda4f-407d-4093-9a52-90a25e0345cb-kubelet-config\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779366 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c238bf35-7bb4-4231-b8dc-e8f0f794425e-tmp-dir\") pod \"node-resolver-8gqgn\" (UID: \"c238bf35-7bb4-4231-b8dc-e8f0f794425e\") " pod="openshift-dns/node-resolver-8gqgn" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779410 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dxtj\" (UniqueName: \"kubernetes.io/projected/49822cd3-a729-4a17-9b34-e61eb6d6257a-kube-api-access-4dxtj\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779441 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-run-multus-certs\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779473 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-device-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779500 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gss7v\" (UniqueName: \"kubernetes.io/projected/bc50d127-1a8d-4a89-8a69-5eb54bef09f4-kube-api-access-gss7v\") pod \"node-ca-k4wxn\" (UID: \"bc50d127-1a8d-4a89-8a69-5eb54bef09f4\") " pod="openshift-image-registry/node-ca-k4wxn" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779527 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-run-netns\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779553 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-kubernetes\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779577 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-run-ovn-kubernetes\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779601 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-cni-bin\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.779884 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779628 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779659 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-system-cni-dir\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779685 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779717 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-socket-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779767 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-registration-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779837 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-systemd-units\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779861 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-run\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779909 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-host\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779944 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-sys-fs\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779969 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-run-ovn\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.779993 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-cni-netd\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.780015 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-os-release\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.780043 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ebbda4f-407d-4093-9a52-90a25e0345cb-dbus\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.780080 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-cni-dir\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.780104 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-modprobe-d\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.780126 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-sysctl-conf\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.780632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.780149 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-sys\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.781493 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.780171 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-run-openvswitch\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.781493 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.780291 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ebbda4f-407d-4093-9a52-90a25e0345cb-dbus\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:45.785246 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:45.785227 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 20:47:45.785347 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:45.785252 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 20:47:45.785347 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:45.785268 2553 projected.go:196] Error preparing data for projected volume kube-api-access-q2xxw for pod openshift-network-diagnostics/network-check-target-rswbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:47:45.785347 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:45.785325 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw podName:b8a0f4c5-66fc-41fe-9e40-be137c051c68 nodeName:}" failed. No retries permitted until 2026-07-15 20:47:46.285307209 +0000 UTC m=+2.960796441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q2xxw" (UniqueName: "kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw") pod "network-check-target-rswbn" (UID: "b8a0f4c5-66fc-41fe-9e40-be137c051c68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:47:45.798755 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.798736 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 20:47:45.879777 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.879707 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-248.ec2.internal" event={"ID":"d2a10535261cd6acdc45b882f26431ac","Type":"ContainerStarted","Data":"6a7eec6cb692fee1d77a80c8a74270a9c3ec62cbff8ead0b5ac3a573a286a634"} Jul 15 20:47:45.880621 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880582 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-run-netns\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.880760 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880624 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc50d127-1a8d-4a89-8a69-5eb54bef09f4-host\") pod \"node-ca-k4wxn\" (UID: \"bc50d127-1a8d-4a89-8a69-5eb54bef09f4\") " pod="openshift-image-registry/node-ca-k4wxn" Jul 15 20:47:45.880760 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880637 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-run-netns\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.880760 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880652 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-socket-dir-parent\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.880760 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880682 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npg84\" (UniqueName: \"kubernetes.io/projected/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-kube-api-access-npg84\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.880760 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880713 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c238bf35-7bb4-4231-b8dc-e8f0f794425e-tmp-dir\") pod \"node-resolver-8gqgn\" (UID: \"c238bf35-7bb4-4231-b8dc-e8f0f794425e\") " pod="openshift-dns/node-resolver-8gqgn" Jul 15 20:47:45.880760 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880711 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc50d127-1a8d-4a89-8a69-5eb54bef09f4-host\") pod \"node-ca-k4wxn\" (UID: \"bc50d127-1a8d-4a89-8a69-5eb54bef09f4\") " pod="openshift-image-registry/node-ca-k4wxn" Jul 15 20:47:45.880760 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880735 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-socket-dir-parent\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.880760 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880742 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dxtj\" (UniqueName: \"kubernetes.io/projected/49822cd3-a729-4a17-9b34-e61eb6d6257a-kube-api-access-4dxtj\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880769 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-run-multus-certs\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880813 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-device-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880837 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gss7v\" (UniqueName: \"kubernetes.io/projected/bc50d127-1a8d-4a89-8a69-5eb54bef09f4-kube-api-access-gss7v\") pod \"node-ca-k4wxn\" (UID: \"bc50d127-1a8d-4a89-8a69-5eb54bef09f4\") " pod="openshift-image-registry/node-ca-k4wxn" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880862 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-run-netns\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880909 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-run-multus-certs\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.880913 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-device-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881020 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-kubernetes\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881049 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-run-ovn-kubernetes\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881074 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-cni-bin\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881104 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881109 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-run-netns\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881154 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881167 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-kubernetes\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.881215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881209 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-cni-bin\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881235 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-system-cni-dir\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881262 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881279 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c238bf35-7bb4-4231-b8dc-e8f0f794425e-tmp-dir\") pod \"node-resolver-8gqgn\" (UID: \"c238bf35-7bb4-4231-b8dc-e8f0f794425e\") " pod="openshift-dns/node-resolver-8gqgn" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881305 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-socket-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881332 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-registration-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881355 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-run-ovn-kubernetes\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881359 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-systemd-units\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881396 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-run\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881419 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-host\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881444 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-sys-fs\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881470 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-run-ovn\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881493 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-cni-netd\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881515 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-os-release\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881522 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-run\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881541 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-cni-dir\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881566 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-modprobe-d\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881591 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-sysctl-conf\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.881832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881612 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-sys\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881635 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-run-openvswitch\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881637 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-socket-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881660 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881691 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-registration-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881698 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zctsm\" (UniqueName: \"kubernetes.io/projected/622e20ce-f096-4f57-a661-2905fca8ff90-kube-api-access-zctsm\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881726 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57186567-8d5d-4c5b-9d34-6248a420c405-konnectivity-ca\") pod \"konnectivity-agent-bqdbw\" (UID: \"57186567-8d5d-4c5b-9d34-6248a420c405\") " pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881731 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-systemd-units\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881750 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-hostroot\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881773 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-sysconfig\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881785 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-cni-dir\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881798 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-kubelet\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881825 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-sys-fs\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881826 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-run-systemd\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881441 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" event={"ID":"65bab2fb0f34ea38c2e1ddd6d5b0dc0a","Type":"ContainerStarted","Data":"21085bc783e3c7454561f096a6a63a9258a5afe188c3a011fe3ded43e0453bcb"} Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881839 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-system-cni-dir\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881876 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-var-lib-openvswitch\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.882694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881892 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-host\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881910 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-run-ovn\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881902 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881937 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-cni-netd\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881955 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-run-k8s-cni-cncf-io\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881983 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-var-lib-kubelet\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882010 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqhxl\" (UniqueName: \"kubernetes.io/projected/e1e307b3-eabc-490d-ab81-efe2b6197afa-kube-api-access-xqhxl\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882014 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-os-release\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882032 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-hostroot\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882035 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-etc-openvswitch\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882066 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-etc-openvswitch\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882074 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a871f20-0680-4ebf-945b-40aa62b39577-ovnkube-config\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882102 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-run-k8s-cni-cncf-io\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882131 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-sysconfig\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882137 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-var-lib-kubelet\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882134 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqfjw\" (UniqueName: \"kubernetes.io/projected/c238bf35-7bb4-4231-b8dc-e8f0f794425e-kube-api-access-mqfjw\") pod \"node-resolver-8gqgn\" (UID: \"c238bf35-7bb4-4231-b8dc-e8f0f794425e\") " pod="openshift-dns/node-resolver-8gqgn" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.881982 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882173 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:45.883800 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882180 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-var-lib-openvswitch\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882197 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-kubelet\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882248 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-sys\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882237 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-var-lib-cni-bin\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882309 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-conf-dir\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882336 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-etc-kubernetes\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882346 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-sysctl-conf\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882410 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-modprobe-d\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882436 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882498 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-var-lib-cni-bin\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882537 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-conf-dir\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882544 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57186567-8d5d-4c5b-9d34-6248a420c405-konnectivity-ca\") pod \"konnectivity-agent-bqdbw\" (UID: \"57186567-8d5d-4c5b-9d34-6248a420c405\") " pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882559 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-etc-kubernetes\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882584 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-run-systemd\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:45.882585 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882607 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-tuned\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882605 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-run-openvswitch\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.884752 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:45.882683 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs podName:49822cd3-a729-4a17-9b34-e61eb6d6257a nodeName:}" failed. No retries permitted until 2026-07-15 20:47:46.382665127 +0000 UTC m=+3.058154345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs") pod "network-metrics-daemon-7gxbt" (UID: "49822cd3-a729-4a17-9b34-e61eb6d6257a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882731 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882747 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882789 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-var-lib-cni-multus\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882864 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-daemon-config\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882896 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1e307b3-eabc-490d-ab81-efe2b6197afa-tmp\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882899 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-host-var-lib-cni-multus\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882905 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a871f20-0680-4ebf-945b-40aa62b39577-ovnkube-config\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882928 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/243268d0-64f8-44f1-b410-46e4105d7f01-iptables-alerter-script\") pod \"iptables-alerter-vhdz7\" (UID: \"243268d0-64f8-44f1-b410-46e4105d7f01\") " pod="openshift-network-operator/iptables-alerter-vhdz7" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882957 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-slash\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.882982 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-log-socket\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883008 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57186567-8d5d-4c5b-9d34-6248a420c405-agent-certs\") pod \"konnectivity-agent-bqdbw\" (UID: \"57186567-8d5d-4c5b-9d34-6248a420c405\") " pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883022 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-host-slash\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883033 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243268d0-64f8-44f1-b410-46e4105d7f01-host-slash\") pod \"iptables-alerter-vhdz7\" (UID: \"243268d0-64f8-44f1-b410-46e4105d7f01\") " pod="openshift-network-operator/iptables-alerter-vhdz7" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883027 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883063 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a871f20-0680-4ebf-945b-40aa62b39577-ovn-node-metrics-cert\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883081 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-log-socket\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883090 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc50d127-1a8d-4a89-8a69-5eb54bef09f4-serviceca\") pod \"node-ca-k4wxn\" (UID: \"bc50d127-1a8d-4a89-8a69-5eb54bef09f4\") " pod="openshift-image-registry/node-ca-k4wxn" Jul 15 20:47:45.885732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883117 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c238bf35-7bb4-4231-b8dc-e8f0f794425e-hosts-file\") pod \"node-resolver-8gqgn\" (UID: \"c238bf35-7bb4-4231-b8dc-e8f0f794425e\") " pod="openshift-dns/node-resolver-8gqgn" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883125 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243268d0-64f8-44f1-b410-46e4105d7f01-host-slash\") pod \"iptables-alerter-vhdz7\" (UID: \"243268d0-64f8-44f1-b410-46e4105d7f01\") " pod="openshift-network-operator/iptables-alerter-vhdz7" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883142 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r87g9\" (UniqueName: \"kubernetes.io/projected/7d738b72-dca3-4336-bb48-495adea2fb5d-kube-api-access-r87g9\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883167 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a871f20-0680-4ebf-945b-40aa62b39577-env-overrides\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883194 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrwgw\" (UniqueName: \"kubernetes.io/projected/6a871f20-0680-4ebf-945b-40aa62b39577-kube-api-access-jrwgw\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883220 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-os-release\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883247 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-system-cni-dir\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883272 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-systemd\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883286 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883301 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883305 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c238bf35-7bb4-4231-b8dc-e8f0f794425e-hosts-file\") pod \"node-resolver-8gqgn\" (UID: \"c238bf35-7bb4-4231-b8dc-e8f0f794425e\") " pod="openshift-dns/node-resolver-8gqgn" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883331 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp5j8\" (UniqueName: \"kubernetes.io/projected/243268d0-64f8-44f1-b410-46e4105d7f01-kube-api-access-jp5j8\") pod \"iptables-alerter-vhdz7\" (UID: \"243268d0-64f8-44f1-b410-46e4105d7f01\") " pod="openshift-network-operator/iptables-alerter-vhdz7" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883358 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-cnibin\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883383 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-var-lib-kubelet\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883407 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a871f20-0680-4ebf-945b-40aa62b39577-ovnkube-script-lib\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883442 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-cnibin\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883464 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-sysctl-d\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.886974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883487 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-lib-modules\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883518 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-etc-selinux\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883598 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-os-release\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883652 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-system-cni-dir\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883702 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-systemd\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.883756 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884044 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d738b72-dca3-4336-bb48-495adea2fb5d-cnibin\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884080 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d738b72-dca3-4336-bb48-495adea2fb5d-multus-daemon-config\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884118 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-var-lib-kubelet\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884144 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a871f20-0680-4ebf-945b-40aa62b39577-env-overrides\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884191 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-node-log\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884219 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d738b72-dca3-4336-bb48-495adea2fb5d-cni-binary-copy\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884353 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/243268d0-64f8-44f1-b410-46e4105d7f01-iptables-alerter-script\") pod \"iptables-alerter-vhdz7\" (UID: \"243268d0-64f8-44f1-b410-46e4105d7f01\") " pod="openshift-network-operator/iptables-alerter-vhdz7" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884521 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-sysctl-d\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884591 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-cnibin\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884654 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a871f20-0680-4ebf-945b-40aa62b39577-ovnkube-script-lib\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884784 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1e307b3-eabc-490d-ab81-efe2b6197afa-lib-modules\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884786 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d738b72-dca3-4336-bb48-495adea2fb5d-cni-binary-copy\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.887775 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884840 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a871f20-0680-4ebf-945b-40aa62b39577-node-log\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.888489 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884873 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/622e20ce-f096-4f57-a661-2905fca8ff90-etc-selinux\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.888489 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.884954 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc50d127-1a8d-4a89-8a69-5eb54bef09f4-serviceca\") pod \"node-ca-k4wxn\" (UID: \"bc50d127-1a8d-4a89-8a69-5eb54bef09f4\") " pod="openshift-image-registry/node-ca-k4wxn" Jul 15 20:47:45.888489 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.887305 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1e307b3-eabc-490d-ab81-efe2b6197afa-etc-tuned\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.888489 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.887437 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a871f20-0680-4ebf-945b-40aa62b39577-ovn-node-metrics-cert\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.888489 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.887459 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1e307b3-eabc-490d-ab81-efe2b6197afa-tmp\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.888489 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.887994 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57186567-8d5d-4c5b-9d34-6248a420c405-agent-certs\") pod \"konnectivity-agent-bqdbw\" (UID: \"57186567-8d5d-4c5b-9d34-6248a420c405\") " pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:47:45.896969 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.896732 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dxtj\" (UniqueName: \"kubernetes.io/projected/49822cd3-a729-4a17-9b34-e61eb6d6257a-kube-api-access-4dxtj\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:45.897092 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.897004 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npg84\" (UniqueName: \"kubernetes.io/projected/4e1595ed-f475-47cb-9b89-2217bfb3c8c5-kube-api-access-npg84\") pod \"multus-additional-cni-plugins-gm9gc\" (UID: \"4e1595ed-f475-47cb-9b89-2217bfb3c8c5\") " pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:45.898829 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.898275 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp5j8\" (UniqueName: \"kubernetes.io/projected/243268d0-64f8-44f1-b410-46e4105d7f01-kube-api-access-jp5j8\") pod \"iptables-alerter-vhdz7\" (UID: \"243268d0-64f8-44f1-b410-46e4105d7f01\") " pod="openshift-network-operator/iptables-alerter-vhdz7" Jul 15 20:47:45.898829 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.898732 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gss7v\" (UniqueName: \"kubernetes.io/projected/bc50d127-1a8d-4a89-8a69-5eb54bef09f4-kube-api-access-gss7v\") pod \"node-ca-k4wxn\" (UID: \"bc50d127-1a8d-4a89-8a69-5eb54bef09f4\") " pod="openshift-image-registry/node-ca-k4wxn" Jul 15 20:47:45.900256 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.900158 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrwgw\" (UniqueName: \"kubernetes.io/projected/6a871f20-0680-4ebf-945b-40aa62b39577-kube-api-access-jrwgw\") pod \"ovnkube-node-zxk2g\" (UID: \"6a871f20-0680-4ebf-945b-40aa62b39577\") " pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:45.900256 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.900180 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87g9\" (UniqueName: \"kubernetes.io/projected/7d738b72-dca3-4336-bb48-495adea2fb5d-kube-api-access-r87g9\") pod \"multus-6swgz\" (UID: \"7d738b72-dca3-4336-bb48-495adea2fb5d\") " pod="openshift-multus/multus-6swgz" Jul 15 20:47:45.900256 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.900226 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zctsm\" (UniqueName: \"kubernetes.io/projected/622e20ce-f096-4f57-a661-2905fca8ff90-kube-api-access-zctsm\") pod \"aws-ebs-csi-driver-node-tjgb6\" (UID: \"622e20ce-f096-4f57-a661-2905fca8ff90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:45.900890 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.900863 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqfjw\" (UniqueName: \"kubernetes.io/projected/c238bf35-7bb4-4231-b8dc-e8f0f794425e-kube-api-access-mqfjw\") pod \"node-resolver-8gqgn\" (UID: \"c238bf35-7bb4-4231-b8dc-e8f0f794425e\") " pod="openshift-dns/node-resolver-8gqgn" Jul 15 20:47:45.902271 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.902243 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqhxl\" (UniqueName: \"kubernetes.io/projected/e1e307b3-eabc-490d-ab81-efe2b6197afa-kube-api-access-xqhxl\") pod \"tuned-fc2pc\" (UID: \"e1e307b3-eabc-490d-ab81-efe2b6197afa\") " pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:45.985246 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.985206 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k4wxn" Jul 15 20:47:45.999648 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:45.999618 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gm9gc" Jul 15 20:47:46.011578 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.011557 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:47:46.020632 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.020609 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:47:46.029533 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.029514 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8gqgn" Jul 15 20:47:46.038312 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.038290 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6swgz" Jul 15 20:47:46.047169 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.047149 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" Jul 15 20:47:46.055059 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.055037 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" Jul 15 20:47:46.061866 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.061835 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vhdz7" Jul 15 20:47:46.287428 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.287340 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:46.287428 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.287402 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2xxw\" (UniqueName: \"kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw\") pod \"network-check-target-rswbn\" (UID: \"b8a0f4c5-66fc-41fe-9e40-be137c051c68\") " pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:46.287631 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:46.287517 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 20:47:46.287631 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:46.287538 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 20:47:46.287631 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:46.287557 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 20:47:46.287631 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:46.287572 2553 projected.go:196] Error preparing data for projected volume kube-api-access-q2xxw for pod openshift-network-diagnostics/network-check-target-rswbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:47:46.287631 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:46.287615 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret podName:4ebbda4f-407d-4093-9a52-90a25e0345cb nodeName:}" failed. No retries permitted until 2026-07-15 20:47:47.287590559 +0000 UTC m=+3.963079781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret") pod "global-pull-secret-syncer-wc5wg" (UID: "4ebbda4f-407d-4093-9a52-90a25e0345cb") : object "kube-system"/"original-pull-secret" not registered Jul 15 20:47:46.287890 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:46.287648 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw podName:b8a0f4c5-66fc-41fe-9e40-be137c051c68 nodeName:}" failed. No retries permitted until 2026-07-15 20:47:47.28762662 +0000 UTC m=+3.963115835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2xxw" (UniqueName: "kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw") pod "network-check-target-rswbn" (UID: "b8a0f4c5-66fc-41fe-9e40-be137c051c68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:47:46.388544 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.388504 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:46.388719 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:46.388676 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:47:46.388820 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:46.388761 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs podName:49822cd3-a729-4a17-9b34-e61eb6d6257a nodeName:}" failed. No retries permitted until 2026-07-15 20:47:47.388740565 +0000 UTC m=+4.064229782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs") pod "network-metrics-daemon-7gxbt" (UID: "49822cd3-a729-4a17-9b34-e61eb6d6257a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:47:46.725176 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.725069 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 20:42:46 +0000 UTC" deadline="2028-02-29 15:41:59.162595404 +0000 UTC" Jul 15 20:47:46.725176 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.725137 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14250h54m12.43746337s" Jul 15 20:47:46.875335 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.875292 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:46.875503 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:46.875423 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:47:46.875503 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:46.875486 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:46.875636 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:46.875609 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:47:46.991604 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:46.991527 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc238bf35_7bb4_4231_b8dc_e8f0f794425e.slice/crio-3384c568e0d9c40ba6e64f3907cf70e06bb7efe24c5e7f6ee8d579403e5b1e07 WatchSource:0}: Error finding container 3384c568e0d9c40ba6e64f3907cf70e06bb7efe24c5e7f6ee8d579403e5b1e07: Status 404 returned error can't find the container with id 3384c568e0d9c40ba6e64f3907cf70e06bb7efe24c5e7f6ee8d579403e5b1e07 Jul 15 20:47:46.993824 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:46.993802 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243268d0_64f8_44f1_b410_46e4105d7f01.slice/crio-255850c9b7a1dbf31203f3adaecdc822a803ade495b177307253b1d97a0dfddf WatchSource:0}: Error finding container 255850c9b7a1dbf31203f3adaecdc822a803ade495b177307253b1d97a0dfddf: Status 404 returned error can't find the container with id 255850c9b7a1dbf31203f3adaecdc822a803ade495b177307253b1d97a0dfddf Jul 15 20:47:46.997198 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:46.997173 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc50d127_1a8d_4a89_8a69_5eb54bef09f4.slice/crio-9773b69887a4647137442d179ccc117036daba61b105e168367e3be963eea5a8 WatchSource:0}: Error finding container 9773b69887a4647137442d179ccc117036daba61b105e168367e3be963eea5a8: Status 404 returned error can't find the container with id 9773b69887a4647137442d179ccc117036daba61b105e168367e3be963eea5a8 Jul 15 20:47:46.998645 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:46.998546 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e307b3_eabc_490d_ab81_efe2b6197afa.slice/crio-c3cefc2d3ffe7496aa8b0a54b2d79dde14872ca7dd1608bf760ab5b8b8bc546b WatchSource:0}: Error finding container c3cefc2d3ffe7496aa8b0a54b2d79dde14872ca7dd1608bf760ab5b8b8bc546b: Status 404 returned error can't find the container with id c3cefc2d3ffe7496aa8b0a54b2d79dde14872ca7dd1608bf760ab5b8b8bc546b Jul 15 20:47:47.001656 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:47.000398 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57186567_8d5d_4c5b_9d34_6248a420c405.slice/crio-b644913dffa86c3f1ab6daa04e33d72a23f5f66fc0f03fd1d369be0312adb921 WatchSource:0}: Error finding container b644913dffa86c3f1ab6daa04e33d72a23f5f66fc0f03fd1d369be0312adb921: Status 404 returned error can't find the container with id b644913dffa86c3f1ab6daa04e33d72a23f5f66fc0f03fd1d369be0312adb921 Jul 15 20:47:47.001656 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:47.001182 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622e20ce_f096_4f57_a661_2905fca8ff90.slice/crio-53a032c51817a7cb0d95f4e848fcba3ce7b91bd9c76d26c0517101cf9d6e29dd WatchSource:0}: Error finding container 53a032c51817a7cb0d95f4e848fcba3ce7b91bd9c76d26c0517101cf9d6e29dd: Status 404 returned error can't find the container with id 53a032c51817a7cb0d95f4e848fcba3ce7b91bd9c76d26c0517101cf9d6e29dd Jul 15 20:47:47.002887 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:47.002863 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a871f20_0680_4ebf_945b_40aa62b39577.slice/crio-b1e259d44f7212fb7f900f6226dc00e1bd0097eba614b587dba30513f14cb4ea WatchSource:0}: Error finding container b1e259d44f7212fb7f900f6226dc00e1bd0097eba614b587dba30513f14cb4ea: Status 404 returned error can't find the container with id b1e259d44f7212fb7f900f6226dc00e1bd0097eba614b587dba30513f14cb4ea Jul 15 20:47:47.005709 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:47.005144 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d738b72_dca3_4336_bb48_495adea2fb5d.slice/crio-23137d4243ca3201bdb3d1074d3aa52f57d5131ec849e785ea615bc2b8d56497 WatchSource:0}: Error finding container 23137d4243ca3201bdb3d1074d3aa52f57d5131ec849e785ea615bc2b8d56497: Status 404 returned error can't find the container with id 23137d4243ca3201bdb3d1074d3aa52f57d5131ec849e785ea615bc2b8d56497 Jul 15 20:47:47.008762 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:47:47.007743 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1595ed_f475_47cb_9b89_2217bfb3c8c5.slice/crio-3a9a4ce929e532b7336552e2b6a37bbb6ef60d737348dd32ca895709b2475c79 WatchSource:0}: Error finding container 3a9a4ce929e532b7336552e2b6a37bbb6ef60d737348dd32ca895709b2475c79: Status 404 returned error can't find the container with id 3a9a4ce929e532b7336552e2b6a37bbb6ef60d737348dd32ca895709b2475c79 Jul 15 20:47:47.295255 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.295053 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:47.295395 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.295283 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2xxw\" (UniqueName: \"kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw\") pod \"network-check-target-rswbn\" (UID: \"b8a0f4c5-66fc-41fe-9e40-be137c051c68\") " pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:47.295395 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:47.295188 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 20:47:47.295395 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:47.295392 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 20:47:47.295529 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:47.295400 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret podName:4ebbda4f-407d-4093-9a52-90a25e0345cb nodeName:}" failed. No retries permitted until 2026-07-15 20:47:49.295377799 +0000 UTC m=+5.970867011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret") pod "global-pull-secret-syncer-wc5wg" (UID: "4ebbda4f-407d-4093-9a52-90a25e0345cb") : object "kube-system"/"original-pull-secret" not registered Jul 15 20:47:47.295529 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:47.295407 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 20:47:47.295529 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:47.295417 2553 projected.go:196] Error preparing data for projected volume kube-api-access-q2xxw for pod openshift-network-diagnostics/network-check-target-rswbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:47:47.295529 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:47.295467 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw podName:b8a0f4c5-66fc-41fe-9e40-be137c051c68 nodeName:}" failed. No retries permitted until 2026-07-15 20:47:49.295449549 +0000 UTC m=+5.970938763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2xxw" (UniqueName: "kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw") pod "network-check-target-rswbn" (UID: "b8a0f4c5-66fc-41fe-9e40-be137c051c68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:47:47.396738 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.396673 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:47.397068 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:47.396876 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:47:47.397068 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:47.396963 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs podName:49822cd3-a729-4a17-9b34-e61eb6d6257a nodeName:}" failed. No retries permitted until 2026-07-15 20:47:49.396940745 +0000 UTC m=+6.072429964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs") pod "network-metrics-daemon-7gxbt" (UID: "49822cd3-a729-4a17-9b34-e61eb6d6257a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:47:47.725688 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.725644 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 20:42:46 +0000 UTC" deadline="2027-12-31 19:54:28.748808142 +0000 UTC" Jul 15 20:47:47.725688 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.725686 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12815h6m41.023127467s" Jul 15 20:47:47.878157 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.878065 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:47.878335 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:47.878219 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:47:47.906173 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.906133 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8gqgn" event={"ID":"c238bf35-7bb4-4231-b8dc-e8f0f794425e","Type":"ContainerStarted","Data":"3384c568e0d9c40ba6e64f3907cf70e06bb7efe24c5e7f6ee8d579403e5b1e07"} Jul 15 20:47:47.914706 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.914672 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-248.ec2.internal" event={"ID":"d2a10535261cd6acdc45b882f26431ac","Type":"ContainerStarted","Data":"4d946ca1933b8517838767eae06072fad4b2462be3b86a21a9c873618a2a7631"} Jul 15 20:47:47.920629 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.920595 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" event={"ID":"e1e307b3-eabc-490d-ab81-efe2b6197afa","Type":"ContainerStarted","Data":"c3cefc2d3ffe7496aa8b0a54b2d79dde14872ca7dd1608bf760ab5b8b8bc546b"} Jul 15 20:47:47.927135 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.927082 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" event={"ID":"6a871f20-0680-4ebf-945b-40aa62b39577","Type":"ContainerStarted","Data":"b1e259d44f7212fb7f900f6226dc00e1bd0097eba614b587dba30513f14cb4ea"} Jul 15 20:47:47.937027 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.936973 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-248.ec2.internal" podStartSLOduration=2.936954519 podStartE2EDuration="2.936954519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:47:47.936481169 +0000 UTC m=+4.611970411" watchObservedRunningTime="2026-07-15 20:47:47.936954519 +0000 UTC m=+4.612443758" Jul 15 20:47:47.937967 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.937942 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k4wxn" event={"ID":"bc50d127-1a8d-4a89-8a69-5eb54bef09f4","Type":"ContainerStarted","Data":"9773b69887a4647137442d179ccc117036daba61b105e168367e3be963eea5a8"} Jul 15 20:47:47.961539 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.961470 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhdz7" event={"ID":"243268d0-64f8-44f1-b410-46e4105d7f01","Type":"ContainerStarted","Data":"255850c9b7a1dbf31203f3adaecdc822a803ade495b177307253b1d97a0dfddf"} Jul 15 20:47:47.970164 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.970129 2553 generic.go:356] "Generic (PLEG): container finished" podID="65bab2fb0f34ea38c2e1ddd6d5b0dc0a" containerID="8d0caa8949712fee85d240cfd89591b3e288fb535bff0fa165c73b4e41c59528" exitCode=0 Jul 15 20:47:47.970327 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.970230 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" event={"ID":"65bab2fb0f34ea38c2e1ddd6d5b0dc0a","Type":"ContainerDied","Data":"8d0caa8949712fee85d240cfd89591b3e288fb535bff0fa165c73b4e41c59528"} Jul 15 20:47:47.982749 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.982718 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm9gc" event={"ID":"4e1595ed-f475-47cb-9b89-2217bfb3c8c5","Type":"ContainerStarted","Data":"3a9a4ce929e532b7336552e2b6a37bbb6ef60d737348dd32ca895709b2475c79"} Jul 15 20:47:47.993120 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:47.990927 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6swgz" event={"ID":"7d738b72-dca3-4336-bb48-495adea2fb5d","Type":"ContainerStarted","Data":"23137d4243ca3201bdb3d1074d3aa52f57d5131ec849e785ea615bc2b8d56497"} Jul 15 20:47:48.009619 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:48.009540 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bqdbw" event={"ID":"57186567-8d5d-4c5b-9d34-6248a420c405","Type":"ContainerStarted","Data":"b644913dffa86c3f1ab6daa04e33d72a23f5f66fc0f03fd1d369be0312adb921"} Jul 15 20:47:48.021948 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:48.021838 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" event={"ID":"622e20ce-f096-4f57-a661-2905fca8ff90","Type":"ContainerStarted","Data":"53a032c51817a7cb0d95f4e848fcba3ce7b91bd9c76d26c0517101cf9d6e29dd"} Jul 15 20:47:48.875130 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:48.875089 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:48.875620 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:48.875243 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:47:48.875727 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:48.875682 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:48.875816 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:48.875790 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:47:49.048027 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:49.047923 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" event={"ID":"65bab2fb0f34ea38c2e1ddd6d5b0dc0a","Type":"ContainerStarted","Data":"8a39993b6641125c34d7a7b0ac09c7ce1bdf5b6fb6e394bab41256e09f21a38a"} Jul 15 20:47:49.316881 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:49.315868 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:49.316881 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:49.315938 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2xxw\" (UniqueName: \"kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw\") pod \"network-check-target-rswbn\" (UID: \"b8a0f4c5-66fc-41fe-9e40-be137c051c68\") " pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:49.316881 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:49.316144 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 20:47:49.316881 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:49.316170 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 20:47:49.316881 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:49.316183 2553 projected.go:196] Error preparing data for projected volume kube-api-access-q2xxw for pod openshift-network-diagnostics/network-check-target-rswbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:47:49.316881 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:49.316246 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw podName:b8a0f4c5-66fc-41fe-9e40-be137c051c68 nodeName:}" failed. No retries permitted until 2026-07-15 20:47:53.316227494 +0000 UTC m=+9.991716734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2xxw" (UniqueName: "kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw") pod "network-check-target-rswbn" (UID: "b8a0f4c5-66fc-41fe-9e40-be137c051c68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:47:49.316881 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:49.316654 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 20:47:49.316881 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:49.316758 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret podName:4ebbda4f-407d-4093-9a52-90a25e0345cb nodeName:}" failed. No retries permitted until 2026-07-15 20:47:53.316740681 +0000 UTC m=+9.992229900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret") pod "global-pull-secret-syncer-wc5wg" (UID: "4ebbda4f-407d-4093-9a52-90a25e0345cb") : object "kube-system"/"original-pull-secret" not registered Jul 15 20:47:49.417419 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:49.417142 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:49.417419 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:49.417316 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:47:49.417419 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:49.417388 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs podName:49822cd3-a729-4a17-9b34-e61eb6d6257a nodeName:}" failed. No retries permitted until 2026-07-15 20:47:53.417368074 +0000 UTC m=+10.092857297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs") pod "network-metrics-daemon-7gxbt" (UID: "49822cd3-a729-4a17-9b34-e61eb6d6257a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:47:49.875419 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:49.875140 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:49.875419 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:49.875301 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:47:50.879038 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:50.875191 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:50.879038 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:50.875343 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:47:50.879038 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:50.875737 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:50.879038 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:50.875863 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:47:51.875566 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:51.875532 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:51.875760 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:51.875692 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:47:52.875925 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:52.875800 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:52.876407 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:52.876015 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:47:52.876477 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:52.876452 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:52.876657 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:52.876620 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:47:53.352282 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:53.352126 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:53.352282 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:53.352259 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2xxw\" (UniqueName: \"kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw\") pod \"network-check-target-rswbn\" (UID: \"b8a0f4c5-66fc-41fe-9e40-be137c051c68\") " pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:53.352526 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:53.352341 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 20:47:53.352526 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:53.352417 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 20:47:53.352526 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:53.352441 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret podName:4ebbda4f-407d-4093-9a52-90a25e0345cb nodeName:}" failed. No retries permitted until 2026-07-15 20:48:01.3524167 +0000 UTC m=+18.027905930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret") pod "global-pull-secret-syncer-wc5wg" (UID: "4ebbda4f-407d-4093-9a52-90a25e0345cb") : object "kube-system"/"original-pull-secret" not registered Jul 15 20:47:53.352526 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:53.352444 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 20:47:53.352526 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:53.352459 2553 projected.go:196] Error preparing data for projected volume kube-api-access-q2xxw for pod openshift-network-diagnostics/network-check-target-rswbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:47:53.352526 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:53.352510 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw podName:b8a0f4c5-66fc-41fe-9e40-be137c051c68 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:01.352492971 +0000 UTC m=+18.027982203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2xxw" (UniqueName: "kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw") pod "network-check-target-rswbn" (UID: "b8a0f4c5-66fc-41fe-9e40-be137c051c68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:47:53.453124 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:53.453004 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:53.453295 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:53.453162 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:47:53.453295 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:53.453237 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs podName:49822cd3-a729-4a17-9b34-e61eb6d6257a nodeName:}" failed. No retries permitted until 2026-07-15 20:48:01.453218464 +0000 UTC m=+18.128707689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs") pod "network-metrics-daemon-7gxbt" (UID: "49822cd3-a729-4a17-9b34-e61eb6d6257a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:47:53.875948 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:53.875918 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:53.876475 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:53.876037 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:47:54.875525 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:54.875488 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:54.875700 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:54.875535 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:54.875700 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:54.875636 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:47:54.875855 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:54.875765 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:47:55.876227 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:55.875951 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:55.876227 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:55.876117 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:47:56.875010 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:56.874963 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:56.875181 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:56.874969 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:56.875181 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:56.875111 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:47:56.875338 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:56.875177 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:47:57.875966 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:57.875931 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:57.876394 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:57.876064 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:47:58.874943 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:58.874914 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:47:58.875107 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:58.874913 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:47:58.875107 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:58.875027 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:47:58.875235 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:58.875133 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:47:59.875702 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:47:59.875663 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:47:59.876124 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:47:59.875824 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:48:00.875957 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:00.875923 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:00.876485 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:00.875970 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:00.876485 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:00.876059 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:48:00.876485 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:00.876201 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:48:01.416500 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:01.416460 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:01.416661 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:01.416525 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2xxw\" (UniqueName: \"kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw\") pod \"network-check-target-rswbn\" (UID: \"b8a0f4c5-66fc-41fe-9e40-be137c051c68\") " pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:01.416661 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:01.416647 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 20:48:01.416730 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:01.416665 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 20:48:01.416730 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:01.416683 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 20:48:01.416730 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:01.416693 2553 projected.go:196] Error preparing data for projected volume kube-api-access-q2xxw for pod openshift-network-diagnostics/network-check-target-rswbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:48:01.416730 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:01.416709 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret podName:4ebbda4f-407d-4093-9a52-90a25e0345cb nodeName:}" failed. No retries permitted until 2026-07-15 20:48:17.416689663 +0000 UTC m=+34.092178892 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret") pod "global-pull-secret-syncer-wc5wg" (UID: "4ebbda4f-407d-4093-9a52-90a25e0345cb") : object "kube-system"/"original-pull-secret" not registered Jul 15 20:48:01.416730 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:01.416728 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw podName:b8a0f4c5-66fc-41fe-9e40-be137c051c68 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:17.41671636 +0000 UTC m=+34.092205572 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2xxw" (UniqueName: "kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw") pod "network-check-target-rswbn" (UID: "b8a0f4c5-66fc-41fe-9e40-be137c051c68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:48:01.516896 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:01.516856 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:01.517103 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:01.517030 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:48:01.517103 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:01.517100 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs podName:49822cd3-a729-4a17-9b34-e61eb6d6257a nodeName:}" failed. No retries permitted until 2026-07-15 20:48:17.517085046 +0000 UTC m=+34.192574256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs") pod "network-metrics-daemon-7gxbt" (UID: "49822cd3-a729-4a17-9b34-e61eb6d6257a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:48:01.875230 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:01.875145 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:01.875367 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:01.875300 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:48:02.875546 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:02.875507 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:02.876053 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:02.875507 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:02.876053 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:02.875643 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:48:02.876053 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:02.875701 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:48:03.876936 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:03.876900 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:03.877360 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:03.877030 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:48:04.875083 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:04.875047 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:04.875262 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:04.875047 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:04.875262 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:04.875225 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:48:04.875262 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:04.875218 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:48:05.875556 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:05.875507 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:05.876040 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:05.875664 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:48:06.093944 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:06.092330 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bqdbw" event={"ID":"57186567-8d5d-4c5b-9d34-6248a420c405","Type":"ContainerStarted","Data":"0733106803d477b29f018b36e937e92088131411c92c83b19a8dce405f2bbde1"} Jul 15 20:48:06.109322 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:06.109190 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bqdbw" podStartSLOduration=6.81943114 podStartE2EDuration="22.109169721s" totalImagesPullingTime="15.289738581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:06.108914487 +0000 UTC m=+22.784403720" watchObservedRunningTime="2026-07-15 20:48:06.109169721 +0000 UTC m=+22.784658958" Jul 15 20:48:06.109408 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:06.109344 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-248.ec2.internal" podStartSLOduration=21.109336356 podStartE2EDuration="21.109336356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:47:49.069939404 +0000 UTC m=+5.745428642" watchObservedRunningTime="2026-07-15 20:48:06.109336356 +0000 UTC m=+22.784825588" Jul 15 20:48:06.875264 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:06.875022 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:06.875396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:06.875104 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:06.875444 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:06.875386 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:48:06.875498 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:06.875438 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:48:07.100735 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.100699 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6swgz" event={"ID":"7d738b72-dca3-4336-bb48-495adea2fb5d","Type":"ContainerStarted","Data":"7485c276158a3216a4a38f023418252ef92091146cee7a787d6be9f4084b2991"} Jul 15 20:48:07.102216 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.102187 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" event={"ID":"622e20ce-f096-4f57-a661-2905fca8ff90","Type":"ContainerStarted","Data":"6be83c37b1c3cf4880251a5a3185a32b0359a5950f95ef0ab90a0976225211da"} Jul 15 20:48:07.103514 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.103496 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8gqgn" event={"ID":"c238bf35-7bb4-4231-b8dc-e8f0f794425e","Type":"ContainerStarted","Data":"b3e17a06e65c12cf3fac71f98ac1801c52131b2cc8a9b28bc1c271f14d02159a"} Jul 15 20:48:07.104851 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.104828 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" event={"ID":"e1e307b3-eabc-490d-ab81-efe2b6197afa","Type":"ContainerStarted","Data":"0c3359e868118691e443768f42f862fea475c8f8c6d82292e36524e2f5db3e76"} Jul 15 20:48:07.107858 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.107837 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" event={"ID":"6a871f20-0680-4ebf-945b-40aa62b39577","Type":"ContainerStarted","Data":"382b947e6eef907adb5558ca514de4f6cc5c9f5677492d813d389790aa0322c9"} Jul 15 20:48:07.107961 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.107903 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" event={"ID":"6a871f20-0680-4ebf-945b-40aa62b39577","Type":"ContainerStarted","Data":"3a86f331f1ff5946d06035a6f0172edba31edd766ac983fbc37c6deea93d966a"} Jul 15 20:48:07.107961 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.107933 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" event={"ID":"6a871f20-0680-4ebf-945b-40aa62b39577","Type":"ContainerStarted","Data":"677927371f3a4f6a5002427263ef93857a44e6df03ad193871c9ce41a203c196"} Jul 15 20:48:07.108044 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.107978 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" event={"ID":"6a871f20-0680-4ebf-945b-40aa62b39577","Type":"ContainerStarted","Data":"38aca1984d175e6ea0202f6c60e72421c511c7dbf60390cc46e84dc779f4aa69"} Jul 15 20:48:07.108044 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.108014 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" event={"ID":"6a871f20-0680-4ebf-945b-40aa62b39577","Type":"ContainerStarted","Data":"3822e46d05b3499911c1673bad48aa517983031cc74b1c35dffcbb16c5958eb7"} Jul 15 20:48:07.108125 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.108044 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" event={"ID":"6a871f20-0680-4ebf-945b-40aa62b39577","Type":"ContainerStarted","Data":"db456c7dbd50e412baf95a99927c80363f02c434f8c717bfda14b8592ca24795"} Jul 15 20:48:07.109165 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.109149 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k4wxn" event={"ID":"bc50d127-1a8d-4a89-8a69-5eb54bef09f4","Type":"ContainerStarted","Data":"993c890ec738e97dc02b1dab2b3ebc66c672b74872204324afa201d400bf3e18"} Jul 15 20:48:07.110433 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.110416 2553 generic.go:356] "Generic (PLEG): container finished" podID="4e1595ed-f475-47cb-9b89-2217bfb3c8c5" containerID="804317542a46b22474bcb1751c835d1b5be19e4e1a547a85ba5bcc5401cc31ab" exitCode=0 Jul 15 20:48:07.110516 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.110491 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm9gc" event={"ID":"4e1595ed-f475-47cb-9b89-2217bfb3c8c5","Type":"ContainerDied","Data":"804317542a46b22474bcb1751c835d1b5be19e4e1a547a85ba5bcc5401cc31ab"} Jul 15 20:48:07.125280 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.125239 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6swgz" podStartSLOduration=4.118705534 podStartE2EDuration="23.125228173s" totalImagesPullingTime="19.006522639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:07.124927814 +0000 UTC m=+23.800417047" watchObservedRunningTime="2026-07-15 20:48:07.125228173 +0000 UTC m=+23.800717405" Jul 15 20:48:07.181672 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.181622 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8gqgn" podStartSLOduration=4.221571762 podStartE2EDuration="23.181607377s" totalImagesPullingTime="18.960035615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:07.181602456 +0000 UTC m=+23.857091688" watchObservedRunningTime="2026-07-15 20:48:07.181607377 +0000 UTC m=+23.857096610" Jul 15 20:48:07.221122 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.221080 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k4wxn" podStartSLOduration=4.261821447 podStartE2EDuration="23.221065447s" totalImagesPullingTime="18.959244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:07.220684136 +0000 UTC m=+23.896173369" watchObservedRunningTime="2026-07-15 20:48:07.221065447 +0000 UTC m=+23.896554680" Jul 15 20:48:07.240908 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.240837 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fc2pc" podStartSLOduration=4.267348606 podStartE2EDuration="23.240820988s" totalImagesPullingTime="18.973472382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:07.240586845 +0000 UTC m=+23.916076078" watchObservedRunningTime="2026-07-15 20:48:07.240820988 +0000 UTC m=+23.916310218" Jul 15 20:48:07.389306 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.389283 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 20:48:07.458414 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.458380 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:48:07.459019 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.459001 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:48:07.741464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.741369 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T20:48:07.389302291Z","UUID":"cb79d99d-24ba-4eca-b0e5-05110bf453ba","Handler":null,"Name":"","Endpoint":""} Jul 15 20:48:07.743072 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.743052 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 20:48:07.743201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.743093 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 20:48:07.875841 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:07.875796 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:07.876077 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:07.875944 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:48:08.114128 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:08.114045 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vhdz7" event={"ID":"243268d0-64f8-44f1-b410-46e4105d7f01","Type":"ContainerStarted","Data":"50db218691cffac12ded2be1cf880a57b7406cdf00a6a0cec1c799ee4e58fea9"} Jul 15 20:48:08.116693 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:08.116259 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" event={"ID":"622e20ce-f096-4f57-a661-2905fca8ff90","Type":"ContainerStarted","Data":"0f33986a13259edeee70920cb1c628f6f26339c02878bf021c22ac44cf2fa86e"} Jul 15 20:48:08.117137 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:08.117110 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:48:08.117946 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:08.117918 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bqdbw" Jul 15 20:48:08.169699 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:08.169644 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vhdz7" podStartSLOduration=5.205932095 podStartE2EDuration="24.169620881s" totalImagesPullingTime="18.963688786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:08.144731196 +0000 UTC m=+24.820220433" watchObservedRunningTime="2026-07-15 20:48:08.169620881 +0000 UTC m=+24.845110116" Jul 15 20:48:08.875563 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:08.875487 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:08.875717 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:08.875487 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:08.875717 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:08.875618 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:48:08.875717 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:08.875655 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:48:09.122478 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:09.122439 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" event={"ID":"6a871f20-0680-4ebf-945b-40aa62b39577","Type":"ContainerStarted","Data":"ea1bf50dd3c658bfb05d5b40ee628b7c7560a46487f7905e8dee626d9665b0b0"} Jul 15 20:48:09.124924 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:09.124888 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" event={"ID":"622e20ce-f096-4f57-a661-2905fca8ff90","Type":"ContainerStarted","Data":"fbbce45d1e89366ea8d97c36add40fb385720b34a296de27b24a47457e44248f"} Jul 15 20:48:09.875737 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:09.875495 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:09.875947 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:09.875875 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:48:10.875558 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:10.875528 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:10.876000 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:10.875528 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:10.876000 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:10.875651 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:48:10.876000 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:10.875696 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:48:11.875571 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:11.875330 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:11.876249 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:11.875588 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:48:12.138186 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:12.138099 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" event={"ID":"6a871f20-0680-4ebf-945b-40aa62b39577","Type":"ContainerStarted","Data":"bf3c5c9a1ae33863feda1c61332e4b60109c14485f5462fd24923700590c8f52"} Jul 15 20:48:12.138367 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:12.138350 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:48:12.139925 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:12.139902 2553 generic.go:356] "Generic (PLEG): container finished" podID="4e1595ed-f475-47cb-9b89-2217bfb3c8c5" containerID="457cd4d30c010d30784f395eb2c441e67ba9acde353478728ced4f2437b84a0a" exitCode=0 Jul 15 20:48:12.140040 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:12.139930 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm9gc" event={"ID":"4e1595ed-f475-47cb-9b89-2217bfb3c8c5","Type":"ContainerDied","Data":"457cd4d30c010d30784f395eb2c441e67ba9acde353478728ced4f2437b84a0a"} Jul 15 20:48:12.153998 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:12.153980 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:48:12.171557 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:12.171519 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" podStartSLOduration=9.146074816 podStartE2EDuration="28.171508425s" totalImagesPullingTime="19.025433609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:12.171231616 +0000 UTC m=+28.846720849" watchObservedRunningTime="2026-07-15 20:48:12.171508425 +0000 UTC m=+28.846997657" Jul 15 20:48:12.171717 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:12.171699 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjgb6" podStartSLOduration=7.036801568 podStartE2EDuration="28.171695229s" totalImagesPullingTime="21.134893661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:09.151652043 +0000 UTC m=+25.827141277" watchObservedRunningTime="2026-07-15 20:48:12.171695229 +0000 UTC m=+28.847184481" Jul 15 20:48:12.875314 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:12.875284 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:12.875541 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:12.875284 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:12.875541 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:12.875410 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:48:12.875541 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:12.875446 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:48:13.145678 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:13.145643 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:48:13.145844 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:13.145792 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:48:13.165661 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:13.165638 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:48:13.327640 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:13.327612 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wc5wg"] Jul 15 20:48:13.327887 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:13.327713 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:13.327887 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:13.327808 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:48:13.330588 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:13.330563 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rswbn"] Jul 15 20:48:13.330700 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:13.330664 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:13.330789 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:13.330756 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:48:13.333462 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:13.333440 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7gxbt"] Jul 15 20:48:13.333567 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:13.333546 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:13.333637 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:13.333621 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:48:14.148367 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:14.148336 2553 generic.go:356] "Generic (PLEG): container finished" podID="4e1595ed-f475-47cb-9b89-2217bfb3c8c5" containerID="681d9ba457f89fd7ab0222caba4771a76052da26ec460670089fecac5d2b0748" exitCode=0 Jul 15 20:48:14.148734 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:14.148419 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm9gc" event={"ID":"4e1595ed-f475-47cb-9b89-2217bfb3c8c5","Type":"ContainerDied","Data":"681d9ba457f89fd7ab0222caba4771a76052da26ec460670089fecac5d2b0748"} Jul 15 20:48:14.875732 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:14.875697 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:14.875922 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:14.875748 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:14.875922 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:14.875748 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:14.875922 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:14.875842 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:48:14.876086 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:14.875934 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:48:14.876086 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:14.876022 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:48:16.154788 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:16.154570 2553 generic.go:356] "Generic (PLEG): container finished" podID="4e1595ed-f475-47cb-9b89-2217bfb3c8c5" containerID="7bf4a11975840d9363aaa503a2332cd58890ab662d954e4ccdf816180a8a63e2" exitCode=0 Jul 15 20:48:16.154788 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:16.154651 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm9gc" event={"ID":"4e1595ed-f475-47cb-9b89-2217bfb3c8c5","Type":"ContainerDied","Data":"7bf4a11975840d9363aaa503a2332cd58890ab662d954e4ccdf816180a8a63e2"} Jul 15 20:48:16.875817 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:16.875787 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:16.875989 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:16.875837 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:16.875989 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:16.875909 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:16.875989 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:16.875927 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7gxbt" podUID="49822cd3-a729-4a17-9b34-e61eb6d6257a" Jul 15 20:48:16.875989 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:16.875976 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rswbn" podUID="b8a0f4c5-66fc-41fe-9e40-be137c051c68" Jul 15 20:48:16.876155 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:16.876063 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wc5wg" podUID="4ebbda4f-407d-4093-9a52-90a25e0345cb" Jul 15 20:48:17.433145 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:17.433114 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:17.433643 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:17.433158 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2xxw\" (UniqueName: \"kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw\") pod \"network-check-target-rswbn\" (UID: \"b8a0f4c5-66fc-41fe-9e40-be137c051c68\") " pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:17.433643 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:17.433272 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 20:48:17.433643 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:17.433278 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 20:48:17.433643 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:17.433351 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret podName:4ebbda4f-407d-4093-9a52-90a25e0345cb nodeName:}" failed. No retries permitted until 2026-07-15 20:48:49.433329815 +0000 UTC m=+66.108819046 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret") pod "global-pull-secret-syncer-wc5wg" (UID: "4ebbda4f-407d-4093-9a52-90a25e0345cb") : object "kube-system"/"original-pull-secret" not registered Jul 15 20:48:17.433643 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:17.433285 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 20:48:17.433643 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:17.433381 2553 projected.go:196] Error preparing data for projected volume kube-api-access-q2xxw for pod openshift-network-diagnostics/network-check-target-rswbn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:48:17.433643 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:17.433436 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw podName:b8a0f4c5-66fc-41fe-9e40-be137c051c68 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:49.433422196 +0000 UTC m=+66.108911406 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2xxw" (UniqueName: "kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw") pod "network-check-target-rswbn" (UID: "b8a0f4c5-66fc-41fe-9e40-be137c051c68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 20:48:17.534387 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:17.534349 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:17.534552 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:17.534511 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:48:17.534639 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:17.534588 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs podName:49822cd3-a729-4a17-9b34-e61eb6d6257a nodeName:}" failed. No retries permitted until 2026-07-15 20:48:49.534568034 +0000 UTC m=+66.210057266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs") pod "network-metrics-daemon-7gxbt" (UID: "49822cd3-a729-4a17-9b34-e61eb6d6257a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 20:48:18.674970 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.674906 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-248.ec2.internal" event="NodeReady" Jul 15 20:48:18.675468 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.675053 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 20:48:18.721066 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.720465 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg"] Jul 15 20:48:18.724529 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.724506 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-97b66b7f8-jlwjw"] Jul 15 20:48:18.724807 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.724786 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" Jul 15 20:48:18.727377 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.727348 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 20:48:18.728064 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.727493 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vc27z\"" Jul 15 20:48:18.728064 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.727910 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 20:48:18.728064 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.727994 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 20:48:18.728241 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.728126 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 20:48:18.728319 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.728298 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pmltj"] Jul 15 20:48:18.728427 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.728381 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.730832 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.730765 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ljh2w"] Jul 15 20:48:18.731208 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.730846 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pmltj" Jul 15 20:48:18.731208 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.730916 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 20:48:18.731596 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.731580 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 20:48:18.731709 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.731677 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n7hwd\"" Jul 15 20:48:18.731819 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.731717 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 20:48:18.733293 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.733251 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf"] Jul 15 20:48:18.733436 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.733378 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.734589 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.734571 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 20:48:18.736960 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.735898 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k"] Jul 15 20:48:18.736960 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.736062 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6vcs9\"" Jul 15 20:48:18.736960 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.736122 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" Jul 15 20:48:18.736960 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.736573 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 20:48:18.736960 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.736669 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mvdww\"" Jul 15 20:48:18.736960 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.736677 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 20:48:18.736960 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.736804 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 20:48:18.736960 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.736935 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 20:48:18.739077 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.736990 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 20:48:18.740968 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.740430 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 20:48:18.741113 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.741093 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gwsb7\"" Jul 15 20:48:18.742672 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.742341 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 20:48:18.743953 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.742980 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 20:48:18.743953 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.743109 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pmltj"] Jul 15 20:48:18.743953 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.743140 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf"] Jul 15 20:48:18.743953 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.743163 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg"] Jul 15 20:48:18.743953 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.743181 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ljh2w"] Jul 15 20:48:18.743953 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.743198 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-97b66b7f8-jlwjw"] Jul 15 20:48:18.743953 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.743270 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:18.745136 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.744981 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 20:48:18.745683 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.745636 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 20:48:18.745929 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.745911 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 20:48:18.746139 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.746122 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 20:48:18.746214 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.746170 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4ncw6\"" Jul 15 20:48:18.746266 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.746124 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 20:48:18.747040 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.746857 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 20:48:18.759130 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.759105 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k"] Jul 15 20:48:18.762230 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.762207 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2"] Jul 15 20:48:18.766414 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.766384 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s2jgz"] Jul 15 20:48:18.766564 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.766547 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:18.768704 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.768686 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dhvh9\"" Jul 15 20:48:18.769525 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.769506 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 20:48:18.769716 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.769535 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 20:48:18.769858 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.769547 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 20:48:18.769858 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.769563 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 20:48:18.770873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.770851 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-mxr4t"] Jul 15 20:48:18.771002 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.770987 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.774786 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.774587 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 20:48:18.775153 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.775110 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kll9v\"" Jul 15 20:48:18.775238 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.775149 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 20:48:18.776555 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.776539 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-qwfct"] Jul 15 20:48:18.776863 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.776841 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:18.779938 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.779918 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 20:48:18.781327 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.780518 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 20:48:18.781327 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.780893 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 20:48:18.781556 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.781539 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dzmdt\"" Jul 15 20:48:18.781829 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.779930 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 20:48:18.784727 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.782051 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6cb6f979db-vqk9s"] Jul 15 20:48:18.784727 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.783361 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qwfct" Jul 15 20:48:18.786480 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.786459 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 20:48:18.787306 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.786694 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jx2l6\"" Jul 15 20:48:18.787306 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.787250 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 20:48:18.787938 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.787650 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hv47s"] Jul 15 20:48:18.787938 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.787865 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:18.789408 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.789361 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 20:48:18.790411 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.790395 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 20:48:18.791029 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.791010 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cvgsd\"" Jul 15 20:48:18.791029 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.791026 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 20:48:18.791177 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.791029 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 20:48:18.791177 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.791072 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 20:48:18.791304 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.791287 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 20:48:18.791517 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.791495 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 20:48:18.792687 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.792667 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2"] Jul 15 20:48:18.792801 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.792697 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s2jgz"] Jul 15 20:48:18.792801 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.792718 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-mxr4t"] Jul 15 20:48:18.792801 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.792735 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hv47s"] Jul 15 20:48:18.793009 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.792826 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hv47s" Jul 15 20:48:18.794018 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.793999 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-qwfct"] Jul 15 20:48:18.795530 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.795508 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 20:48:18.796168 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.795584 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 20:48:18.796242 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.795615 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 20:48:18.796306 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.795736 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pz297\"" Jul 15 20:48:18.802783 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.802750 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6cb6f979db-vqk9s"] Jul 15 20:48:18.843279 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843255 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sh6v\" (UniqueName: \"kubernetes.io/projected/7d900b98-fa9b-457c-acc8-7c65df59d4e0-kube-api-access-6sh6v\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:18.843383 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843293 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/52546b70-c875-44e4-afa2-70bf34e5f7dc-ca-trust-extracted\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.843383 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843316 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xghhk\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-kube-api-access-xghhk\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.843383 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843364 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e95cdc29-c50b-4470-a2af-7d158d58d1eb-serving-cert\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.843584 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843433 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4723c782-9fbb-4b87-99c9-13786304bb2d-config\") pod \"service-ca-operator-7695fc6c8c-r2fbf\" (UID: \"4723c782-9fbb-4b87-99c9-13786304bb2d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" Jul 15 20:48:18.843584 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843467 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-trusted-ca\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.843584 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843498 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npcsf\" (UniqueName: \"kubernetes.io/projected/e95cdc29-c50b-4470-a2af-7d158d58d1eb-kube-api-access-npcsf\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.843584 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843522 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntj58\" (UniqueName: \"kubernetes.io/projected/e11bbae4-d50c-46b1-a8bf-8b48ae664c3e-kube-api-access-ntj58\") pod \"volume-data-source-validator-78495597f6-pmltj\" (UID: \"e11bbae4-d50c-46b1-a8bf-8b48ae664c3e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pmltj" Jul 15 20:48:18.843584 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843545 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-installation-pull-secrets\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.843584 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843566 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/259f06c8-f250-4e55-bf98-54ae3ac65636-config-volume\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.844007 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843656 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e95cdc29-c50b-4470-a2af-7d158d58d1eb-tmp\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.844007 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843707 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.844007 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843747 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e95cdc29-c50b-4470-a2af-7d158d58d1eb-snapshots\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.844007 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843788 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d900b98-fa9b-457c-acc8-7c65df59d4e0-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:18.844007 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843859 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-image-registry-private-configuration\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.844007 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843892 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sptcr\" (UniqueName: \"kubernetes.io/projected/4723c782-9fbb-4b87-99c9-13786304bb2d-kube-api-access-sptcr\") pod \"service-ca-operator-7695fc6c8c-r2fbf\" (UID: \"4723c782-9fbb-4b87-99c9-13786304bb2d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" Jul 15 20:48:18.844007 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843924 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4723c782-9fbb-4b87-99c9-13786304bb2d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-r2fbf\" (UID: \"4723c782-9fbb-4b87-99c9-13786304bb2d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" Jul 15 20:48:18.844007 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843951 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9613d99-d0ed-4e47-b087-713ff9332b1a-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-29dsg\" (UID: \"b9613d99-d0ed-4e47-b087-713ff9332b1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" Jul 15 20:48:18.844007 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.843973 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tw7g\" (UniqueName: \"kubernetes.io/projected/259f06c8-f250-4e55-bf98-54ae3ac65636-kube-api-access-8tw7g\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.844007 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.844002 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e95cdc29-c50b-4470-a2af-7d158d58d1eb-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.844445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.844030 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.844445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.844056 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9613d99-d0ed-4e47-b087-713ff9332b1a-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-29dsg\" (UID: \"b9613d99-d0ed-4e47-b087-713ff9332b1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" Jul 15 20:48:18.844445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.844081 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:18.844445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.844107 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e95cdc29-c50b-4470-a2af-7d158d58d1eb-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.844445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.844129 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-certificates\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.844445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.844186 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2nh8\" (UniqueName: \"kubernetes.io/projected/b9613d99-d0ed-4e47-b087-713ff9332b1a-kube-api-access-x2nh8\") pod \"kube-storage-version-migrator-operator-799cb7f958-29dsg\" (UID: \"b9613d99-d0ed-4e47-b087-713ff9332b1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" Jul 15 20:48:18.844445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.844221 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-bound-sa-token\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.844445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.844268 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mgsw\" (UniqueName: \"kubernetes.io/projected/a369c290-e786-4758-bc3b-998a3afbb815-kube-api-access-6mgsw\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:18.844445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.844293 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/259f06c8-f250-4e55-bf98-54ae3ac65636-tmp-dir\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.844445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.844365 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:18.875097 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.875073 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:18.875239 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.875226 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:18.875345 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.875328 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:18.877342 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.877320 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 20:48:18.877439 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.877413 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 20:48:18.877521 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.877504 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lxhhk\"" Jul 15 20:48:18.877749 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.877717 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5sgcj\"" Jul 15 20:48:18.945718 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.945680 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.945903 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.945726 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9613d99-d0ed-4e47-b087-713ff9332b1a-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-29dsg\" (UID: \"b9613d99-d0ed-4e47-b087-713ff9332b1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" Jul 15 20:48:18.945903 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.945841 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:18.945903 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:18.945859 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 20:48:18.945903 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.945873 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e95cdc29-c50b-4470-a2af-7d158d58d1eb-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.945903 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.945902 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-certificates\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.946103 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.945932 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2nh8\" (UniqueName: \"kubernetes.io/projected/b9613d99-d0ed-4e47-b087-713ff9332b1a-kube-api-access-x2nh8\") pod \"kube-storage-version-migrator-operator-799cb7f958-29dsg\" (UID: \"b9613d99-d0ed-4e47-b087-713ff9332b1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" Jul 15 20:48:18.946103 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.945956 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-bound-sa-token\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.946103 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946008 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mgsw\" (UniqueName: \"kubernetes.io/projected/a369c290-e786-4758-bc3b-998a3afbb815-kube-api-access-6mgsw\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:18.946103 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946031 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/259f06c8-f250-4e55-bf98-54ae3ac65636-tmp-dir\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.946103 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946060 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljvw4\" (UniqueName: \"kubernetes.io/projected/4131898e-b714-49ab-bbe9-18ab20e268a0-kube-api-access-ljvw4\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:18.946103 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946098 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:18.946350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946121 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sh6v\" (UniqueName: \"kubernetes.io/projected/7d900b98-fa9b-457c-acc8-7c65df59d4e0-kube-api-access-6sh6v\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:18.946350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946147 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/52546b70-c875-44e4-afa2-70bf34e5f7dc-ca-trust-extracted\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.946350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946171 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xghhk\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-kube-api-access-xghhk\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.946350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946198 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-default-certificate\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:18.946350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946229 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:18.946350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946256 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e95cdc29-c50b-4470-a2af-7d158d58d1eb-serving-cert\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.946350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946285 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4723c782-9fbb-4b87-99c9-13786304bb2d-config\") pod \"service-ca-operator-7695fc6c8c-r2fbf\" (UID: \"4723c782-9fbb-4b87-99c9-13786304bb2d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" Jul 15 20:48:18.946350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946317 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-stats-auth\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:18.946350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946348 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-trusted-ca\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.946763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:18.945881 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97b66b7f8-jlwjw: secret "image-registry-tls" not found Jul 15 20:48:18.946763 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946414 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a293a93-2b99-4009-80d8-d31045b5fbd8-cert\") pod \"ingress-canary-hv47s\" (UID: \"6a293a93-2b99-4009-80d8-d31045b5fbd8\") " pod="openshift-ingress-canary/ingress-canary-hv47s" Jul 15 20:48:18.946763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:18.946436 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls podName:52546b70-c875-44e4-afa2-70bf34e5f7dc nodeName:}" failed. No retries permitted until 2026-07-15 20:48:19.446414285 +0000 UTC m=+36.121903509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls") pod "image-registry-97b66b7f8-jlwjw" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc") : secret "image-registry-tls" not found Jul 15 20:48:18.946763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:18.946499 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:18.946763 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.946525 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/259f06c8-f250-4e55-bf98-54ae3ac65636-tmp-dir\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.946763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:18.946634 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls podName:7d900b98-fa9b-457c-acc8-7c65df59d4e0 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:19.446617173 +0000 UTC m=+36.122106398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4g6v2" (UID: "7d900b98-fa9b-457c-acc8-7c65df59d4e0") : secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:18.946763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:18.946696 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 20:48:18.946763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:18.946730 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls podName:a369c290-e786-4758-bc3b-998a3afbb815 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:19.446719641 +0000 UTC m=+36.122208858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls") pod "cluster-samples-operator-65db858894-8gm8k" (UID: "a369c290-e786-4758-bc3b-998a3afbb815") : secret "samples-operator-tls" not found Jul 15 20:48:18.947172 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947019 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:18.947172 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947073 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npcsf\" (UniqueName: \"kubernetes.io/projected/e95cdc29-c50b-4470-a2af-7d158d58d1eb-kube-api-access-npcsf\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.947172 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947098 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/52546b70-c875-44e4-afa2-70bf34e5f7dc-ca-trust-extracted\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.947319 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947175 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e95cdc29-c50b-4470-a2af-7d158d58d1eb-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.947319 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947101 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntj58\" (UniqueName: \"kubernetes.io/projected/e11bbae4-d50c-46b1-a8bf-8b48ae664c3e-kube-api-access-ntj58\") pod \"volume-data-source-validator-78495597f6-pmltj\" (UID: \"e11bbae4-d50c-46b1-a8bf-8b48ae664c3e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pmltj" Jul 15 20:48:18.947319 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947231 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-installation-pull-secrets\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.947319 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947259 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/259f06c8-f250-4e55-bf98-54ae3ac65636-config-volume\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.947319 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947277 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4131898e-b714-49ab-bbe9-18ab20e268a0-serving-cert\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:18.947319 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947318 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e95cdc29-c50b-4470-a2af-7d158d58d1eb-tmp\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.947610 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947342 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.947610 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947362 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4723c782-9fbb-4b87-99c9-13786304bb2d-config\") pod \"service-ca-operator-7695fc6c8c-r2fbf\" (UID: \"4723c782-9fbb-4b87-99c9-13786304bb2d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" Jul 15 20:48:18.947610 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947371 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7mmv\" (UniqueName: \"kubernetes.io/projected/a121d5c1-0427-487e-b874-fb4eda803b38-kube-api-access-f7mmv\") pod \"network-check-source-869dcfcdcd-qwfct\" (UID: \"a121d5c1-0427-487e-b874-fb4eda803b38\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qwfct" Jul 15 20:48:18.947610 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947423 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e95cdc29-c50b-4470-a2af-7d158d58d1eb-snapshots\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.947610 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947450 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d900b98-fa9b-457c-acc8-7c65df59d4e0-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:18.947610 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947489 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4wjs\" (UniqueName: \"kubernetes.io/projected/27a97da1-f66f-45c9-aaa9-a16df8672253-kube-api-access-z4wjs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:18.947610 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947518 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-image-registry-private-configuration\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.947610 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947544 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4131898e-b714-49ab-bbe9-18ab20e268a0-config\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:18.947610 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947571 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7v6h\" (UniqueName: \"kubernetes.io/projected/6a293a93-2b99-4009-80d8-d31045b5fbd8-kube-api-access-s7v6h\") pod \"ingress-canary-hv47s\" (UID: \"6a293a93-2b99-4009-80d8-d31045b5fbd8\") " pod="openshift-ingress-canary/ingress-canary-hv47s" Jul 15 20:48:18.947610 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947598 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sptcr\" (UniqueName: \"kubernetes.io/projected/4723c782-9fbb-4b87-99c9-13786304bb2d-kube-api-access-sptcr\") pod \"service-ca-operator-7695fc6c8c-r2fbf\" (UID: \"4723c782-9fbb-4b87-99c9-13786304bb2d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" Jul 15 20:48:18.948106 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947628 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4723c782-9fbb-4b87-99c9-13786304bb2d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-r2fbf\" (UID: \"4723c782-9fbb-4b87-99c9-13786304bb2d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" Jul 15 20:48:18.948106 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947655 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9613d99-d0ed-4e47-b087-713ff9332b1a-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-29dsg\" (UID: \"b9613d99-d0ed-4e47-b087-713ff9332b1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" Jul 15 20:48:18.948106 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947666 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-trusted-ca\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.948106 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947679 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tw7g\" (UniqueName: \"kubernetes.io/projected/259f06c8-f250-4e55-bf98-54ae3ac65636-kube-api-access-8tw7g\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.948106 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947725 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e95cdc29-c50b-4470-a2af-7d158d58d1eb-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.948106 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947757 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4131898e-b714-49ab-bbe9-18ab20e268a0-trusted-ca\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:18.948106 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947842 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/259f06c8-f250-4e55-bf98-54ae3ac65636-config-volume\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.948106 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.947944 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-certificates\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.948106 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:18.948059 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 20:48:18.948590 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:18.948119 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls podName:259f06c8-f250-4e55-bf98-54ae3ac65636 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:19.448099629 +0000 UTC m=+36.123588852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls") pod "dns-default-s2jgz" (UID: "259f06c8-f250-4e55-bf98-54ae3ac65636") : secret "dns-default-metrics-tls" not found Jul 15 20:48:18.948590 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.948434 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e95cdc29-c50b-4470-a2af-7d158d58d1eb-tmp\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.948590 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.948444 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e95cdc29-c50b-4470-a2af-7d158d58d1eb-snapshots\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.948590 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.948576 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e95cdc29-c50b-4470-a2af-7d158d58d1eb-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.949190 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.949128 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9613d99-d0ed-4e47-b087-713ff9332b1a-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-29dsg\" (UID: \"b9613d99-d0ed-4e47-b087-713ff9332b1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" Jul 15 20:48:18.949629 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.949607 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d900b98-fa9b-457c-acc8-7c65df59d4e0-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:18.951060 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.951016 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9613d99-d0ed-4e47-b087-713ff9332b1a-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-29dsg\" (UID: \"b9613d99-d0ed-4e47-b087-713ff9332b1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" Jul 15 20:48:18.951162 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.951069 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e95cdc29-c50b-4470-a2af-7d158d58d1eb-serving-cert\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.951162 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.951115 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-image-registry-private-configuration\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.951447 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.951425 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-installation-pull-secrets\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.951540 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.951522 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4723c782-9fbb-4b87-99c9-13786304bb2d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-r2fbf\" (UID: \"4723c782-9fbb-4b87-99c9-13786304bb2d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" Jul 15 20:48:18.961062 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.961013 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-bound-sa-token\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.962614 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.962590 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tw7g\" (UniqueName: \"kubernetes.io/projected/259f06c8-f250-4e55-bf98-54ae3ac65636-kube-api-access-8tw7g\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:18.962723 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.962599 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2nh8\" (UniqueName: \"kubernetes.io/projected/b9613d99-d0ed-4e47-b087-713ff9332b1a-kube-api-access-x2nh8\") pod \"kube-storage-version-migrator-operator-799cb7f958-29dsg\" (UID: \"b9613d99-d0ed-4e47-b087-713ff9332b1a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" Jul 15 20:48:18.962809 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.962788 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npcsf\" (UniqueName: \"kubernetes.io/projected/e95cdc29-c50b-4470-a2af-7d158d58d1eb-kube-api-access-npcsf\") pod \"insights-operator-68d9dd94cf-ljh2w\" (UID: \"e95cdc29-c50b-4470-a2af-7d158d58d1eb\") " pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:18.962942 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.962899 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mgsw\" (UniqueName: \"kubernetes.io/projected/a369c290-e786-4758-bc3b-998a3afbb815-kube-api-access-6mgsw\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:18.963275 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.963235 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntj58\" (UniqueName: \"kubernetes.io/projected/e11bbae4-d50c-46b1-a8bf-8b48ae664c3e-kube-api-access-ntj58\") pod \"volume-data-source-validator-78495597f6-pmltj\" (UID: \"e11bbae4-d50c-46b1-a8bf-8b48ae664c3e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pmltj" Jul 15 20:48:18.964100 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.964051 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sh6v\" (UniqueName: \"kubernetes.io/projected/7d900b98-fa9b-457c-acc8-7c65df59d4e0-kube-api-access-6sh6v\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:18.964349 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.964324 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xghhk\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-kube-api-access-xghhk\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:18.964455 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:18.964444 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sptcr\" (UniqueName: \"kubernetes.io/projected/4723c782-9fbb-4b87-99c9-13786304bb2d-kube-api-access-sptcr\") pod \"service-ca-operator-7695fc6c8c-r2fbf\" (UID: \"4723c782-9fbb-4b87-99c9-13786304bb2d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" Jul 15 20:48:19.039274 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.039194 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" Jul 15 20:48:19.049035 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049013 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-stats-auth\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:19.049147 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049044 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a293a93-2b99-4009-80d8-d31045b5fbd8-cert\") pod \"ingress-canary-hv47s\" (UID: \"6a293a93-2b99-4009-80d8-d31045b5fbd8\") " pod="openshift-ingress-canary/ingress-canary-hv47s" Jul 15 20:48:19.049147 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049075 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:19.049147 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049103 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4131898e-b714-49ab-bbe9-18ab20e268a0-serving-cert\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:19.049147 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049142 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7mmv\" (UniqueName: \"kubernetes.io/projected/a121d5c1-0427-487e-b874-fb4eda803b38-kube-api-access-f7mmv\") pod \"network-check-source-869dcfcdcd-qwfct\" (UID: \"a121d5c1-0427-487e-b874-fb4eda803b38\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qwfct" Jul 15 20:48:19.049327 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049175 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4wjs\" (UniqueName: \"kubernetes.io/projected/27a97da1-f66f-45c9-aaa9-a16df8672253-kube-api-access-z4wjs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:19.049327 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049198 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4131898e-b714-49ab-bbe9-18ab20e268a0-config\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:19.049327 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049222 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7v6h\" (UniqueName: \"kubernetes.io/projected/6a293a93-2b99-4009-80d8-d31045b5fbd8-kube-api-access-s7v6h\") pod \"ingress-canary-hv47s\" (UID: \"6a293a93-2b99-4009-80d8-d31045b5fbd8\") " pod="openshift-ingress-canary/ingress-canary-hv47s" Jul 15 20:48:19.049327 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.049266 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:19.549248656 +0000 UTC m=+36.224737876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : configmap references non-existent config key: service-ca.crt Jul 15 20:48:19.049327 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049320 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4131898e-b714-49ab-bbe9-18ab20e268a0-trusted-ca\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:19.049575 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049391 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljvw4\" (UniqueName: \"kubernetes.io/projected/4131898e-b714-49ab-bbe9-18ab20e268a0-kube-api-access-ljvw4\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:19.049575 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049439 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-default-certificate\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:19.049575 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.049466 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:19.049718 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.049579 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 20:48:19.049718 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.049634 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:19.549620359 +0000 UTC m=+36.225109577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : secret "router-metrics-certs-default" not found Jul 15 20:48:19.050071 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.050020 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4131898e-b714-49ab-bbe9-18ab20e268a0-config\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:19.050452 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.050403 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4131898e-b714-49ab-bbe9-18ab20e268a0-trusted-ca\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:19.051851 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.051825 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4131898e-b714-49ab-bbe9-18ab20e268a0-serving-cert\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:19.052013 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.051995 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a293a93-2b99-4009-80d8-d31045b5fbd8-cert\") pod \"ingress-canary-hv47s\" (UID: \"6a293a93-2b99-4009-80d8-d31045b5fbd8\") " pod="openshift-ingress-canary/ingress-canary-hv47s" Jul 15 20:48:19.052358 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.052339 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-default-certificate\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:19.052358 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.052346 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-stats-auth\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:19.058979 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.058746 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4wjs\" (UniqueName: \"kubernetes.io/projected/27a97da1-f66f-45c9-aaa9-a16df8672253-kube-api-access-z4wjs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:19.058979 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.058962 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7mmv\" (UniqueName: \"kubernetes.io/projected/a121d5c1-0427-487e-b874-fb4eda803b38-kube-api-access-f7mmv\") pod \"network-check-source-869dcfcdcd-qwfct\" (UID: \"a121d5c1-0427-487e-b874-fb4eda803b38\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qwfct" Jul 15 20:48:19.059104 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.059088 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7v6h\" (UniqueName: \"kubernetes.io/projected/6a293a93-2b99-4009-80d8-d31045b5fbd8-kube-api-access-s7v6h\") pod \"ingress-canary-hv47s\" (UID: \"6a293a93-2b99-4009-80d8-d31045b5fbd8\") " pod="openshift-ingress-canary/ingress-canary-hv47s" Jul 15 20:48:19.059445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.059414 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljvw4\" (UniqueName: \"kubernetes.io/projected/4131898e-b714-49ab-bbe9-18ab20e268a0-kube-api-access-ljvw4\") pod \"console-operator-7866497494-mxr4t\" (UID: \"4131898e-b714-49ab-bbe9-18ab20e268a0\") " pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:19.061173 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.061151 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pmltj" Jul 15 20:48:19.070179 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.070155 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" Jul 15 20:48:19.078398 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.078378 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" Jul 15 20:48:19.111877 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.111848 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:19.122196 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.122168 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qwfct" Jul 15 20:48:19.134653 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.134625 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hv47s" Jul 15 20:48:19.178646 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.178621 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-vjmp5"] Jul 15 20:48:19.181992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.181973 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:19.184454 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.184431 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 20:48:19.184454 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.184449 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bhg56\"" Jul 15 20:48:19.184604 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.184580 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 20:48:19.198025 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.198001 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-vjmp5"] Jul 15 20:48:19.353048 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.352980 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-nginx-conf\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:19.353203 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.353106 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:19.454580 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.454544 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:19.454798 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.454588 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:19.454798 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.454633 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:19.454798 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.454688 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:19.454798 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.454729 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 20:48:19.454798 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.454754 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97b66b7f8-jlwjw: secret "image-registry-tls" not found Jul 15 20:48:19.454798 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.454793 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:19.455089 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.454805 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 20:48:19.455089 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.454761 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-nginx-conf\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:19.455089 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.454842 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls podName:52546b70-c875-44e4-afa2-70bf34e5f7dc nodeName:}" failed. No retries permitted until 2026-07-15 20:48:20.454820374 +0000 UTC m=+37.130309592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls") pod "image-registry-97b66b7f8-jlwjw" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc") : secret "image-registry-tls" not found Jul 15 20:48:19.455089 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.454846 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 20:48:19.455089 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.454867 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls podName:7d900b98-fa9b-457c-acc8-7c65df59d4e0 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:20.454857615 +0000 UTC m=+37.130346826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4g6v2" (UID: "7d900b98-fa9b-457c-acc8-7c65df59d4e0") : secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:19.455089 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.454888 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert podName:b1461f20-8aee-40e4-99cb-5e6e94c61ab4 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:19.9548771 +0000 UTC m=+36.630366324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vjmp5" (UID: "b1461f20-8aee-40e4-99cb-5e6e94c61ab4") : secret "networking-console-plugin-cert" not found Jul 15 20:48:19.455089 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.454908 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls podName:a369c290-e786-4758-bc3b-998a3afbb815 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:20.454897985 +0000 UTC m=+37.130387201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls") pod "cluster-samples-operator-65db858894-8gm8k" (UID: "a369c290-e786-4758-bc3b-998a3afbb815") : secret "samples-operator-tls" not found Jul 15 20:48:19.455089 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.454967 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:19.455089 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.455083 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 20:48:19.455480 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.455128 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls podName:259f06c8-f250-4e55-bf98-54ae3ac65636 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:20.455113267 +0000 UTC m=+37.130602484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls") pod "dns-default-s2jgz" (UID: "259f06c8-f250-4e55-bf98-54ae3ac65636") : secret "dns-default-metrics-tls" not found Jul 15 20:48:19.455480 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.455473 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-nginx-conf\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:19.557206 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.557163 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:19.557350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.557244 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:19.557583 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.557563 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:20.557499582 +0000 UTC m=+37.232988810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : configmap references non-existent config key: service-ca.crt Jul 15 20:48:19.557691 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.557678 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 20:48:19.557903 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.557892 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:20.557876279 +0000 UTC m=+37.233365505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : secret "router-metrics-certs-default" not found Jul 15 20:48:19.961287 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:19.961246 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:19.962061 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.961427 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 20:48:19.962061 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:19.961581 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert podName:b1461f20-8aee-40e4-99cb-5e6e94c61ab4 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:20.961561574 +0000 UTC m=+37.637050808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vjmp5" (UID: "b1461f20-8aee-40e4-99cb-5e6e94c61ab4") : secret "networking-console-plugin-cert" not found Jul 15 20:48:20.410670 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.410452 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg"] Jul 15 20:48:20.415075 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:20.414319 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9613d99_d0ed_4e47_b087_713ff9332b1a.slice/crio-dc600eb32240469eacbfbbca4e310ffd93360eb9afcbb95d6f558814949bbcf0 WatchSource:0}: Error finding container dc600eb32240469eacbfbbca4e310ffd93360eb9afcbb95d6f558814949bbcf0: Status 404 returned error can't find the container with id dc600eb32240469eacbfbbca4e310ffd93360eb9afcbb95d6f558814949bbcf0 Jul 15 20:48:20.415075 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.414662 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ljh2w"] Jul 15 20:48:20.421470 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:20.421443 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95cdc29_c50b_4470_a2af_7d158d58d1eb.slice/crio-ea04d573df9a2ead4c8347df33957638b954d4945dff72806a233e3386627f9a WatchSource:0}: Error finding container ea04d573df9a2ead4c8347df33957638b954d4945dff72806a233e3386627f9a: Status 404 returned error can't find the container with id ea04d573df9a2ead4c8347df33957638b954d4945dff72806a233e3386627f9a Jul 15 20:48:20.427170 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.427108 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pmltj"] Jul 15 20:48:20.431057 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.430951 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-qwfct"] Jul 15 20:48:20.432059 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.431999 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-mxr4t"] Jul 15 20:48:20.432276 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:20.432242 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11bbae4_d50c_46b1_a8bf_8b48ae664c3e.slice/crio-cd9d976f3836d7695ef88240ad5dfb31765f04baf06243ecb782cfc6a929dc9c WatchSource:0}: Error finding container cd9d976f3836d7695ef88240ad5dfb31765f04baf06243ecb782cfc6a929dc9c: Status 404 returned error can't find the container with id cd9d976f3836d7695ef88240ad5dfb31765f04baf06243ecb782cfc6a929dc9c Jul 15 20:48:20.433704 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:20.433668 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4131898e_b714_49ab_bbe9_18ab20e268a0.slice/crio-8e6bbe7b0fa4458e0308ed38e8c268c7e32905c2d6b4891bb1a8278f76c1a571 WatchSource:0}: Error finding container 8e6bbe7b0fa4458e0308ed38e8c268c7e32905c2d6b4891bb1a8278f76c1a571: Status 404 returned error can't find the container with id 8e6bbe7b0fa4458e0308ed38e8c268c7e32905c2d6b4891bb1a8278f76c1a571 Jul 15 20:48:20.434847 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:20.434825 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda121d5c1_0427_487e_b874_fb4eda803b38.slice/crio-fec9111badebf4914f9c453548418cfc02b03251bd32f237225cd1a45c60e0d8 WatchSource:0}: Error finding container fec9111badebf4914f9c453548418cfc02b03251bd32f237225cd1a45c60e0d8: Status 404 returned error can't find the container with id fec9111badebf4914f9c453548418cfc02b03251bd32f237225cd1a45c60e0d8 Jul 15 20:48:20.443226 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.443095 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf"] Jul 15 20:48:20.445580 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.445556 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hv47s"] Jul 15 20:48:20.446910 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:20.446852 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4723c782_9fbb_4b87_99c9_13786304bb2d.slice/crio-1a53d21f476e85640fa91a2eccea8b1bfb661e74431b7aefe89b3d2a089a4a76 WatchSource:0}: Error finding container 1a53d21f476e85640fa91a2eccea8b1bfb661e74431b7aefe89b3d2a089a4a76: Status 404 returned error can't find the container with id 1a53d21f476e85640fa91a2eccea8b1bfb661e74431b7aefe89b3d2a089a4a76 Jul 15 20:48:20.448899 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:20.448880 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a293a93_2b99_4009_80d8_d31045b5fbd8.slice/crio-205b51fedf583ac1cf26d1d88d23243d9c3ac94d7bacb8d2fa4e7ea95fc105b5 WatchSource:0}: Error finding container 205b51fedf583ac1cf26d1d88d23243d9c3ac94d7bacb8d2fa4e7ea95fc105b5: Status 404 returned error can't find the container with id 205b51fedf583ac1cf26d1d88d23243d9c3ac94d7bacb8d2fa4e7ea95fc105b5 Jul 15 20:48:20.470466 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.470439 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:20.470635 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.470473 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:20.470635 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.470518 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:20.470635 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.470571 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:20.470635 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.470593 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 20:48:20.470635 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.470613 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97b66b7f8-jlwjw: secret "image-registry-tls" not found Jul 15 20:48:20.470926 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.470667 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls podName:52546b70-c875-44e4-afa2-70bf34e5f7dc nodeName:}" failed. No retries permitted until 2026-07-15 20:48:22.470647386 +0000 UTC m=+39.146136597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls") pod "image-registry-97b66b7f8-jlwjw" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc") : secret "image-registry-tls" not found Jul 15 20:48:20.470926 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.470671 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:20.470926 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.470671 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 20:48:20.470926 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.470671 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 20:48:20.470926 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.470728 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls podName:7d900b98-fa9b-457c-acc8-7c65df59d4e0 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:22.4707105 +0000 UTC m=+39.146199731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4g6v2" (UID: "7d900b98-fa9b-457c-acc8-7c65df59d4e0") : secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:20.470926 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.470831 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls podName:a369c290-e786-4758-bc3b-998a3afbb815 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:22.470819727 +0000 UTC m=+39.146308937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls") pod "cluster-samples-operator-65db858894-8gm8k" (UID: "a369c290-e786-4758-bc3b-998a3afbb815") : secret "samples-operator-tls" not found Jul 15 20:48:20.470926 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.470846 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls podName:259f06c8-f250-4e55-bf98-54ae3ac65636 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:22.470836918 +0000 UTC m=+39.146326131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls") pod "dns-default-s2jgz" (UID: "259f06c8-f250-4e55-bf98-54ae3ac65636") : secret "dns-default-metrics-tls" not found Jul 15 20:48:20.571060 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.571020 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:20.571210 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.571075 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:20.571210 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.571190 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 20:48:20.571301 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.571255 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:22.571239345 +0000 UTC m=+39.246728559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : configmap references non-existent config key: service-ca.crt Jul 15 20:48:20.571301 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.571278 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:22.57127165 +0000 UTC m=+39.246760861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : secret "router-metrics-certs-default" not found Jul 15 20:48:20.974454 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:20.974362 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:20.975014 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.974587 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 20:48:20.975014 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:20.974660 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert podName:b1461f20-8aee-40e4-99cb-5e6e94c61ab4 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:22.974639616 +0000 UTC m=+39.650128841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vjmp5" (UID: "b1461f20-8aee-40e4-99cb-5e6e94c61ab4") : secret "networking-console-plugin-cert" not found Jul 15 20:48:21.177348 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:21.176383 2553 generic.go:356] "Generic (PLEG): container finished" podID="4e1595ed-f475-47cb-9b89-2217bfb3c8c5" containerID="364145ce17b1f3ad77f06f56d81d266fdab4f986eb6db0b33824cf38f45ee2f7" exitCode=0 Jul 15 20:48:21.177348 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:21.176475 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm9gc" event={"ID":"4e1595ed-f475-47cb-9b89-2217bfb3c8c5","Type":"ContainerDied","Data":"364145ce17b1f3ad77f06f56d81d266fdab4f986eb6db0b33824cf38f45ee2f7"} Jul 15 20:48:21.183660 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:21.183562 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mxr4t" event={"ID":"4131898e-b714-49ab-bbe9-18ab20e268a0","Type":"ContainerStarted","Data":"8e6bbe7b0fa4458e0308ed38e8c268c7e32905c2d6b4891bb1a8278f76c1a571"} Jul 15 20:48:21.186376 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:21.186300 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" event={"ID":"e95cdc29-c50b-4470-a2af-7d158d58d1eb","Type":"ContainerStarted","Data":"ea04d573df9a2ead4c8347df33957638b954d4945dff72806a233e3386627f9a"} Jul 15 20:48:21.190365 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:21.190302 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" event={"ID":"b9613d99-d0ed-4e47-b087-713ff9332b1a","Type":"ContainerStarted","Data":"dc600eb32240469eacbfbbca4e310ffd93360eb9afcbb95d6f558814949bbcf0"} Jul 15 20:48:21.192113 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:21.192039 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hv47s" event={"ID":"6a293a93-2b99-4009-80d8-d31045b5fbd8","Type":"ContainerStarted","Data":"205b51fedf583ac1cf26d1d88d23243d9c3ac94d7bacb8d2fa4e7ea95fc105b5"} Jul 15 20:48:21.195405 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:21.195335 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pmltj" event={"ID":"e11bbae4-d50c-46b1-a8bf-8b48ae664c3e","Type":"ContainerStarted","Data":"cd9d976f3836d7695ef88240ad5dfb31765f04baf06243ecb782cfc6a929dc9c"} Jul 15 20:48:21.200696 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:21.200646 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" event={"ID":"4723c782-9fbb-4b87-99c9-13786304bb2d","Type":"ContainerStarted","Data":"1a53d21f476e85640fa91a2eccea8b1bfb661e74431b7aefe89b3d2a089a4a76"} Jul 15 20:48:21.204596 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:21.204530 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qwfct" event={"ID":"a121d5c1-0427-487e-b874-fb4eda803b38","Type":"ContainerStarted","Data":"fec9111badebf4914f9c453548418cfc02b03251bd32f237225cd1a45c60e0d8"} Jul 15 20:48:22.219096 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:22.217387 2553 generic.go:356] "Generic (PLEG): container finished" podID="4e1595ed-f475-47cb-9b89-2217bfb3c8c5" containerID="821ba804346338a8e1454a34bd509e78141c1b4c9e17f4b54ff2889890ab1045" exitCode=0 Jul 15 20:48:22.219096 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:22.217458 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm9gc" event={"ID":"4e1595ed-f475-47cb-9b89-2217bfb3c8c5","Type":"ContainerDied","Data":"821ba804346338a8e1454a34bd509e78141c1b4c9e17f4b54ff2889890ab1045"} Jul 15 20:48:22.489596 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:22.489131 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:22.489596 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.489372 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 20:48:22.489596 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.489437 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls podName:259f06c8-f250-4e55-bf98-54ae3ac65636 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:26.489418671 +0000 UTC m=+43.164907882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls") pod "dns-default-s2jgz" (UID: "259f06c8-f250-4e55-bf98-54ae3ac65636") : secret "dns-default-metrics-tls" not found Jul 15 20:48:22.489596 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:22.489459 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:22.489596 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:22.489498 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:22.489596 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:22.489572 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:22.490221 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.489716 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 20:48:22.490221 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.489756 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls podName:a369c290-e786-4758-bc3b-998a3afbb815 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:26.489744156 +0000 UTC m=+43.165233372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls") pod "cluster-samples-operator-65db858894-8gm8k" (UID: "a369c290-e786-4758-bc3b-998a3afbb815") : secret "samples-operator-tls" not found Jul 15 20:48:22.490221 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.489842 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 20:48:22.490221 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.489859 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97b66b7f8-jlwjw: secret "image-registry-tls" not found Jul 15 20:48:22.490221 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.489883 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:22.490221 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.489894 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls podName:52546b70-c875-44e4-afa2-70bf34e5f7dc nodeName:}" failed. No retries permitted until 2026-07-15 20:48:26.489882784 +0000 UTC m=+43.165371999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls") pod "image-registry-97b66b7f8-jlwjw" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc") : secret "image-registry-tls" not found Jul 15 20:48:22.490221 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.489921 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls podName:7d900b98-fa9b-457c-acc8-7c65df59d4e0 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:26.489909881 +0000 UTC m=+43.165399100 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4g6v2" (UID: "7d900b98-fa9b-457c-acc8-7c65df59d4e0") : secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:22.590686 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:22.590645 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:22.590906 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:22.590871 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:22.591044 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.591027 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 20:48:22.591102 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.591094 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:26.591074885 +0000 UTC m=+43.266564102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : secret "router-metrics-certs-default" not found Jul 15 20:48:22.591592 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.591571 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:26.591551966 +0000 UTC m=+43.267041194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : configmap references non-existent config key: service-ca.crt Jul 15 20:48:22.996297 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:22.996245 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:22.996619 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.996398 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 20:48:22.996706 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:22.996686 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert podName:b1461f20-8aee-40e4-99cb-5e6e94c61ab4 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:26.996660858 +0000 UTC m=+43.672150080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vjmp5" (UID: "b1461f20-8aee-40e4-99cb-5e6e94c61ab4") : secret "networking-console-plugin-cert" not found Jul 15 20:48:23.225577 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:23.225497 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gm9gc" event={"ID":"4e1595ed-f475-47cb-9b89-2217bfb3c8c5","Type":"ContainerStarted","Data":"753f25fa347ffdd208c48ee49d884b4bca2ca1ad1d8cad8e67548b44084ff687"} Jul 15 20:48:23.255606 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:23.255523 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gm9gc" podStartSLOduration=10.036963068 podStartE2EDuration="39.255503789s" totalImagesPullingTime="29.218540721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:23.254681775 +0000 UTC m=+39.930171009" watchObservedRunningTime="2026-07-15 20:48:23.255503789 +0000 UTC m=+39.930993023" Jul 15 20:48:26.529396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:26.529355 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:26.530129 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.529740 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 20:48:26.530129 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:26.529852 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:26.530129 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.529871 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls podName:259f06c8-f250-4e55-bf98-54ae3ac65636 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:34.529843916 +0000 UTC m=+51.205333144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls") pod "dns-default-s2jgz" (UID: "259f06c8-f250-4e55-bf98-54ae3ac65636") : secret "dns-default-metrics-tls" not found Jul 15 20:48:26.530129 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:26.529923 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:26.530129 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:26.530027 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:26.530446 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.530204 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 20:48:26.530446 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.530273 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls podName:a369c290-e786-4758-bc3b-998a3afbb815 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:34.530246185 +0000 UTC m=+51.205735401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls") pod "cluster-samples-operator-65db858894-8gm8k" (UID: "a369c290-e786-4758-bc3b-998a3afbb815") : secret "samples-operator-tls" not found Jul 15 20:48:26.530580 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.530554 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 20:48:26.530617 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.530586 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97b66b7f8-jlwjw: secret "image-registry-tls" not found Jul 15 20:48:26.530665 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.530653 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls podName:52546b70-c875-44e4-afa2-70bf34e5f7dc nodeName:}" failed. No retries permitted until 2026-07-15 20:48:34.530635649 +0000 UTC m=+51.206124861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls") pod "image-registry-97b66b7f8-jlwjw" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc") : secret "image-registry-tls" not found Jul 15 20:48:26.531362 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.531333 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:26.531479 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.531467 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls podName:7d900b98-fa9b-457c-acc8-7c65df59d4e0 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:34.53145012 +0000 UTC m=+51.206939344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4g6v2" (UID: "7d900b98-fa9b-457c-acc8-7c65df59d4e0") : secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:26.630844 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:26.630809 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:26.631028 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:26.630856 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:26.631028 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.630959 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 20:48:26.631028 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.630964 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:34.630949513 +0000 UTC m=+51.306438724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : configmap references non-existent config key: service-ca.crt Jul 15 20:48:26.631159 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:26.631082 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:34.631069061 +0000 UTC m=+51.306558273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : secret "router-metrics-certs-default" not found Jul 15 20:48:27.034476 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:27.034430 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:27.034677 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:27.034614 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 20:48:27.034730 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:27.034696 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert podName:b1461f20-8aee-40e4-99cb-5e6e94c61ab4 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:35.034674097 +0000 UTC m=+51.710163312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vjmp5" (UID: "b1461f20-8aee-40e4-99cb-5e6e94c61ab4") : secret "networking-console-plugin-cert" not found Jul 15 20:48:29.243404 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.243352 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" event={"ID":"4723c782-9fbb-4b87-99c9-13786304bb2d","Type":"ContainerStarted","Data":"76446fa830634abc261bf2d8268151a6d016e1a2e0f2950adf872b5583aebaf8"} Jul 15 20:48:29.245105 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.245076 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qwfct" event={"ID":"a121d5c1-0427-487e-b874-fb4eda803b38","Type":"ContainerStarted","Data":"694c4fac1314efa13f618a6cae1f8c66f67d827e71f54395c5c5fa9b2999f64c"} Jul 15 20:48:29.247293 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.247266 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/0.log" Jul 15 20:48:29.247401 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.247310 2553 generic.go:356] "Generic (PLEG): container finished" podID="4131898e-b714-49ab-bbe9-18ab20e268a0" containerID="7feff4294bc7bec5e35dfb19b4efd8956205b9405de4831ab9d5cae4606a2236" exitCode=255 Jul 15 20:48:29.247542 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.247487 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mxr4t" event={"ID":"4131898e-b714-49ab-bbe9-18ab20e268a0","Type":"ContainerDied","Data":"7feff4294bc7bec5e35dfb19b4efd8956205b9405de4831ab9d5cae4606a2236"} Jul 15 20:48:29.247722 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.247691 2553 scope.go:117] "RemoveContainer" containerID="7feff4294bc7bec5e35dfb19b4efd8956205b9405de4831ab9d5cae4606a2236" Jul 15 20:48:29.249501 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.249210 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" event={"ID":"e95cdc29-c50b-4470-a2af-7d158d58d1eb","Type":"ContainerStarted","Data":"d105820e1113a60ea7ba6c6bcce91957227bb66205f9073aa2fb1c89d3237ae3"} Jul 15 20:48:29.250822 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.250797 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" event={"ID":"b9613d99-d0ed-4e47-b087-713ff9332b1a","Type":"ContainerStarted","Data":"7d3afa7f0ade08824331f2d7ec281de4208e6af7cb5cb01fa096826ea36b3010"} Jul 15 20:48:29.252397 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.252378 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hv47s" event={"ID":"6a293a93-2b99-4009-80d8-d31045b5fbd8","Type":"ContainerStarted","Data":"68b66613bc8b5de09c0f57e20adcde2468af36d378eed34ff92641b6a6afca7b"} Jul 15 20:48:29.253931 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.253910 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pmltj" event={"ID":"e11bbae4-d50c-46b1-a8bf-8b48ae664c3e","Type":"ContainerStarted","Data":"857f14f919f2f673c02ccdf691843f9cee018ebc98e0b8c7c0e7116b3492d019"} Jul 15 20:48:29.279333 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.279281 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" podStartSLOduration=24.287848899 podStartE2EDuration="32.279263678s" totalImagesPullingTime="7.991414779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:29.278841473 +0000 UTC m=+45.954330704" watchObservedRunningTime="2026-07-15 20:48:29.279263678 +0000 UTC m=+45.954752914" Jul 15 20:48:29.279509 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.279475 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" podStartSLOduration=24.31910309 podStartE2EDuration="32.27946842s" totalImagesPullingTime="7.96036533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:29.262732861 +0000 UTC m=+45.938222089" watchObservedRunningTime="2026-07-15 20:48:29.27946842 +0000 UTC m=+45.954957654" Jul 15 20:48:29.316317 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.315913 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-pmltj" podStartSLOduration=24.342013545 podStartE2EDuration="32.315894775s" totalImagesPullingTime="7.97388123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:29.31584093 +0000 UTC m=+45.991330167" watchObservedRunningTime="2026-07-15 20:48:29.315894775 +0000 UTC m=+45.991384017" Jul 15 20:48:29.344254 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.338614 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" podStartSLOduration=24.352962423 podStartE2EDuration="32.338593804s" totalImagesPullingTime="7.985631381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:29.337565315 +0000 UTC m=+46.013054551" watchObservedRunningTime="2026-07-15 20:48:29.338593804 +0000 UTC m=+46.014083038" Jul 15 20:48:29.374597 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.374210 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qwfct" podStartSLOduration=24.38951599 podStartE2EDuration="32.374189555s" totalImagesPullingTime="7.984673565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:29.373751672 +0000 UTC m=+46.049240906" watchObservedRunningTime="2026-07-15 20:48:29.374189555 +0000 UTC m=+46.049678789" Jul 15 20:48:29.407349 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.407294 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hv47s" podStartSLOduration=3.449033543 podStartE2EDuration="11.407270892s" totalImagesPullingTime="7.958237349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:29.405887703 +0000 UTC m=+46.081376947" watchObservedRunningTime="2026-07-15 20:48:29.407270892 +0000 UTC m=+46.082760126" Jul 15 20:48:29.852218 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.852180 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5brxm"] Jul 15 20:48:29.873529 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.873496 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5brxm"] Jul 15 20:48:29.873667 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.873616 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:29.876261 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.876229 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 20:48:29.876447 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.876234 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wc9r4\"" Jul 15 20:48:29.876588 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.876565 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 20:48:29.961060 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.961024 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-data-volume\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:29.961223 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.961068 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-crio-socket\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:29.961223 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.961093 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:29.961223 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.961189 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:29.961317 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:29.961239 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxrdj\" (UniqueName: \"kubernetes.io/projected/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-api-access-fxrdj\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:30.061853 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.061816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-data-volume\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:30.061853 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.061857 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-crio-socket\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:30.062096 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.061873 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:30.062096 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.061896 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:30.062096 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.061917 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxrdj\" (UniqueName: \"kubernetes.io/projected/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-api-access-fxrdj\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:30.062096 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.061971 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-crio-socket\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:30.062096 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:30.061983 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 20:48:30.062096 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:30.062028 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 20:48:30.062096 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:30.062052 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm podName:224bab0f-56d3-42ca-b7c3-7db7b016e4f9 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:30.562035754 +0000 UTC m=+47.237524968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5brxm" (UID: "224bab0f-56d3-42ca-b7c3-7db7b016e4f9") : configmap "kube-rbac-proxy" not found Jul 15 20:48:30.062096 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:30.062086 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls podName:224bab0f-56d3-42ca-b7c3-7db7b016e4f9 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:30.562068591 +0000 UTC m=+47.237557836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5brxm" (UID: "224bab0f-56d3-42ca-b7c3-7db7b016e4f9") : secret "insights-runtime-extractor-tls" not found Jul 15 20:48:30.062421 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.062221 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-data-volume\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:30.073474 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.073449 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxrdj\" (UniqueName: \"kubernetes.io/projected/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-api-access-fxrdj\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:30.260359 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.260278 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 20:48:30.260838 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.260695 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/0.log" Jul 15 20:48:30.260838 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.260731 2553 generic.go:356] "Generic (PLEG): container finished" podID="4131898e-b714-49ab-bbe9-18ab20e268a0" containerID="8eab02d11af43e78235d78b67a24a0e33918c2241168091d1006810a02bdfe9d" exitCode=255 Jul 15 20:48:30.260934 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.260844 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mxr4t" event={"ID":"4131898e-b714-49ab-bbe9-18ab20e268a0","Type":"ContainerDied","Data":"8eab02d11af43e78235d78b67a24a0e33918c2241168091d1006810a02bdfe9d"} Jul 15 20:48:30.260934 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.260905 2553 scope.go:117] "RemoveContainer" containerID="7feff4294bc7bec5e35dfb19b4efd8956205b9405de4831ab9d5cae4606a2236" Jul 15 20:48:30.261290 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.261265 2553 scope.go:117] "RemoveContainer" containerID="8eab02d11af43e78235d78b67a24a0e33918c2241168091d1006810a02bdfe9d" Jul 15 20:48:30.261446 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:30.261416 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mxr4t_openshift-console-operator(4131898e-b714-49ab-bbe9-18ab20e268a0)\"" pod="openshift-console-operator/console-operator-7866497494-mxr4t" podUID="4131898e-b714-49ab-bbe9-18ab20e268a0" Jul 15 20:48:30.567917 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.567834 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:30.567917 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:30.567883 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:30.568092 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:30.567956 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 20:48:30.568092 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:30.567981 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 20:48:30.568092 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:30.568030 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls podName:224bab0f-56d3-42ca-b7c3-7db7b016e4f9 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:31.568013348 +0000 UTC m=+48.243502563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5brxm" (UID: "224bab0f-56d3-42ca-b7c3-7db7b016e4f9") : secret "insights-runtime-extractor-tls" not found Jul 15 20:48:30.568092 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:30.568054 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm podName:224bab0f-56d3-42ca-b7c3-7db7b016e4f9 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:31.568047091 +0000 UTC m=+48.243536303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5brxm" (UID: "224bab0f-56d3-42ca-b7c3-7db7b016e4f9") : configmap "kube-rbac-proxy" not found Jul 15 20:48:31.265835 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:31.265806 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 20:48:31.266217 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:31.266123 2553 scope.go:117] "RemoveContainer" containerID="8eab02d11af43e78235d78b67a24a0e33918c2241168091d1006810a02bdfe9d" Jul 15 20:48:31.266342 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:31.266322 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mxr4t_openshift-console-operator(4131898e-b714-49ab-bbe9-18ab20e268a0)\"" pod="openshift-console-operator/console-operator-7866497494-mxr4t" podUID="4131898e-b714-49ab-bbe9-18ab20e268a0" Jul 15 20:48:31.578228 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:31.578193 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:31.578393 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:31.578241 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:31.578393 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:31.578336 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 20:48:31.578393 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:31.578335 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 20:48:31.578393 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:31.578393 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls podName:224bab0f-56d3-42ca-b7c3-7db7b016e4f9 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:33.578381434 +0000 UTC m=+50.253870645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5brxm" (UID: "224bab0f-56d3-42ca-b7c3-7db7b016e4f9") : secret "insights-runtime-extractor-tls" not found Jul 15 20:48:31.578526 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:31.578407 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm podName:224bab0f-56d3-42ca-b7c3-7db7b016e4f9 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:33.578400431 +0000 UTC m=+50.253889642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5brxm" (UID: "224bab0f-56d3-42ca-b7c3-7db7b016e4f9") : configmap "kube-rbac-proxy" not found Jul 15 20:48:31.645759 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:31.645732 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8gqgn_c238bf35-7bb4-4231-b8dc-e8f0f794425e/dns-node-resolver/0.log" Jul 15 20:48:32.842636 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:32.842605 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k4wxn_bc50d127-1a8d-4a89-8a69-5eb54bef09f4/node-ca/0.log" Jul 15 20:48:33.442083 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:33.442046 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hv47s_6a293a93-2b99-4009-80d8-d31045b5fbd8/serve-healthcheck-canary/0.log" Jul 15 20:48:33.595594 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:33.595558 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:33.595811 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:33.595608 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:33.595811 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:33.595676 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 20:48:33.595811 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:33.595758 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm podName:224bab0f-56d3-42ca-b7c3-7db7b016e4f9 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:37.595742046 +0000 UTC m=+54.271231262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5brxm" (UID: "224bab0f-56d3-42ca-b7c3-7db7b016e4f9") : configmap "kube-rbac-proxy" not found Jul 15 20:48:33.595811 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:33.595792 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 20:48:33.595964 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:33.595857 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls podName:224bab0f-56d3-42ca-b7c3-7db7b016e4f9 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:37.59584401 +0000 UTC m=+54.271333223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5brxm" (UID: "224bab0f-56d3-42ca-b7c3-7db7b016e4f9") : secret "insights-runtime-extractor-tls" not found Jul 15 20:48:34.604330 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:34.604288 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:34.604360 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:34.604388 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.604447 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:34.604464 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.604508 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls podName:259f06c8-f250-4e55-bf98-54ae3ac65636 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:50.604493879 +0000 UTC m=+67.279983091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls") pod "dns-default-s2jgz" (UID: "259f06c8-f250-4e55-bf98-54ae3ac65636") : secret "dns-default-metrics-tls" not found Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.604512 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.604531 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97b66b7f8-jlwjw: secret "image-registry-tls" not found Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.604559 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.604574 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.604579 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls podName:52546b70-c875-44e4-afa2-70bf34e5f7dc nodeName:}" failed. No retries permitted until 2026-07-15 20:48:50.604562408 +0000 UTC m=+67.280051618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls") pod "image-registry-97b66b7f8-jlwjw" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc") : secret "image-registry-tls" not found Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.604627 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls podName:a369c290-e786-4758-bc3b-998a3afbb815 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:50.604613162 +0000 UTC m=+67.280102374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls") pod "cluster-samples-operator-65db858894-8gm8k" (UID: "a369c290-e786-4758-bc3b-998a3afbb815") : secret "samples-operator-tls" not found Jul 15 20:48:34.604763 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.604642 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls podName:7d900b98-fa9b-457c-acc8-7c65df59d4e0 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:50.604634196 +0000 UTC m=+67.280123411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4g6v2" (UID: "7d900b98-fa9b-457c-acc8-7c65df59d4e0") : secret "cluster-monitoring-operator-tls" not found Jul 15 20:48:34.705280 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:34.705246 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:34.705443 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:34.705302 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:34.705443 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.705415 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 20:48:34.705521 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.705485 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:50.705461638 +0000 UTC m=+67.380950848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : configmap references non-existent config key: service-ca.crt Jul 15 20:48:34.705521 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:34.705508 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs podName:27a97da1-f66f-45c9-aaa9-a16df8672253 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:50.705499731 +0000 UTC m=+67.380988941 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs") pod "router-default-6cb6f979db-vqk9s" (UID: "27a97da1-f66f-45c9-aaa9-a16df8672253") : secret "router-metrics-certs-default" not found Jul 15 20:48:35.109361 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:35.109324 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:35.109543 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:35.109440 2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 20:48:35.109543 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:35.109502 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert podName:b1461f20-8aee-40e4-99cb-5e6e94c61ab4 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:51.109488705 +0000 UTC m=+67.784977916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-vjmp5" (UID: "b1461f20-8aee-40e4-99cb-5e6e94c61ab4") : secret "networking-console-plugin-cert" not found Jul 15 20:48:37.631581 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:37.631532 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:37.632139 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:37.631594 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:37.632139 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:37.631760 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 20:48:37.632139 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:37.631844 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls podName:224bab0f-56d3-42ca-b7c3-7db7b016e4f9 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:45.631827719 +0000 UTC m=+62.307316930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5brxm" (UID: "224bab0f-56d3-42ca-b7c3-7db7b016e4f9") : secret "insights-runtime-extractor-tls" not found Jul 15 20:48:37.632260 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:37.632152 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:39.112617 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:39.112582 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:39.113074 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:39.112638 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:48:39.113074 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:39.112973 2553 scope.go:117] "RemoveContainer" containerID="8eab02d11af43e78235d78b67a24a0e33918c2241168091d1006810a02bdfe9d" Jul 15 20:48:39.113154 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:48:39.113113 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mxr4t_openshift-console-operator(4131898e-b714-49ab-bbe9-18ab20e268a0)\"" pod="openshift-console-operator/console-operator-7866497494-mxr4t" podUID="4131898e-b714-49ab-bbe9-18ab20e268a0" Jul 15 20:48:45.163972 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:45.163944 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zxk2g" Jul 15 20:48:45.703353 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:45.703311 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:45.705506 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:45.705469 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/224bab0f-56d3-42ca-b7c3-7db7b016e4f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5brxm\" (UID: \"224bab0f-56d3-42ca-b7c3-7db7b016e4f9\") " pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:45.787399 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:45.787371 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wc9r4\"" Jul 15 20:48:45.795094 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:45.795076 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5brxm" Jul 15 20:48:45.930119 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:45.930092 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5brxm"] Jul 15 20:48:45.934559 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:45.934527 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224bab0f_56d3_42ca_b7c3_7db7b016e4f9.slice/crio-fbd873a2e5c8452964684d156c324c99331180c5ebeb7d42dc4db467dd0b562d WatchSource:0}: Error finding container fbd873a2e5c8452964684d156c324c99331180c5ebeb7d42dc4db467dd0b562d: Status 404 returned error can't find the container with id fbd873a2e5c8452964684d156c324c99331180c5ebeb7d42dc4db467dd0b562d Jul 15 20:48:46.310595 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:46.310562 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5brxm" event={"ID":"224bab0f-56d3-42ca-b7c3-7db7b016e4f9","Type":"ContainerStarted","Data":"fbd873a2e5c8452964684d156c324c99331180c5ebeb7d42dc4db467dd0b562d"} Jul 15 20:48:49.439552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.439511 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:49.440082 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.439566 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2xxw\" (UniqueName: \"kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw\") pod \"network-check-target-rswbn\" (UID: \"b8a0f4c5-66fc-41fe-9e40-be137c051c68\") " pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:49.442261 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.442225 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 20:48:49.442404 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.442345 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2xxw\" (UniqueName: \"kubernetes.io/projected/b8a0f4c5-66fc-41fe-9e40-be137c051c68-kube-api-access-q2xxw\") pod \"network-check-target-rswbn\" (UID: \"b8a0f4c5-66fc-41fe-9e40-be137c051c68\") " pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:49.452587 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.452567 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ebbda4f-407d-4093-9a52-90a25e0345cb-original-pull-secret\") pod \"global-pull-secret-syncer-wc5wg\" (UID: \"4ebbda4f-407d-4093-9a52-90a25e0345cb\") " pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:49.494889 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.494864 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5sgcj\"" Jul 15 20:48:49.500206 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.500183 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wc5wg" Jul 15 20:48:49.503339 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.503316 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:49.540005 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.539977 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:49.542781 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.542739 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 20:48:49.553248 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.553226 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49822cd3-a729-4a17-9b34-e61eb6d6257a-metrics-certs\") pod \"network-metrics-daemon-7gxbt\" (UID: \"49822cd3-a729-4a17-9b34-e61eb6d6257a\") " pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:49.788558 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.788485 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lxhhk\"" Jul 15 20:48:49.795981 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:49.795956 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7gxbt" Jul 15 20:48:50.651573 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.651536 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:50.652126 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.651641 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:50.652126 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.651704 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:50.652126 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.651741 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:50.654527 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.654503 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/259f06c8-f250-4e55-bf98-54ae3ac65636-metrics-tls\") pod \"dns-default-s2jgz\" (UID: \"259f06c8-f250-4e55-bf98-54ae3ac65636\") " pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:50.654653 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.654618 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d900b98-fa9b-457c-acc8-7c65df59d4e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4g6v2\" (UID: \"7d900b98-fa9b-457c-acc8-7c65df59d4e0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:50.654653 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.654639 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls\") pod \"image-registry-97b66b7f8-jlwjw\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:50.654791 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.654667 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a369c290-e786-4758-bc3b-998a3afbb815-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gm8k\" (UID: \"a369c290-e786-4758-bc3b-998a3afbb815\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:50.752933 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.752904 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:50.753082 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.752985 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:50.753728 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.753702 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a97da1-f66f-45c9-aaa9-a16df8672253-service-ca-bundle\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:50.755342 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.755291 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27a97da1-f66f-45c9-aaa9-a16df8672253-metrics-certs\") pod \"router-default-6cb6f979db-vqk9s\" (UID: \"27a97da1-f66f-45c9-aaa9-a16df8672253\") " pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:50.850119 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.850064 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n7hwd\"" Jul 15 20:48:50.858656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.858378 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:50.887597 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.887528 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rswbn"] Jul 15 20:48:50.888477 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.888144 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4ncw6\"" Jul 15 20:48:50.891051 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:50.891028 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a0f4c5_66fc_41fe_9e40_be137c051c68.slice/crio-79bb4a769194d42fe1c19d53bfdb4675c58a6277f68d3ac1d78a7c953abbc3fd WatchSource:0}: Error finding container 79bb4a769194d42fe1c19d53bfdb4675c58a6277f68d3ac1d78a7c953abbc3fd: Status 404 returned error can't find the container with id 79bb4a769194d42fe1c19d53bfdb4675c58a6277f68d3ac1d78a7c953abbc3fd Jul 15 20:48:50.896797 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.896595 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" Jul 15 20:48:50.898570 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.898554 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dhvh9\"" Jul 15 20:48:50.905824 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.905754 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kll9v\"" Jul 15 20:48:50.906867 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.906838 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" Jul 15 20:48:50.914686 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.914652 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s2jgz" Jul 15 20:48:50.935669 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.934034 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cvgsd\"" Jul 15 20:48:50.944784 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:50.942440 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:51.078198 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.078173 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-97b66b7f8-jlwjw"] Jul 15 20:48:51.119892 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.119866 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k"] Jul 15 20:48:51.122784 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.122741 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7gxbt"] Jul 15 20:48:51.123902 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.123881 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wc5wg"] Jul 15 20:48:51.140062 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:51.140029 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49822cd3_a729_4a17_9b34_e61eb6d6257a.slice/crio-4cd676ecb6895040fadc7ed8238341d6118a87067710eb3c20d6aa7ceb135238 WatchSource:0}: Error finding container 4cd676ecb6895040fadc7ed8238341d6118a87067710eb3c20d6aa7ceb135238: Status 404 returned error can't find the container with id 4cd676ecb6895040fadc7ed8238341d6118a87067710eb3c20d6aa7ceb135238 Jul 15 20:48:51.140355 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:51.140332 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ebbda4f_407d_4093_9a52_90a25e0345cb.slice/crio-733dde2d7d039a48899f3b35242736c40e380d0911d399d8d275ea6baf7b5040 WatchSource:0}: Error finding container 733dde2d7d039a48899f3b35242736c40e380d0911d399d8d275ea6baf7b5040: Status 404 returned error can't find the container with id 733dde2d7d039a48899f3b35242736c40e380d0911d399d8d275ea6baf7b5040 Jul 15 20:48:51.158066 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.158004 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:51.160303 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.160282 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1461f20-8aee-40e4-99cb-5e6e94c61ab4-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-vjmp5\" (UID: \"b1461f20-8aee-40e4-99cb-5e6e94c61ab4\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:51.295834 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.295808 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bhg56\"" Jul 15 20:48:51.303912 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.303878 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" Jul 15 20:48:51.330383 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.330344 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wc5wg" event={"ID":"4ebbda4f-407d-4093-9a52-90a25e0345cb","Type":"ContainerStarted","Data":"733dde2d7d039a48899f3b35242736c40e380d0911d399d8d275ea6baf7b5040"} Jul 15 20:48:51.331900 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.331863 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gxbt" event={"ID":"49822cd3-a729-4a17-9b34-e61eb6d6257a","Type":"ContainerStarted","Data":"4cd676ecb6895040fadc7ed8238341d6118a87067710eb3c20d6aa7ceb135238"} Jul 15 20:48:51.334257 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.334169 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rswbn" event={"ID":"b8a0f4c5-66fc-41fe-9e40-be137c051c68","Type":"ContainerStarted","Data":"6e42159609fd1b09cac04b345da91886f43512bc6c1624a4842a8dd29303559b"} Jul 15 20:48:51.334257 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.334219 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rswbn" event={"ID":"b8a0f4c5-66fc-41fe-9e40-be137c051c68","Type":"ContainerStarted","Data":"79bb4a769194d42fe1c19d53bfdb4675c58a6277f68d3ac1d78a7c953abbc3fd"} Jul 15 20:48:51.334517 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.334475 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:48:51.336967 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.336942 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5brxm" event={"ID":"224bab0f-56d3-42ca-b7c3-7db7b016e4f9","Type":"ContainerStarted","Data":"0604bfb23338b8b2ffac76b1653862c86e832f0c050a521369e4d0eaa87b7fcc"} Jul 15 20:48:51.338289 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.338267 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" event={"ID":"a369c290-e786-4758-bc3b-998a3afbb815","Type":"ContainerStarted","Data":"934cea16034d2ae1f3c89a56486b1b59aa8050caa04a80907ba89f4301f8bb58"} Jul 15 20:48:51.339958 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.339936 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" event={"ID":"52546b70-c875-44e4-afa2-70bf34e5f7dc","Type":"ContainerStarted","Data":"b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a"} Jul 15 20:48:51.340071 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.339972 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" event={"ID":"52546b70-c875-44e4-afa2-70bf34e5f7dc","Type":"ContainerStarted","Data":"fa222a763a7fcdd0125cc49b2094ac7d8d966de0dcdc9e4225b5941a81c125d1"} Jul 15 20:48:51.340135 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.340078 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:48:51.350663 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.350636 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2"] Jul 15 20:48:51.353295 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.353269 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s2jgz"] Jul 15 20:48:51.354081 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:51.354054 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d900b98_fa9b_457c_acc8_7c65df59d4e0.slice/crio-a1e56a7347486d5e903f8049d34a3e1666e499dcbcfdae6529d89204800448a1 WatchSource:0}: Error finding container a1e56a7347486d5e903f8049d34a3e1666e499dcbcfdae6529d89204800448a1: Status 404 returned error can't find the container with id a1e56a7347486d5e903f8049d34a3e1666e499dcbcfdae6529d89204800448a1 Jul 15 20:48:51.354170 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.354121 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rswbn" podStartSLOduration=67.354100589 podStartE2EDuration="1m7.354100589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:51.351666055 +0000 UTC m=+68.027155289" watchObservedRunningTime="2026-07-15 20:48:51.354100589 +0000 UTC m=+68.029589826" Jul 15 20:48:51.356737 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.356700 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6cb6f979db-vqk9s"] Jul 15 20:48:51.357589 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:51.357319 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259f06c8_f250_4e55_bf98_54ae3ac65636.slice/crio-ce7a462dd429355d061e7389d37f22dfc388957bd111c7055d61f9aaa1bfec1e WatchSource:0}: Error finding container ce7a462dd429355d061e7389d37f22dfc388957bd111c7055d61f9aaa1bfec1e: Status 404 returned error can't find the container with id ce7a462dd429355d061e7389d37f22dfc388957bd111c7055d61f9aaa1bfec1e Jul 15 20:48:51.361916 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:51.361863 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a97da1_f66f_45c9_aaa9_a16df8672253.slice/crio-58821c89971fd97e5d3f4a9bfed12262a33176beba919df0ada41643a831784e WatchSource:0}: Error finding container 58821c89971fd97e5d3f4a9bfed12262a33176beba919df0ada41643a831784e: Status 404 returned error can't find the container with id 58821c89971fd97e5d3f4a9bfed12262a33176beba919df0ada41643a831784e Jul 15 20:48:51.375267 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.375215 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" podStartSLOduration=66.375193676 podStartE2EDuration="1m6.375193676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:51.373656629 +0000 UTC m=+68.049145861" watchObservedRunningTime="2026-07-15 20:48:51.375193676 +0000 UTC m=+68.050682909" Jul 15 20:48:51.447535 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:51.447503 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-vjmp5"] Jul 15 20:48:51.451396 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:48:51.451352 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1461f20_8aee_40e4_99cb_5e6e94c61ab4.slice/crio-0c6ecf30ab979ed403135dbacd8169797beb272cbfac4921b6a3cb345873f78c WatchSource:0}: Error finding container 0c6ecf30ab979ed403135dbacd8169797beb272cbfac4921b6a3cb345873f78c: Status 404 returned error can't find the container with id 0c6ecf30ab979ed403135dbacd8169797beb272cbfac4921b6a3cb345873f78c Jul 15 20:48:52.346541 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:52.346504 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2jgz" event={"ID":"259f06c8-f250-4e55-bf98-54ae3ac65636","Type":"ContainerStarted","Data":"ce7a462dd429355d061e7389d37f22dfc388957bd111c7055d61f9aaa1bfec1e"} Jul 15 20:48:52.348694 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:52.348618 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" event={"ID":"b1461f20-8aee-40e4-99cb-5e6e94c61ab4","Type":"ContainerStarted","Data":"0c6ecf30ab979ed403135dbacd8169797beb272cbfac4921b6a3cb345873f78c"} Jul 15 20:48:52.351138 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:52.351111 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6cb6f979db-vqk9s" event={"ID":"27a97da1-f66f-45c9-aaa9-a16df8672253","Type":"ContainerStarted","Data":"8a422684b60bbb04234f6c05ad1c52987200c8e96837ea05b66f8b2f6b765d46"} Jul 15 20:48:52.351247 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:52.351160 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6cb6f979db-vqk9s" event={"ID":"27a97da1-f66f-45c9-aaa9-a16df8672253","Type":"ContainerStarted","Data":"58821c89971fd97e5d3f4a9bfed12262a33176beba919df0ada41643a831784e"} Jul 15 20:48:52.355648 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:52.355184 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" event={"ID":"7d900b98-fa9b-457c-acc8-7c65df59d4e0","Type":"ContainerStarted","Data":"a1e56a7347486d5e903f8049d34a3e1666e499dcbcfdae6529d89204800448a1"} Jul 15 20:48:52.375088 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:52.374176 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6cb6f979db-vqk9s" podStartSLOduration=55.374157518 podStartE2EDuration="55.374157518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:52.372764863 +0000 UTC m=+69.048254100" watchObservedRunningTime="2026-07-15 20:48:52.374157518 +0000 UTC m=+69.049646752" Jul 15 20:48:52.875635 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:52.875253 2553 scope.go:117] "RemoveContainer" containerID="8eab02d11af43e78235d78b67a24a0e33918c2241168091d1006810a02bdfe9d" Jul 15 20:48:52.943291 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:52.942982 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:52.946556 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:52.946363 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:53.360443 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:53.360362 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:48:53.362306 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:48:53.362104 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6cb6f979db-vqk9s" Jul 15 20:49:01.040031 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.039953 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9"] Jul 15 20:49:01.043023 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.043007 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9" Jul 15 20:49:01.045328 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.045304 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-z7tbq\"" Jul 15 20:49:01.045447 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.045353 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 15 20:49:01.055301 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.055278 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9"] Jul 15 20:49:01.141110 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.141072 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/35399360-2c40-4cc5-92fd-fef7993b03d8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-gb9d9\" (UID: \"35399360-2c40-4cc5-92fd-fef7993b03d8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9" Jul 15 20:49:01.242106 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.242067 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/35399360-2c40-4cc5-92fd-fef7993b03d8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-gb9d9\" (UID: \"35399360-2c40-4cc5-92fd-fef7993b03d8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9" Jul 15 20:49:01.244447 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.244424 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/35399360-2c40-4cc5-92fd-fef7993b03d8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-gb9d9\" (UID: \"35399360-2c40-4cc5-92fd-fef7993b03d8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9" Jul 15 20:49:01.352268 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.352222 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9" Jul 15 20:49:01.394598 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.394555 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2jgz" event={"ID":"259f06c8-f250-4e55-bf98-54ae3ac65636","Type":"ContainerStarted","Data":"77ba14d0471cc323a78a3172b63296e5148b876f84e09c7beee939a63362f4a1"} Jul 15 20:49:01.394795 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.394620 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s2jgz" event={"ID":"259f06c8-f250-4e55-bf98-54ae3ac65636","Type":"ContainerStarted","Data":"8d967c5f65dc1e954c2021bc1e157fd949325044263beb57be4cd83559d1a7a5"} Jul 15 20:49:01.394915 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.394897 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s2jgz" Jul 15 20:49:01.396891 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.396867 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 20:49:01.397008 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.396987 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mxr4t" event={"ID":"4131898e-b714-49ab-bbe9-18ab20e268a0","Type":"ContainerStarted","Data":"7269aa0546a70c05972e2e566daf194c303b1caa87c61197ea76cbf3f6a49424"} Jul 15 20:49:01.397280 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.397235 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:49:01.400641 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.400618 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5brxm" event={"ID":"224bab0f-56d3-42ca-b7c3-7db7b016e4f9","Type":"ContainerStarted","Data":"efa2d4e63fcfbfb26f0baab88dd587e360704af31b05acbc6b71e87850cded2a"} Jul 15 20:49:01.403148 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.403123 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" event={"ID":"a369c290-e786-4758-bc3b-998a3afbb815","Type":"ContainerStarted","Data":"72c486b4d5cc4be18501f8ad0f7547c5cba949d4348b52d82fe7b201dd839e81"} Jul 15 20:49:01.403277 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.403173 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" event={"ID":"a369c290-e786-4758-bc3b-998a3afbb815","Type":"ContainerStarted","Data":"d5179c68f88d08d66eea04862303cabdeccbbbe6115f6b893c6ec546b7fb8190"} Jul 15 20:49:01.405041 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.405015 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wc5wg" event={"ID":"4ebbda4f-407d-4093-9a52-90a25e0345cb","Type":"ContainerStarted","Data":"81d8ce89d062b563fc2922ff2b297331a607181111ca3d54e94b95f2c8635db2"} Jul 15 20:49:01.406900 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.406878 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" event={"ID":"b1461f20-8aee-40e4-99cb-5e6e94c61ab4","Type":"ContainerStarted","Data":"2362c85a5a2a7d67bbf21feb96a13480898ef5db3ff2e5b01821c20299865c91"} Jul 15 20:49:01.412908 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.412759 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" event={"ID":"7d900b98-fa9b-457c-acc8-7c65df59d4e0","Type":"ContainerStarted","Data":"f2da357f421ee0e6af68ed889d8e2b65d222579b3ca0d14a1995bf5620cbe8d7"} Jul 15 20:49:01.416903 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.416534 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s2jgz" podStartSLOduration=34.455690367 podStartE2EDuration="43.416520383s" totalImagesPullingTime="8.960830016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:01.414824663 +0000 UTC m=+78.090313897" watchObservedRunningTime="2026-07-15 20:49:01.416520383 +0000 UTC m=+78.092009616" Jul 15 20:49:01.419667 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.419644 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gxbt" event={"ID":"49822cd3-a729-4a17-9b34-e61eb6d6257a","Type":"ContainerStarted","Data":"897861198eb193775da4cee4d7476c8bae134fedcff5ef0351f84f5cb8fa5871"} Jul 15 20:49:01.419801 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.419692 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7gxbt" event={"ID":"49822cd3-a729-4a17-9b34-e61eb6d6257a","Type":"ContainerStarted","Data":"210ea6ebc8b93d7855123c34811f97ba9f6c900eb22c95ac5ea889f593c63d82"} Jul 15 20:49:01.437524 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.436392 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-mxr4t" podStartSLOduration=56.46337755 podStartE2EDuration="1m4.436368709s" totalImagesPullingTime="7.972991159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:01.435006742 +0000 UTC m=+78.110495976" watchObservedRunningTime="2026-07-15 20:49:01.436368709 +0000 UTC m=+78.111857944" Jul 15 20:49:01.460652 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.460564 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wc5wg" podStartSLOduration=68.280448824 podStartE2EDuration="1m17.460539429s" totalImagesPullingTime="9.180090605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:01.458596539 +0000 UTC m=+78.134085773" watchObservedRunningTime="2026-07-15 20:49:01.460539429 +0000 UTC m=+78.136028666" Jul 15 20:49:01.478178 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.478098 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4g6v2" podStartSLOduration=55.514804716 podStartE2EDuration="1m4.478081678s" totalImagesPullingTime="8.963276962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:01.477169347 +0000 UTC m=+78.152658580" watchObservedRunningTime="2026-07-15 20:49:01.478081678 +0000 UTC m=+78.153570950" Jul 15 20:49:01.500797 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.498827 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gm8k" podStartSLOduration=55.344490966 podStartE2EDuration="1m4.498806792s" totalImagesPullingTime="9.154315826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:01.497025014 +0000 UTC m=+78.172514248" watchObservedRunningTime="2026-07-15 20:49:01.498806792 +0000 UTC m=+78.174296025" Jul 15 20:49:01.516985 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.516939 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9"] Jul 15 20:49:01.518607 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.518553 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-vjmp5" podStartSLOduration=33.652300349 podStartE2EDuration="42.518531872s" totalImagesPullingTime="8.866231523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:48:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:01.517632895 +0000 UTC m=+78.193122130" watchObservedRunningTime="2026-07-15 20:49:01.518531872 +0000 UTC m=+78.194021109" Jul 15 20:49:01.521237 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:49:01.521201 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35399360_2c40_4cc5_92fd_fef7993b03d8.slice/crio-eaf1578b1c0521c989a13839f26a7a87cca8cdc258be4774835804fc4e1bf941 WatchSource:0}: Error finding container eaf1578b1c0521c989a13839f26a7a87cca8cdc258be4774835804fc4e1bf941: Status 404 returned error can't find the container with id eaf1578b1c0521c989a13839f26a7a87cca8cdc258be4774835804fc4e1bf941 Jul 15 20:49:01.678850 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.678752 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-mxr4t" Jul 15 20:49:01.705802 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:01.705597 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7gxbt" podStartSLOduration=68.714027412 podStartE2EDuration="1m17.705575146s" totalImagesPullingTime="8.991547734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:01.541360439 +0000 UTC m=+78.216849673" watchObservedRunningTime="2026-07-15 20:49:01.705575146 +0000 UTC m=+78.381064381" Jul 15 20:49:02.426669 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:02.426624 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9" event={"ID":"35399360-2c40-4cc5-92fd-fef7993b03d8","Type":"ContainerStarted","Data":"eaf1578b1c0521c989a13839f26a7a87cca8cdc258be4774835804fc4e1bf941"} Jul 15 20:49:03.432787 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:03.432738 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9" event={"ID":"35399360-2c40-4cc5-92fd-fef7993b03d8","Type":"ContainerStarted","Data":"85171d11f40cd33bd8ca97618263ab33701694e3912e5df1807bf498c4167644"} Jul 15 20:49:03.451604 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:03.451558 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9" podStartSLOduration=1.319345878 podStartE2EDuration="2.451542742s" totalImagesPullingTime="1.132196864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:03.449637697 +0000 UTC m=+80.125126930" watchObservedRunningTime="2026-07-15 20:49:03.451542742 +0000 UTC m=+80.127031974" Jul 15 20:49:04.436420 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:04.436389 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9" Jul 15 20:49:04.441145 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:04.441116 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-gb9d9" Jul 15 20:49:05.441538 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:05.441423 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5brxm" event={"ID":"224bab0f-56d3-42ca-b7c3-7db7b016e4f9","Type":"ContainerStarted","Data":"eb1c485f9c252e2c0a47e23c97bb524ca3e0b757e5dacf015652b55ca187cd02"} Jul 15 20:49:05.465184 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:05.465138 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5brxm" podStartSLOduration=18.118556628 podStartE2EDuration="36.465123116s" totalImagesPullingTime="18.346566488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:48:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:05.464180614 +0000 UTC m=+82.139669847" watchObservedRunningTime="2026-07-15 20:49:05.465123116 +0000 UTC m=+82.140612348" Jul 15 20:49:10.513187 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.513149 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2"] Jul 15 20:49:10.517828 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.517805 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.520278 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.520255 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 15 20:49:10.520393 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.520279 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 15 20:49:10.520464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.520393 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-48nxf\"" Jul 15 20:49:10.520637 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.520624 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 20:49:10.530049 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.530029 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2"] Jul 15 20:49:10.566743 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.566716 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nd2cb"] Jul 15 20:49:10.570090 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.570066 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.572264 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.572242 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2qz5x\"" Jul 15 20:49:10.572406 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.572378 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 20:49:10.572662 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.572643 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 20:49:10.572879 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.572862 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 20:49:10.616197 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.616165 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.616386 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.616205 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbdvq\" (UniqueName: \"kubernetes.io/projected/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-kube-api-access-cbdvq\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.616386 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.616233 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.616386 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.616288 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.717358 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717323 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.717556 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717372 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.717556 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717417 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.717556 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717455 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.717556 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptt2v\" (UniqueName: \"kubernetes.io/projected/9fe46a68-91e1-48b4-8203-9f14eb83391e-kube-api-access-ptt2v\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.717816 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717637 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-tls\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.717816 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717679 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-wtmp\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.717816 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717717 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9fe46a68-91e1-48b4-8203-9f14eb83391e-root\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.717971 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717842 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.717971 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717876 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fe46a68-91e1-48b4-8203-9f14eb83391e-sys\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.717971 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717898 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fe46a68-91e1-48b4-8203-9f14eb83391e-metrics-client-ca\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.717971 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717930 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-textfile\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.717971 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.717957 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbdvq\" (UniqueName: \"kubernetes.io/projected/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-kube-api-access-cbdvq\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.718293 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.718274 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.719988 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.719965 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.720176 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.720158 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.726897 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.726874 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbdvq\" (UniqueName: \"kubernetes.io/projected/c72f8fd4-1b35-4851-9052-4fbaa700c0ea-kube-api-access-cbdvq\") pod \"openshift-state-metrics-84bd68b896-cgsj2\" (UID: \"c72f8fd4-1b35-4851-9052-4fbaa700c0ea\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.818447 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818362 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fe46a68-91e1-48b4-8203-9f14eb83391e-sys\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.818447 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818396 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fe46a68-91e1-48b4-8203-9f14eb83391e-metrics-client-ca\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.818447 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818416 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-textfile\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.818447 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818444 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.818757 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818469 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.818757 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818483 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fe46a68-91e1-48b4-8203-9f14eb83391e-sys\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.818757 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818492 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptt2v\" (UniqueName: \"kubernetes.io/projected/9fe46a68-91e1-48b4-8203-9f14eb83391e-kube-api-access-ptt2v\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.818757 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818561 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-tls\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.818757 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818588 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-wtmp\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.818757 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818615 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9fe46a68-91e1-48b4-8203-9f14eb83391e-root\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.818757 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:49:10.818693 2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 20:49:10.818757 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818729 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9fe46a68-91e1-48b4-8203-9f14eb83391e-root\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.818757 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:49:10.818761 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-tls podName:9fe46a68-91e1-48b4-8203-9f14eb83391e nodeName:}" failed. No retries permitted until 2026-07-15 20:49:11.318741179 +0000 UTC m=+87.994230412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-tls") pod "node-exporter-nd2cb" (UID: "9fe46a68-91e1-48b4-8203-9f14eb83391e") : secret "node-exporter-tls" not found Jul 15 20:49:10.819271 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818805 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-wtmp\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.819271 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.818839 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-textfile\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.819271 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.819098 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.819271 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.819153 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fe46a68-91e1-48b4-8203-9f14eb83391e-metrics-client-ca\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.820967 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.820948 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.827118 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.827095 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" Jul 15 20:49:10.827395 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.827377 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptt2v\" (UniqueName: \"kubernetes.io/projected/9fe46a68-91e1-48b4-8203-9f14eb83391e-kube-api-access-ptt2v\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:10.965449 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:10.965409 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2"] Jul 15 20:49:10.967479 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:49:10.967449 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72f8fd4_1b35_4851_9052_4fbaa700c0ea.slice/crio-17bbdb66c60e4bf717c08f370600a604ff5661905a87f260fae1a01c839bc798 WatchSource:0}: Error finding container 17bbdb66c60e4bf717c08f370600a604ff5661905a87f260fae1a01c839bc798: Status 404 returned error can't find the container with id 17bbdb66c60e4bf717c08f370600a604ff5661905a87f260fae1a01c839bc798 Jul 15 20:49:11.322877 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:11.322843 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-tls\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:11.325017 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:11.324999 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9fe46a68-91e1-48b4-8203-9f14eb83391e-node-exporter-tls\") pod \"node-exporter-nd2cb\" (UID: \"9fe46a68-91e1-48b4-8203-9f14eb83391e\") " pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:11.429469 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:11.429394 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s2jgz" Jul 15 20:49:11.466978 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:11.466949 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" event={"ID":"c72f8fd4-1b35-4851-9052-4fbaa700c0ea","Type":"ContainerStarted","Data":"b88c77b8f7b69cf8750c7c3cbdd1fe2fb45585b1dc76fb05b981c7e339c5eaad"} Jul 15 20:49:11.467110 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:11.467002 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" event={"ID":"c72f8fd4-1b35-4851-9052-4fbaa700c0ea","Type":"ContainerStarted","Data":"0ac8403304f72507efb780d9c37b69e2b528d2100af0f1296b9e35389e1f2adc"} Jul 15 20:49:11.467110 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:11.467019 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" event={"ID":"c72f8fd4-1b35-4851-9052-4fbaa700c0ea","Type":"ContainerStarted","Data":"17bbdb66c60e4bf717c08f370600a604ff5661905a87f260fae1a01c839bc798"} Jul 15 20:49:11.478745 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:11.478721 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nd2cb" Jul 15 20:49:11.495936 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:49:11.495902 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe46a68_91e1_48b4_8203_9f14eb83391e.slice/crio-0177b71570ecc2b9f4484177e56571d22a7f465094e59fc7518ed85babe1d473 WatchSource:0}: Error finding container 0177b71570ecc2b9f4484177e56571d22a7f465094e59fc7518ed85babe1d473: Status 404 returned error can't find the container with id 0177b71570ecc2b9f4484177e56571d22a7f465094e59fc7518ed85babe1d473 Jul 15 20:49:12.360736 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:12.360707 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:49:12.477628 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:12.477596 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" event={"ID":"c72f8fd4-1b35-4851-9052-4fbaa700c0ea","Type":"ContainerStarted","Data":"1061d0ab3f124e4d47a9e9ce5d642628a097f13678050c81edf8d025e29e0c07"} Jul 15 20:49:12.478905 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:12.478883 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nd2cb" event={"ID":"9fe46a68-91e1-48b4-8203-9f14eb83391e","Type":"ContainerStarted","Data":"0177b71570ecc2b9f4484177e56571d22a7f465094e59fc7518ed85babe1d473"} Jul 15 20:49:12.498388 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:12.498338 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cgsj2" podStartSLOduration=1.424100578 podStartE2EDuration="2.498323169s" totalImagesPullingTime="1.074222591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:12.497666403 +0000 UTC m=+89.173155637" watchObservedRunningTime="2026-07-15 20:49:12.498323169 +0000 UTC m=+89.173812402" Jul 15 20:49:13.485426 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.485391 2553 generic.go:356] "Generic (PLEG): container finished" podID="9fe46a68-91e1-48b4-8203-9f14eb83391e" containerID="fe20236da10daabcc3dda77e3cf5c1cf08e5ca59182f363e6ddf04b53a5b9e5f" exitCode=0 Jul 15 20:49:13.485898 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.485475 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nd2cb" event={"ID":"9fe46a68-91e1-48b4-8203-9f14eb83391e","Type":"ContainerDied","Data":"fe20236da10daabcc3dda77e3cf5c1cf08e5ca59182f363e6ddf04b53a5b9e5f"} Jul 15 20:49:13.713464 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.713429 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg"] Jul 15 20:49:13.717204 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.717187 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.720041 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.720018 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 15 20:49:13.720041 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.720041 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3i6b8mt9oqn17\"" Jul 15 20:49:13.720229 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.720018 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 15 20:49:13.720229 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.720179 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 15 20:49:13.720455 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.720440 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 15 20:49:13.720531 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.720444 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2b4ld\"" Jul 15 20:49:13.720531 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.720461 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 15 20:49:13.739348 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.739275 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg"] Jul 15 20:49:13.842676 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.842635 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37cb2e18-83ef-49cc-a132-ea4917bbd802-metrics-client-ca\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.842885 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.842687 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-grpc-tls\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.842885 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.842765 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.842885 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.842837 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxpls\" (UniqueName: \"kubernetes.io/projected/37cb2e18-83ef-49cc-a132-ea4917bbd802-kube-api-access-cxpls\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.842988 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.842919 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.842988 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.842975 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.843053 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.843000 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.843053 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.843031 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-tls\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.943965 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.943934 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxpls\" (UniqueName: \"kubernetes.io/projected/37cb2e18-83ef-49cc-a132-ea4917bbd802-kube-api-access-cxpls\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.944100 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.943972 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.944100 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.943991 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.944278 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.944259 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.944328 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.944305 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-tls\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.944365 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.944355 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37cb2e18-83ef-49cc-a132-ea4917bbd802-metrics-client-ca\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.944416 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.944402 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-grpc-tls\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.944459 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.944437 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.945195 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.945133 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37cb2e18-83ef-49cc-a132-ea4917bbd802-metrics-client-ca\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.946992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.946969 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.947106 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.947018 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-grpc-tls\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.947179 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.947132 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.947179 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.947137 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.947251 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.947178 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.947296 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.947277 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/37cb2e18-83ef-49cc-a132-ea4917bbd802-secret-thanos-querier-tls\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:13.951963 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:13.951942 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxpls\" (UniqueName: \"kubernetes.io/projected/37cb2e18-83ef-49cc-a132-ea4917bbd802-kube-api-access-cxpls\") pod \"thanos-querier-59bd6d97c5-8vpbg\" (UID: \"37cb2e18-83ef-49cc-a132-ea4917bbd802\") " pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:14.026391 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.026289 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:14.169363 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.169337 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg"] Jul 15 20:49:14.171876 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:49:14.171845 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37cb2e18_83ef_49cc_a132_ea4917bbd802.slice/crio-086aec51aeb3b4c6a18b5f27443386427b7b411bad9aba64e053d4ef6524d09f WatchSource:0}: Error finding container 086aec51aeb3b4c6a18b5f27443386427b7b411bad9aba64e053d4ef6524d09f: Status 404 returned error can't find the container with id 086aec51aeb3b4c6a18b5f27443386427b7b411bad9aba64e053d4ef6524d09f Jul 15 20:49:14.490453 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.490417 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" event={"ID":"37cb2e18-83ef-49cc-a132-ea4917bbd802","Type":"ContainerStarted","Data":"086aec51aeb3b4c6a18b5f27443386427b7b411bad9aba64e053d4ef6524d09f"} Jul 15 20:49:14.492468 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.492447 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nd2cb" event={"ID":"9fe46a68-91e1-48b4-8203-9f14eb83391e","Type":"ContainerStarted","Data":"97f08f920116669df89b89b14e04a7cb68804ddd209546b9963136c0a4b27dc1"} Jul 15 20:49:14.492587 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.492490 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nd2cb" event={"ID":"9fe46a68-91e1-48b4-8203-9f14eb83391e","Type":"ContainerStarted","Data":"5eb0e168d412fc9952814348395038ae33e4cb3eb936876f3e29e009a21796bf"} Jul 15 20:49:14.515574 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.515524 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nd2cb" podStartSLOduration=3.477207951 podStartE2EDuration="4.515508706s" totalImagesPullingTime="972.603149ms" totalInitContainerRuntime="65.697606ms" isStatefulPod=true podCreationTimestamp="2026-07-15 20:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:14.515031149 +0000 UTC m=+91.190520382" watchObservedRunningTime="2026-07-15 20:49:14.515508706 +0000 UTC m=+91.190997939" Jul 15 20:49:14.870016 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.869983 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6769df564c-c4wbr"] Jul 15 20:49:14.873257 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.873239 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:14.876193 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.876170 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 15 20:49:14.876345 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.876243 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5gnpq6dgjji4\"" Jul 15 20:49:14.876345 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.876315 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7lmlc\"" Jul 15 20:49:14.876450 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.876434 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 15 20:49:14.876681 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.876663 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 20:49:14.876681 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.876667 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 15 20:49:14.889221 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.889198 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6769df564c-c4wbr"] Jul 15 20:49:14.951686 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.951618 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/35064ca7-bed4-440e-addf-37e3b33e0384-audit-log\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:14.951686 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.951658 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/35064ca7-bed4-440e-addf-37e3b33e0384-metrics-server-audit-profiles\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:14.951686 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.951682 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/35064ca7-bed4-440e-addf-37e3b33e0384-secret-metrics-server-client-certs\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:14.951974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.951740 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35064ca7-bed4-440e-addf-37e3b33e0384-client-ca-bundle\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:14.951974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.951823 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57mtv\" (UniqueName: \"kubernetes.io/projected/35064ca7-bed4-440e-addf-37e3b33e0384-kube-api-access-57mtv\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:14.951974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.951852 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/35064ca7-bed4-440e-addf-37e3b33e0384-secret-metrics-server-tls\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:14.951974 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:14.951923 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35064ca7-bed4-440e-addf-37e3b33e0384-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.053209 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.053164 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/35064ca7-bed4-440e-addf-37e3b33e0384-audit-log\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.053374 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.053225 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/35064ca7-bed4-440e-addf-37e3b33e0384-metrics-server-audit-profiles\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.053374 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.053265 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/35064ca7-bed4-440e-addf-37e3b33e0384-secret-metrics-server-client-certs\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.053374 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.053306 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35064ca7-bed4-440e-addf-37e3b33e0384-client-ca-bundle\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.053374 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.053332 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57mtv\" (UniqueName: \"kubernetes.io/projected/35064ca7-bed4-440e-addf-37e3b33e0384-kube-api-access-57mtv\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.053374 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.053359 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/35064ca7-bed4-440e-addf-37e3b33e0384-secret-metrics-server-tls\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.053657 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.053406 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35064ca7-bed4-440e-addf-37e3b33e0384-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.053657 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.053626 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/35064ca7-bed4-440e-addf-37e3b33e0384-audit-log\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.054369 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.054342 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35064ca7-bed4-440e-addf-37e3b33e0384-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.054652 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.054629 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/35064ca7-bed4-440e-addf-37e3b33e0384-metrics-server-audit-profiles\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.056385 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.056356 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/35064ca7-bed4-440e-addf-37e3b33e0384-secret-metrics-server-client-certs\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.056497 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.056383 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/35064ca7-bed4-440e-addf-37e3b33e0384-secret-metrics-server-tls\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.056497 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.056434 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35064ca7-bed4-440e-addf-37e3b33e0384-client-ca-bundle\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.065820 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.065799 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57mtv\" (UniqueName: \"kubernetes.io/projected/35064ca7-bed4-440e-addf-37e3b33e0384-kube-api-access-57mtv\") pod \"metrics-server-6769df564c-c4wbr\" (UID: \"35064ca7-bed4-440e-addf-37e3b33e0384\") " pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.184886 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.184809 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:15.358239 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.358218 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6769df564c-c4wbr"] Jul 15 20:49:15.361013 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:49:15.360987 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35064ca7_bed4_440e_addf_37e3b33e0384.slice/crio-8d28269fc18b30ee3ae593a19b7ed103ed23c5e25046f9ce2e9ec5f4885da379 WatchSource:0}: Error finding container 8d28269fc18b30ee3ae593a19b7ed103ed23c5e25046f9ce2e9ec5f4885da379: Status 404 returned error can't find the container with id 8d28269fc18b30ee3ae593a19b7ed103ed23c5e25046f9ce2e9ec5f4885da379 Jul 15 20:49:15.498420 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:15.498336 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" event={"ID":"35064ca7-bed4-440e-addf-37e3b33e0384","Type":"ContainerStarted","Data":"8d28269fc18b30ee3ae593a19b7ed103ed23c5e25046f9ce2e9ec5f4885da379"} Jul 15 20:49:17.510005 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:17.509896 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" event={"ID":"37cb2e18-83ef-49cc-a132-ea4917bbd802","Type":"ContainerStarted","Data":"58f4963a5cd24eeceb47c0c9509b6e1a14c26578784bdf826df567e48e7e2f3b"} Jul 15 20:49:17.510385 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:17.510029 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" event={"ID":"37cb2e18-83ef-49cc-a132-ea4917bbd802","Type":"ContainerStarted","Data":"91ba62c3da268d49effcdf387bdebe2bfe62c8c0bbdf134380b9635662e75bea"} Jul 15 20:49:17.510385 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:17.510076 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" event={"ID":"37cb2e18-83ef-49cc-a132-ea4917bbd802","Type":"ContainerStarted","Data":"8e3a85671d5ea7a07c353e7ea26b3fde6341b94575024aadf995dbe6a6e7b18d"} Jul 15 20:49:17.511489 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:17.511465 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" event={"ID":"35064ca7-bed4-440e-addf-37e3b33e0384","Type":"ContainerStarted","Data":"8e7734d99be2a476d495a5b28a261d3b80c8666bdf6289f9a6163ca0462046b7"} Jul 15 20:49:17.533550 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:17.533504 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" podStartSLOduration=1.784635297 podStartE2EDuration="3.533488806s" totalImagesPullingTime="1.748853509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:17.531264916 +0000 UTC m=+94.206754150" watchObservedRunningTime="2026-07-15 20:49:17.533488806 +0000 UTC m=+94.208978039" Jul 15 20:49:18.518363 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:18.518263 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" event={"ID":"37cb2e18-83ef-49cc-a132-ea4917bbd802","Type":"ContainerStarted","Data":"949e107826f75f9cd9d91cccfe860fad4c49514538bc4eed1eae71356ec4923e"} Jul 15 20:49:18.518363 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:18.518347 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" event={"ID":"37cb2e18-83ef-49cc-a132-ea4917bbd802","Type":"ContainerStarted","Data":"c4ae1f57bb86d72ba7ad1d888766b73523cd918ce835251b6586d0e68ccf3d7e"} Jul 15 20:49:18.518791 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:18.518386 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" event={"ID":"37cb2e18-83ef-49cc-a132-ea4917bbd802","Type":"ContainerStarted","Data":"baaf33e3cc3bca1d66ede08762f932d4f47f67006909e6e1ad317bfb935c853d"} Jul 15 20:49:18.556913 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:18.556865 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" podStartSLOduration=1.741089949 podStartE2EDuration="5.556848033s" totalImagesPullingTime="3.815758084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:49:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:18.555679768 +0000 UTC m=+95.231169002" watchObservedRunningTime="2026-07-15 20:49:18.556848033 +0000 UTC m=+95.232337266" Jul 15 20:49:19.521973 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.521949 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:19.983964 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.983933 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b454f5bb-jf4cb"] Jul 15 20:49:19.987206 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.987187 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:19.990127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.990109 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 20:49:19.991238 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.991221 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 20:49:19.991337 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.991224 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 20:49:19.991585 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.991569 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 20:49:19.991665 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.991618 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 20:49:19.991665 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.991660 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 20:49:19.991763 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.991688 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 20:49:19.991835 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.991763 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nmh6g\"" Jul 15 20:49:19.999379 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:19.999354 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 20:49:20.001895 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.001869 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-serving-cert\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.001997 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.001911 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-oauth-config\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.001997 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.001937 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rls94\" (UniqueName: \"kubernetes.io/projected/5e4774e6-fdd7-4299-9990-6b19cea47537-kube-api-access-rls94\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.002086 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.002002 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-oauth-serving-cert\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.002086 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.002058 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-service-ca\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.002161 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.002141 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-trusted-ca-bundle\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.002194 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.002168 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-console-config\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.003419 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.003398 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b454f5bb-jf4cb"] Jul 15 20:49:20.103265 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.103234 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-trusted-ca-bundle\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.103265 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.103271 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-console-config\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.103472 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.103404 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-serving-cert\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.103472 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.103441 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-oauth-config\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.103472 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.103468 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rls94\" (UniqueName: \"kubernetes.io/projected/5e4774e6-fdd7-4299-9990-6b19cea47537-kube-api-access-rls94\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.103590 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.103504 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-oauth-serving-cert\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.103590 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.103541 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-service-ca\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.104119 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.104086 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-console-config\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.104240 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.104214 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-service-ca\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.104311 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.104259 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-trusted-ca-bundle\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.104370 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.104334 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-oauth-serving-cert\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.105959 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.105940 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-serving-cert\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.106113 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.106090 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-oauth-config\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.112011 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.111988 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rls94\" (UniqueName: \"kubernetes.io/projected/5e4774e6-fdd7-4299-9990-6b19cea47537-kube-api-access-rls94\") pod \"console-5b454f5bb-jf4cb\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.296957 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.296862 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:20.430516 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.430494 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b454f5bb-jf4cb"] Jul 15 20:49:20.433012 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:49:20.432985 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4774e6_fdd7_4299_9990_6b19cea47537.slice/crio-0a8fae1122222679c7151144892d20e2df23130e58ff790bda202fe8a7255f17 WatchSource:0}: Error finding container 0a8fae1122222679c7151144892d20e2df23130e58ff790bda202fe8a7255f17: Status 404 returned error can't find the container with id 0a8fae1122222679c7151144892d20e2df23130e58ff790bda202fe8a7255f17 Jul 15 20:49:20.527144 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:20.527114 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b454f5bb-jf4cb" event={"ID":"5e4774e6-fdd7-4299-9990-6b19cea47537","Type":"ContainerStarted","Data":"0a8fae1122222679c7151144892d20e2df23130e58ff790bda202fe8a7255f17"} Jul 15 20:49:22.358369 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:22.358339 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rswbn" Jul 15 20:49:23.529969 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:23.529933 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-97b66b7f8-jlwjw"] Jul 15 20:49:24.547093 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:24.547061 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b454f5bb-jf4cb" event={"ID":"5e4774e6-fdd7-4299-9990-6b19cea47537","Type":"ContainerStarted","Data":"8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1"} Jul 15 20:49:24.587896 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:24.587833 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b454f5bb-jf4cb" podStartSLOduration=2.382326896 podStartE2EDuration="5.587814053s" totalImagesPullingTime="3.205487157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:24.587079756 +0000 UTC m=+101.262568990" watchObservedRunningTime="2026-07-15 20:49:24.587814053 +0000 UTC m=+101.263303288" Jul 15 20:49:25.533386 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:25.533357 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59bd6d97c5-8vpbg" Jul 15 20:49:30.297444 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:30.297403 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:30.297979 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:30.297467 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:30.302452 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:30.302430 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:30.574652 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:30.574627 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:49:34.588452 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:34.588418 2553 generic.go:356] "Generic (PLEG): container finished" podID="e95cdc29-c50b-4470-a2af-7d158d58d1eb" containerID="d105820e1113a60ea7ba6c6bcce91957227bb66205f9073aa2fb1c89d3237ae3" exitCode=0 Jul 15 20:49:34.588853 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:34.588479 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" event={"ID":"e95cdc29-c50b-4470-a2af-7d158d58d1eb","Type":"ContainerDied","Data":"d105820e1113a60ea7ba6c6bcce91957227bb66205f9073aa2fb1c89d3237ae3"} Jul 15 20:49:34.588853 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:34.588797 2553 scope.go:117] "RemoveContainer" containerID="d105820e1113a60ea7ba6c6bcce91957227bb66205f9073aa2fb1c89d3237ae3" Jul 15 20:49:35.185444 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:35.185413 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:35.185613 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:35.185492 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:35.593543 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:35.593509 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ljh2w" event={"ID":"e95cdc29-c50b-4470-a2af-7d158d58d1eb","Type":"ContainerStarted","Data":"a67ac0aa1e194ac358d3871480d4b4140e968d1112fad17f0d6c7eec5b5813a8"} Jul 15 20:49:39.609388 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:39.609359 2553 generic.go:356] "Generic (PLEG): container finished" podID="4723c782-9fbb-4b87-99c9-13786304bb2d" containerID="76446fa830634abc261bf2d8268151a6d016e1a2e0f2950adf872b5583aebaf8" exitCode=0 Jul 15 20:49:39.609814 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:39.609434 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" event={"ID":"4723c782-9fbb-4b87-99c9-13786304bb2d","Type":"ContainerDied","Data":"76446fa830634abc261bf2d8268151a6d016e1a2e0f2950adf872b5583aebaf8"} Jul 15 20:49:39.609814 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:39.609795 2553 scope.go:117] "RemoveContainer" containerID="76446fa830634abc261bf2d8268151a6d016e1a2e0f2950adf872b5583aebaf8" Jul 15 20:49:39.611046 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:39.611023 2553 generic.go:356] "Generic (PLEG): container finished" podID="b9613d99-d0ed-4e47-b087-713ff9332b1a" containerID="7d3afa7f0ade08824331f2d7ec281de4208e6af7cb5cb01fa096826ea36b3010" exitCode=0 Jul 15 20:49:39.611168 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:39.611091 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" event={"ID":"b9613d99-d0ed-4e47-b087-713ff9332b1a","Type":"ContainerDied","Data":"7d3afa7f0ade08824331f2d7ec281de4208e6af7cb5cb01fa096826ea36b3010"} Jul 15 20:49:39.611387 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:39.611370 2553 scope.go:117] "RemoveContainer" containerID="7d3afa7f0ade08824331f2d7ec281de4208e6af7cb5cb01fa096826ea36b3010" Jul 15 20:49:40.617172 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:40.617134 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-29dsg" event={"ID":"b9613d99-d0ed-4e47-b087-713ff9332b1a","Type":"ContainerStarted","Data":"ff9d393472c0ddd8dfb0fad6d9b725a956e68197ff0d51cad00e606d22d8e45e"} Jul 15 20:49:40.618967 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:40.618945 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-r2fbf" event={"ID":"4723c782-9fbb-4b87-99c9-13786304bb2d","Type":"ContainerStarted","Data":"07e3b4af72ed1b001dbb1ca66fc284789c7ad327fea343b5b5503084dcdbb0a1"} Jul 15 20:49:48.553328 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.553242 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" podUID="52546b70-c875-44e4-afa2-70bf34e5f7dc" containerName="registry" containerID="cri-o://b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a" gracePeriod=30 Jul 15 20:49:48.831870 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.830419 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:49:48.950542 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.950496 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-bound-sa-token\") pod \"52546b70-c875-44e4-afa2-70bf34e5f7dc\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " Jul 15 20:49:48.950707 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.950561 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls\") pod \"52546b70-c875-44e4-afa2-70bf34e5f7dc\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " Jul 15 20:49:48.950707 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.950632 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-trusted-ca\") pod \"52546b70-c875-44e4-afa2-70bf34e5f7dc\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " Jul 15 20:49:48.950707 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.950668 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-installation-pull-secrets\") pod \"52546b70-c875-44e4-afa2-70bf34e5f7dc\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " Jul 15 20:49:48.950878 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.950705 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-image-registry-private-configuration\") pod \"52546b70-c875-44e4-afa2-70bf34e5f7dc\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " Jul 15 20:49:48.950878 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.950788 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/52546b70-c875-44e4-afa2-70bf34e5f7dc-ca-trust-extracted\") pod \"52546b70-c875-44e4-afa2-70bf34e5f7dc\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " Jul 15 20:49:48.950878 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.950815 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-certificates\") pod \"52546b70-c875-44e4-afa2-70bf34e5f7dc\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " Jul 15 20:49:48.950878 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.950843 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xghhk\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-kube-api-access-xghhk\") pod \"52546b70-c875-44e4-afa2-70bf34e5f7dc\" (UID: \"52546b70-c875-44e4-afa2-70bf34e5f7dc\") " Jul 15 20:49:48.951079 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.951020 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "52546b70-c875-44e4-afa2-70bf34e5f7dc" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:49:48.951259 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.951215 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "52546b70-c875-44e4-afa2-70bf34e5f7dc" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:49:48.953474 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.953416 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "52546b70-c875-44e4-afa2-70bf34e5f7dc" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:49:48.953876 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.953799 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "52546b70-c875-44e4-afa2-70bf34e5f7dc" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:49:48.953876 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.953862 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "52546b70-c875-44e4-afa2-70bf34e5f7dc" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 20:49:48.954014 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.953947 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "52546b70-c875-44e4-afa2-70bf34e5f7dc" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 20:49:48.954014 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.953948 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-kube-api-access-xghhk" (OuterVolumeSpecName: "kube-api-access-xghhk") pod "52546b70-c875-44e4-afa2-70bf34e5f7dc" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc"). InnerVolumeSpecName "kube-api-access-xghhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:49:48.959968 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:48.959941 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52546b70-c875-44e4-afa2-70bf34e5f7dc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "52546b70-c875-44e4-afa2-70bf34e5f7dc" (UID: "52546b70-c875-44e4-afa2-70bf34e5f7dc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:49:49.052366 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.052332 2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/52546b70-c875-44e4-afa2-70bf34e5f7dc-ca-trust-extracted\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:49:49.052366 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.052363 2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-certificates\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:49:49.052366 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.052375 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xghhk\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-kube-api-access-xghhk\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:49:49.052587 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.052388 2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-bound-sa-token\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:49:49.052587 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.052400 2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/52546b70-c875-44e4-afa2-70bf34e5f7dc-registry-tls\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:49:49.052587 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.052410 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/52546b70-c875-44e4-afa2-70bf34e5f7dc-trusted-ca\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:49:49.052587 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.052420 2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-installation-pull-secrets\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:49:49.052587 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.052433 2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/52546b70-c875-44e4-afa2-70bf34e5f7dc-image-registry-private-configuration\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:49:49.662683 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.662648 2553 generic.go:356] "Generic (PLEG): container finished" podID="52546b70-c875-44e4-afa2-70bf34e5f7dc" containerID="b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a" exitCode=0 Jul 15 20:49:49.663127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.662691 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" Jul 15 20:49:49.663127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.662745 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" event={"ID":"52546b70-c875-44e4-afa2-70bf34e5f7dc","Type":"ContainerDied","Data":"b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a"} Jul 15 20:49:49.663127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.662812 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-97b66b7f8-jlwjw" event={"ID":"52546b70-c875-44e4-afa2-70bf34e5f7dc","Type":"ContainerDied","Data":"fa222a763a7fcdd0125cc49b2094ac7d8d966de0dcdc9e4225b5941a81c125d1"} Jul 15 20:49:49.663127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.662837 2553 scope.go:117] "RemoveContainer" containerID="b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a" Jul 15 20:49:49.671984 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.671967 2553 scope.go:117] "RemoveContainer" containerID="b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a" Jul 15 20:49:49.672245 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:49:49.672225 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a\": container with ID starting with b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a not found: ID does not exist" containerID="b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a" Jul 15 20:49:49.672290 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.672254 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a"} err="failed to get container status \"b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a\": rpc error: code = NotFound desc = could not find container \"b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a\": container with ID starting with b67c9f81b9cbfd9265c30a643f39c135106c4f372b4d96c7e046ce257ca1497a not found: ID does not exist" Jul 15 20:49:49.684425 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.684398 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-97b66b7f8-jlwjw"] Jul 15 20:49:49.688710 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.688690 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-97b66b7f8-jlwjw"] Jul 15 20:49:49.880875 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:49.880843 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52546b70-c875-44e4-afa2-70bf34e5f7dc" path="/var/lib/kubelet/pods/52546b70-c875-44e4-afa2-70bf34e5f7dc/volumes" Jul 15 20:49:55.190352 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:55.190322 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:49:55.194263 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:49:55.194245 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6769df564c-c4wbr" Jul 15 20:50:51.026231 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:50:51.026198 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b454f5bb-jf4cb"] Jul 15 20:51:16.048880 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.048816 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b454f5bb-jf4cb" podUID="5e4774e6-fdd7-4299-9990-6b19cea47537" containerName="console" containerID="cri-o://8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1" gracePeriod=15 Jul 15 20:51:16.296328 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.296303 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:51:16.370726 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.370690 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-trusted-ca-bundle\") pod \"5e4774e6-fdd7-4299-9990-6b19cea47537\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " Jul 15 20:51:16.370906 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.370738 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-service-ca\") pod \"5e4774e6-fdd7-4299-9990-6b19cea47537\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " Jul 15 20:51:16.370906 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.370793 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-serving-cert\") pod \"5e4774e6-fdd7-4299-9990-6b19cea47537\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " Jul 15 20:51:16.370906 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.370823 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-console-config\") pod \"5e4774e6-fdd7-4299-9990-6b19cea47537\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " Jul 15 20:51:16.370906 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.370861 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rls94\" (UniqueName: \"kubernetes.io/projected/5e4774e6-fdd7-4299-9990-6b19cea47537-kube-api-access-rls94\") pod \"5e4774e6-fdd7-4299-9990-6b19cea47537\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " Jul 15 20:51:16.370906 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.370887 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-oauth-serving-cert\") pod \"5e4774e6-fdd7-4299-9990-6b19cea47537\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " Jul 15 20:51:16.371172 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.370927 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-oauth-config\") pod \"5e4774e6-fdd7-4299-9990-6b19cea47537\" (UID: \"5e4774e6-fdd7-4299-9990-6b19cea47537\") " Jul 15 20:51:16.371309 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.371278 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-service-ca" (OuterVolumeSpecName: "service-ca") pod "5e4774e6-fdd7-4299-9990-6b19cea47537" (UID: "5e4774e6-fdd7-4299-9990-6b19cea47537"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:51:16.371309 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.371290 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-console-config" (OuterVolumeSpecName: "console-config") pod "5e4774e6-fdd7-4299-9990-6b19cea47537" (UID: "5e4774e6-fdd7-4299-9990-6b19cea47537"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:51:16.371470 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.371341 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5e4774e6-fdd7-4299-9990-6b19cea47537" (UID: "5e4774e6-fdd7-4299-9990-6b19cea47537"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:51:16.371470 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.371422 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5e4774e6-fdd7-4299-9990-6b19cea47537" (UID: "5e4774e6-fdd7-4299-9990-6b19cea47537"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:51:16.373236 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.373211 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5e4774e6-fdd7-4299-9990-6b19cea47537" (UID: "5e4774e6-fdd7-4299-9990-6b19cea47537"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 20:51:16.373236 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.373218 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e4774e6-fdd7-4299-9990-6b19cea47537-kube-api-access-rls94" (OuterVolumeSpecName: "kube-api-access-rls94") pod "5e4774e6-fdd7-4299-9990-6b19cea47537" (UID: "5e4774e6-fdd7-4299-9990-6b19cea47537"). InnerVolumeSpecName "kube-api-access-rls94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:51:16.373352 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.373266 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5e4774e6-fdd7-4299-9990-6b19cea47537" (UID: "5e4774e6-fdd7-4299-9990-6b19cea47537"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 20:51:16.472375 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.472342 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-oauth-config\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:51:16.472375 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.472368 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-trusted-ca-bundle\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:51:16.472375 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.472379 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-service-ca\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:51:16.472375 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.472388 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4774e6-fdd7-4299-9990-6b19cea47537-console-serving-cert\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:51:16.472642 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.472398 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-console-config\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:51:16.472642 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.472408 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rls94\" (UniqueName: \"kubernetes.io/projected/5e4774e6-fdd7-4299-9990-6b19cea47537-kube-api-access-rls94\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:51:16.472642 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:16.472416 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e4774e6-fdd7-4299-9990-6b19cea47537-oauth-serving-cert\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:51:17.009121 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:17.009089 2553 generic.go:356] "Generic (PLEG): container finished" podID="5e4774e6-fdd7-4299-9990-6b19cea47537" containerID="8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1" exitCode=0 Jul 15 20:51:17.009299 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:17.009132 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b454f5bb-jf4cb" Jul 15 20:51:17.009299 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:17.009174 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b454f5bb-jf4cb" event={"ID":"5e4774e6-fdd7-4299-9990-6b19cea47537","Type":"ContainerDied","Data":"8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1"} Jul 15 20:51:17.009299 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:17.009225 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b454f5bb-jf4cb" event={"ID":"5e4774e6-fdd7-4299-9990-6b19cea47537","Type":"ContainerDied","Data":"0a8fae1122222679c7151144892d20e2df23130e58ff790bda202fe8a7255f17"} Jul 15 20:51:17.009299 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:17.009248 2553 scope.go:117] "RemoveContainer" containerID="8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1" Jul 15 20:51:17.018317 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:17.018296 2553 scope.go:117] "RemoveContainer" containerID="8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1" Jul 15 20:51:17.018605 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:51:17.018585 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1\": container with ID starting with 8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1 not found: ID does not exist" containerID="8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1" Jul 15 20:51:17.018679 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:17.018615 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1"} err="failed to get container status \"8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1\": rpc error: code = NotFound desc = could not find container \"8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1\": container with ID starting with 8013b0a4efdd067ee1d0f5739e99668081442f55eff2c6a76d5c8d47b3edbcb1 not found: ID does not exist" Jul 15 20:51:17.051942 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:17.051904 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b454f5bb-jf4cb"] Jul 15 20:51:17.065457 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:17.065429 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b454f5bb-jf4cb"] Jul 15 20:51:17.880518 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:51:17.880484 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e4774e6-fdd7-4299-9990-6b19cea47537" path="/var/lib/kubelet/pods/5e4774e6-fdd7-4299-9990-6b19cea47537/volumes" Jul 15 20:52:43.681547 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:52:43.681518 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 20:52:43.683978 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:52:43.683951 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 20:52:43.692934 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:52:43.692914 2553 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 20:53:08.828957 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.828927 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp"] Jul 15 20:53:08.831300 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.829237 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4774e6-fdd7-4299-9990-6b19cea47537" containerName="console" Jul 15 20:53:08.831300 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.829248 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4774e6-fdd7-4299-9990-6b19cea47537" containerName="console" Jul 15 20:53:08.831300 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.829270 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52546b70-c875-44e4-afa2-70bf34e5f7dc" containerName="registry" Jul 15 20:53:08.831300 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.829275 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="52546b70-c875-44e4-afa2-70bf34e5f7dc" containerName="registry" Jul 15 20:53:08.831300 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.829330 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="52546b70-c875-44e4-afa2-70bf34e5f7dc" containerName="registry" Jul 15 20:53:08.831300 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.829339 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e4774e6-fdd7-4299-9990-6b19cea47537" containerName="console" Jul 15 20:53:08.832287 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.832272 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:08.836302 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.836269 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 20:53:08.836982 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.836965 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 20:53:08.837044 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.836978 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t5nnx\"" Jul 15 20:53:08.851095 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.851069 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp"] Jul 15 20:53:08.854757 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.854730 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:08.854871 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.854825 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:08.854871 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.854849 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zgdg\" (UniqueName: \"kubernetes.io/projected/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-kube-api-access-4zgdg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:08.955487 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.955444 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:08.955653 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.955543 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:08.955653 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.955573 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zgdg\" (UniqueName: \"kubernetes.io/projected/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-kube-api-access-4zgdg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:08.955796 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.955705 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:08.955940 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.955916 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:08.964898 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:08.964875 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zgdg\" (UniqueName: \"kubernetes.io/projected/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-kube-api-access-4zgdg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:09.141693 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:09.141600 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:09.273712 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:09.273682 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp"] Jul 15 20:53:09.276491 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:53:09.276465 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23cfa794_96f3_46cf_9fb1_8258f9dd21f8.slice/crio-4eb61c519adda223fabde031719c42013fe1fa26fdb5263b8a47e9302b26e197 WatchSource:0}: Error finding container 4eb61c519adda223fabde031719c42013fe1fa26fdb5263b8a47e9302b26e197: Status 404 returned error can't find the container with id 4eb61c519adda223fabde031719c42013fe1fa26fdb5263b8a47e9302b26e197 Jul 15 20:53:09.278365 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:09.278351 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 20:53:09.440095 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:09.440009 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" event={"ID":"23cfa794-96f3-46cf-9fb1-8258f9dd21f8","Type":"ContainerStarted","Data":"4eb61c519adda223fabde031719c42013fe1fa26fdb5263b8a47e9302b26e197"} Jul 15 20:53:15.469121 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:15.469085 2553 generic.go:356] "Generic (PLEG): container finished" podID="23cfa794-96f3-46cf-9fb1-8258f9dd21f8" containerID="64aa16b81a196cea3e9e02127dc55b46179b7300853114579c76349cc0c4b39b" exitCode=0 Jul 15 20:53:15.469613 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:15.469129 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" event={"ID":"23cfa794-96f3-46cf-9fb1-8258f9dd21f8","Type":"ContainerDied","Data":"64aa16b81a196cea3e9e02127dc55b46179b7300853114579c76349cc0c4b39b"} Jul 15 20:53:23.502739 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:23.502653 2553 generic.go:356] "Generic (PLEG): container finished" podID="23cfa794-96f3-46cf-9fb1-8258f9dd21f8" containerID="32f3605fba5b2f4bded47589b44f1a45fd88b07e950d93bb113156252b30a071" exitCode=0 Jul 15 20:53:23.502739 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:23.502706 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" event={"ID":"23cfa794-96f3-46cf-9fb1-8258f9dd21f8","Type":"ContainerDied","Data":"32f3605fba5b2f4bded47589b44f1a45fd88b07e950d93bb113156252b30a071"} Jul 15 20:53:31.542217 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:31.542187 2553 generic.go:356] "Generic (PLEG): container finished" podID="23cfa794-96f3-46cf-9fb1-8258f9dd21f8" containerID="d160982473f54349d9547d2aac419e3005f20774a59ee127634bd18edc66efca" exitCode=0 Jul 15 20:53:31.542635 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:31.542266 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" event={"ID":"23cfa794-96f3-46cf-9fb1-8258f9dd21f8","Type":"ContainerDied","Data":"d160982473f54349d9547d2aac419e3005f20774a59ee127634bd18edc66efca"} Jul 15 20:53:32.670188 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:32.670164 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:32.743523 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:32.743494 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-bundle\") pod \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " Jul 15 20:53:32.743687 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:32.743535 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-util\") pod \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " Jul 15 20:53:32.743687 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:32.743568 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zgdg\" (UniqueName: \"kubernetes.io/projected/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-kube-api-access-4zgdg\") pod \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\" (UID: \"23cfa794-96f3-46cf-9fb1-8258f9dd21f8\") " Jul 15 20:53:32.744333 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:32.744301 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-bundle" (OuterVolumeSpecName: "bundle") pod "23cfa794-96f3-46cf-9fb1-8258f9dd21f8" (UID: "23cfa794-96f3-46cf-9fb1-8258f9dd21f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:53:32.745843 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:32.745810 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-kube-api-access-4zgdg" (OuterVolumeSpecName: "kube-api-access-4zgdg") pod "23cfa794-96f3-46cf-9fb1-8258f9dd21f8" (UID: "23cfa794-96f3-46cf-9fb1-8258f9dd21f8"). InnerVolumeSpecName "kube-api-access-4zgdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:53:32.748442 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:32.748421 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-util" (OuterVolumeSpecName: "util") pod "23cfa794-96f3-46cf-9fb1-8258f9dd21f8" (UID: "23cfa794-96f3-46cf-9fb1-8258f9dd21f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:53:32.844054 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:32.844026 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-bundle\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:53:32.844054 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:32.844047 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-util\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:53:32.844054 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:32.844056 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zgdg\" (UniqueName: \"kubernetes.io/projected/23cfa794-96f3-46cf-9fb1-8258f9dd21f8-kube-api-access-4zgdg\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:53:33.552448 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:33.552414 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" event={"ID":"23cfa794-96f3-46cf-9fb1-8258f9dd21f8","Type":"ContainerDied","Data":"4eb61c519adda223fabde031719c42013fe1fa26fdb5263b8a47e9302b26e197"} Jul 15 20:53:33.552620 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:33.552454 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pdxzp" Jul 15 20:53:33.552620 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:33.552495 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4eb61c519adda223fabde031719c42013fe1fa26fdb5263b8a47e9302b26e197" Jul 15 20:53:37.185390 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.185316 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6"] Jul 15 20:53:37.185736 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.185627 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23cfa794-96f3-46cf-9fb1-8258f9dd21f8" containerName="pull" Jul 15 20:53:37.185736 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.185638 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="23cfa794-96f3-46cf-9fb1-8258f9dd21f8" containerName="pull" Jul 15 20:53:37.185736 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.185653 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23cfa794-96f3-46cf-9fb1-8258f9dd21f8" containerName="util" Jul 15 20:53:37.185736 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.185660 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="23cfa794-96f3-46cf-9fb1-8258f9dd21f8" containerName="util" Jul 15 20:53:37.185736 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.185666 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23cfa794-96f3-46cf-9fb1-8258f9dd21f8" containerName="extract" Jul 15 20:53:37.185736 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.185671 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="23cfa794-96f3-46cf-9fb1-8258f9dd21f8" containerName="extract" Jul 15 20:53:37.185736 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.185718 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="23cfa794-96f3-46cf-9fb1-8258f9dd21f8" containerName="extract" Jul 15 20:53:37.188602 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.188587 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6" Jul 15 20:53:37.193917 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.193896 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wpqmt\"" Jul 15 20:53:37.194721 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.194434 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 20:53:37.194721 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.194453 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 20:53:37.208851 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.208822 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6"] Jul 15 20:53:37.279150 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.279118 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a81a329c-36b2-4132-8e3e-1d057022f381-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrlq6\" (UID: \"a81a329c-36b2-4132-8e3e-1d057022f381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6" Jul 15 20:53:37.279302 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.279166 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwffw\" (UniqueName: \"kubernetes.io/projected/a81a329c-36b2-4132-8e3e-1d057022f381-kube-api-access-nwffw\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrlq6\" (UID: \"a81a329c-36b2-4132-8e3e-1d057022f381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6" Jul 15 20:53:37.380154 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.380114 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a81a329c-36b2-4132-8e3e-1d057022f381-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrlq6\" (UID: \"a81a329c-36b2-4132-8e3e-1d057022f381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6" Jul 15 20:53:37.380332 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.380175 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwffw\" (UniqueName: \"kubernetes.io/projected/a81a329c-36b2-4132-8e3e-1d057022f381-kube-api-access-nwffw\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrlq6\" (UID: \"a81a329c-36b2-4132-8e3e-1d057022f381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6" Jul 15 20:53:37.380493 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.380469 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a81a329c-36b2-4132-8e3e-1d057022f381-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrlq6\" (UID: \"a81a329c-36b2-4132-8e3e-1d057022f381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6" Jul 15 20:53:37.391612 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.391582 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwffw\" (UniqueName: \"kubernetes.io/projected/a81a329c-36b2-4132-8e3e-1d057022f381-kube-api-access-nwffw\") pod \"cert-manager-operator-controller-manager-55c444bf86-nrlq6\" (UID: \"a81a329c-36b2-4132-8e3e-1d057022f381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6" Jul 15 20:53:37.496748 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.496669 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6" Jul 15 20:53:37.660298 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:37.660271 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6"] Jul 15 20:53:37.663197 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:53:37.663175 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81a329c_36b2_4132_8e3e_1d057022f381.slice/crio-646263420f104bc958c0407bf3420ed0372d7c50bb9ba0af9e9bf95c217a5306 WatchSource:0}: Error finding container 646263420f104bc958c0407bf3420ed0372d7c50bb9ba0af9e9bf95c217a5306: Status 404 returned error can't find the container with id 646263420f104bc958c0407bf3420ed0372d7c50bb9ba0af9e9bf95c217a5306 Jul 15 20:53:38.575574 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:38.575533 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6" event={"ID":"a81a329c-36b2-4132-8e3e-1d057022f381","Type":"ContainerStarted","Data":"646263420f104bc958c0407bf3420ed0372d7c50bb9ba0af9e9bf95c217a5306"} Jul 15 20:53:39.581946 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:39.581907 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6" event={"ID":"a81a329c-36b2-4132-8e3e-1d057022f381","Type":"ContainerStarted","Data":"643747d2eb5a28f44414df27d5a888921fc173c4143916a8289ef70cb14d3855"} Jul 15 20:53:39.607728 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:39.607682 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nrlq6" podStartSLOduration=0.904755404 podStartE2EDuration="2.607667936s" totalImagesPullingTime="1.702912532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:53:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:53:39.606301394 +0000 UTC m=+356.281790848" watchObservedRunningTime="2026-07-15 20:53:39.607667936 +0000 UTC m=+356.283157168" Jul 15 20:53:40.899187 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:40.899154 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl"] Jul 15 20:53:40.902728 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:40.902711 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:40.905537 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:40.905513 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t5nnx\"" Jul 15 20:53:40.905682 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:40.905550 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 20:53:40.906360 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:40.906341 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 20:53:40.919873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:40.919848 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl"] Jul 15 20:53:41.012185 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.012155 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:41.012351 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.012200 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pql5j\" (UniqueName: \"kubernetes.io/projected/90a03c79-a344-4e74-ba9d-315512de475a-kube-api-access-pql5j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:41.012351 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.012266 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:41.113424 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.113387 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:41.113603 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.113511 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:41.113603 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.113543 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pql5j\" (UniqueName: \"kubernetes.io/projected/90a03c79-a344-4e74-ba9d-315512de475a-kube-api-access-pql5j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:41.113862 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.113842 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:41.113907 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.113872 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:41.132526 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.132495 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pql5j\" (UniqueName: \"kubernetes.io/projected/90a03c79-a344-4e74-ba9d-315512de475a-kube-api-access-pql5j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:41.211396 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.211328 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:41.352311 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.352189 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl"] Jul 15 20:53:41.355279 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:53:41.355252 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a03c79_a344_4e74_ba9d_315512de475a.slice/crio-4b2630238445e5d6c40594ace0fbc3a8467bdaf94486fc45f43e4f0d405c23dd WatchSource:0}: Error finding container 4b2630238445e5d6c40594ace0fbc3a8467bdaf94486fc45f43e4f0d405c23dd: Status 404 returned error can't find the container with id 4b2630238445e5d6c40594ace0fbc3a8467bdaf94486fc45f43e4f0d405c23dd Jul 15 20:53:41.591433 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.591394 2553 generic.go:356] "Generic (PLEG): container finished" podID="90a03c79-a344-4e74-ba9d-315512de475a" containerID="1f303da5876f1968b8ec50e52f8f4e44e7e30cfd81a4f416cc961b752d118d53" exitCode=0 Jul 15 20:53:41.591433 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.591435 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" event={"ID":"90a03c79-a344-4e74-ba9d-315512de475a","Type":"ContainerDied","Data":"1f303da5876f1968b8ec50e52f8f4e44e7e30cfd81a4f416cc961b752d118d53"} Jul 15 20:53:41.591843 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:41.591476 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" event={"ID":"90a03c79-a344-4e74-ba9d-315512de475a","Type":"ContainerStarted","Data":"4b2630238445e5d6c40594ace0fbc3a8467bdaf94486fc45f43e4f0d405c23dd"} Jul 15 20:53:44.201073 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.201036 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq"] Jul 15 20:53:44.207852 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.207823 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq" Jul 15 20:53:44.210706 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.210679 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-k7tns\"" Jul 15 20:53:44.211291 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.211271 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 20:53:44.211382 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.211340 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 20:53:44.216926 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.216904 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq"] Jul 15 20:53:44.341492 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.341461 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7mt2\" (UniqueName: \"kubernetes.io/projected/2da0bf6e-d0e6-4554-9550-ad2ba0d5e922-kube-api-access-g7mt2\") pod \"cert-manager-cainjector-559cdd8c87-9zpxq\" (UID: \"2da0bf6e-d0e6-4554-9550-ad2ba0d5e922\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq" Jul 15 20:53:44.341675 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.341533 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2da0bf6e-d0e6-4554-9550-ad2ba0d5e922-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9zpxq\" (UID: \"2da0bf6e-d0e6-4554-9550-ad2ba0d5e922\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq" Jul 15 20:53:44.442910 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.442881 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7mt2\" (UniqueName: \"kubernetes.io/projected/2da0bf6e-d0e6-4554-9550-ad2ba0d5e922-kube-api-access-g7mt2\") pod \"cert-manager-cainjector-559cdd8c87-9zpxq\" (UID: \"2da0bf6e-d0e6-4554-9550-ad2ba0d5e922\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq" Jul 15 20:53:44.443099 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.442966 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2da0bf6e-d0e6-4554-9550-ad2ba0d5e922-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9zpxq\" (UID: \"2da0bf6e-d0e6-4554-9550-ad2ba0d5e922\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq" Jul 15 20:53:44.454674 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.454610 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2da0bf6e-d0e6-4554-9550-ad2ba0d5e922-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9zpxq\" (UID: \"2da0bf6e-d0e6-4554-9550-ad2ba0d5e922\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq" Jul 15 20:53:44.454967 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.454949 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7mt2\" (UniqueName: \"kubernetes.io/projected/2da0bf6e-d0e6-4554-9550-ad2ba0d5e922-kube-api-access-g7mt2\") pod \"cert-manager-cainjector-559cdd8c87-9zpxq\" (UID: \"2da0bf6e-d0e6-4554-9550-ad2ba0d5e922\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq" Jul 15 20:53:44.528514 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.528481 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq" Jul 15 20:53:44.910970 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:44.910948 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq"] Jul 15 20:53:44.914425 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:53:44.914402 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2da0bf6e_d0e6_4554_9550_ad2ba0d5e922.slice/crio-3a914f71b9e9120069f8dd08bb656082afd05810909d159816e057944d187dd1 WatchSource:0}: Error finding container 3a914f71b9e9120069f8dd08bb656082afd05810909d159816e057944d187dd1: Status 404 returned error can't find the container with id 3a914f71b9e9120069f8dd08bb656082afd05810909d159816e057944d187dd1 Jul 15 20:53:45.614617 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:45.614585 2553 generic.go:356] "Generic (PLEG): container finished" podID="90a03c79-a344-4e74-ba9d-315512de475a" containerID="190947ac664ceab387920fb998ff3ec8434bf020b8ca5f5af9f221ec9016a90c" exitCode=0 Jul 15 20:53:45.615105 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:45.614685 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" event={"ID":"90a03c79-a344-4e74-ba9d-315512de475a","Type":"ContainerDied","Data":"190947ac664ceab387920fb998ff3ec8434bf020b8ca5f5af9f221ec9016a90c"} Jul 15 20:53:45.616385 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:45.616278 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq" event={"ID":"2da0bf6e-d0e6-4554-9550-ad2ba0d5e922","Type":"ContainerStarted","Data":"3a914f71b9e9120069f8dd08bb656082afd05810909d159816e057944d187dd1"} Jul 15 20:53:46.624638 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:46.624600 2553 generic.go:356] "Generic (PLEG): container finished" podID="90a03c79-a344-4e74-ba9d-315512de475a" containerID="8f18f933220932cba836f146265e35070720977d70e7e8354b6120dc2e7165bc" exitCode=0 Jul 15 20:53:46.625078 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:46.624684 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" event={"ID":"90a03c79-a344-4e74-ba9d-315512de475a","Type":"ContainerDied","Data":"8f18f933220932cba836f146265e35070720977d70e7e8354b6120dc2e7165bc"} Jul 15 20:53:47.631169 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.631134 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq" event={"ID":"2da0bf6e-d0e6-4554-9550-ad2ba0d5e922","Type":"ContainerStarted","Data":"12550041abd69130c2d5d37d44399ed4ba6c0ad4ea73e8497764bbdd10b45548"} Jul 15 20:53:47.760340 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.760314 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:47.790066 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.790007 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9zpxq" podStartSLOduration=1.310651214 podStartE2EDuration="3.789985269s" totalImagesPullingTime="2.479334055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:53:47.654493298 +0000 UTC m=+364.329982536" watchObservedRunningTime="2026-07-15 20:53:47.789985269 +0000 UTC m=+364.465474503" Jul 15 20:53:47.873025 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.873000 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-bundle\") pod \"90a03c79-a344-4e74-ba9d-315512de475a\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " Jul 15 20:53:47.873025 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.873030 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pql5j\" (UniqueName: \"kubernetes.io/projected/90a03c79-a344-4e74-ba9d-315512de475a-kube-api-access-pql5j\") pod \"90a03c79-a344-4e74-ba9d-315512de475a\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " Jul 15 20:53:47.873266 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.873086 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-util\") pod \"90a03c79-a344-4e74-ba9d-315512de475a\" (UID: \"90a03c79-a344-4e74-ba9d-315512de475a\") " Jul 15 20:53:47.873475 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.873441 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-bundle" (OuterVolumeSpecName: "bundle") pod "90a03c79-a344-4e74-ba9d-315512de475a" (UID: "90a03c79-a344-4e74-ba9d-315512de475a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:53:47.875276 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.875239 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90a03c79-a344-4e74-ba9d-315512de475a-kube-api-access-pql5j" (OuterVolumeSpecName: "kube-api-access-pql5j") pod "90a03c79-a344-4e74-ba9d-315512de475a" (UID: "90a03c79-a344-4e74-ba9d-315512de475a"). InnerVolumeSpecName "kube-api-access-pql5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:53:47.878257 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.878231 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-util" (OuterVolumeSpecName: "util") pod "90a03c79-a344-4e74-ba9d-315512de475a" (UID: "90a03c79-a344-4e74-ba9d-315512de475a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:53:47.974184 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.974113 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-bundle\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:53:47.974184 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.974140 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pql5j\" (UniqueName: \"kubernetes.io/projected/90a03c79-a344-4e74-ba9d-315512de475a-kube-api-access-pql5j\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:53:47.974184 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:47.974155 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90a03c79-a344-4e74-ba9d-315512de475a-util\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:53:48.637213 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:48.637186 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" Jul 15 20:53:48.637603 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:48.637222 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjbmpl" event={"ID":"90a03c79-a344-4e74-ba9d-315512de475a","Type":"ContainerDied","Data":"4b2630238445e5d6c40594ace0fbc3a8467bdaf94486fc45f43e4f0d405c23dd"} Jul 15 20:53:48.637603 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:48.637272 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b2630238445e5d6c40594ace0fbc3a8467bdaf94486fc45f43e4f0d405c23dd" Jul 15 20:53:54.874569 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.874534 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb"] Jul 15 20:53:54.874956 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.874880 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a03c79-a344-4e74-ba9d-315512de475a" containerName="extract" Jul 15 20:53:54.874956 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.874892 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a03c79-a344-4e74-ba9d-315512de475a" containerName="extract" Jul 15 20:53:54.874956 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.874907 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a03c79-a344-4e74-ba9d-315512de475a" containerName="pull" Jul 15 20:53:54.874956 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.874912 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a03c79-a344-4e74-ba9d-315512de475a" containerName="pull" Jul 15 20:53:54.874956 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.874921 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90a03c79-a344-4e74-ba9d-315512de475a" containerName="util" Jul 15 20:53:54.874956 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.874926 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="90a03c79-a344-4e74-ba9d-315512de475a" containerName="util" Jul 15 20:53:54.875149 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.874993 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="90a03c79-a344-4e74-ba9d-315512de475a" containerName="extract" Jul 15 20:53:54.929521 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.929496 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb"] Jul 15 20:53:54.929676 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.929605 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb" Jul 15 20:53:54.935855 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.935824 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 20:53:54.936026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.936007 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vd2cz\"" Jul 15 20:53:54.936542 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:54.936521 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 20:53:55.033395 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:55.033364 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zb5d\" (UniqueName: \"kubernetes.io/projected/8c95bae5-64e1-4c85-bcce-d00d1325fc55-kube-api-access-8zb5d\") pod \"openshift-lws-operator-fd8ccff4c-9n9qb\" (UID: \"8c95bae5-64e1-4c85-bcce-d00d1325fc55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb" Jul 15 20:53:55.033550 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:55.033409 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c95bae5-64e1-4c85-bcce-d00d1325fc55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9n9qb\" (UID: \"8c95bae5-64e1-4c85-bcce-d00d1325fc55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb" Jul 15 20:53:55.134410 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:55.134264 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zb5d\" (UniqueName: \"kubernetes.io/projected/8c95bae5-64e1-4c85-bcce-d00d1325fc55-kube-api-access-8zb5d\") pod \"openshift-lws-operator-fd8ccff4c-9n9qb\" (UID: \"8c95bae5-64e1-4c85-bcce-d00d1325fc55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb" Jul 15 20:53:55.134573 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:55.134432 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c95bae5-64e1-4c85-bcce-d00d1325fc55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9n9qb\" (UID: \"8c95bae5-64e1-4c85-bcce-d00d1325fc55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb" Jul 15 20:53:55.134811 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:55.134793 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c95bae5-64e1-4c85-bcce-d00d1325fc55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9n9qb\" (UID: \"8c95bae5-64e1-4c85-bcce-d00d1325fc55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb" Jul 15 20:53:55.144908 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:55.144888 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zb5d\" (UniqueName: \"kubernetes.io/projected/8c95bae5-64e1-4c85-bcce-d00d1325fc55-kube-api-access-8zb5d\") pod \"openshift-lws-operator-fd8ccff4c-9n9qb\" (UID: \"8c95bae5-64e1-4c85-bcce-d00d1325fc55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb" Jul 15 20:53:55.239248 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:55.239217 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb" Jul 15 20:53:55.391431 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:55.391344 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb"] Jul 15 20:53:55.394416 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:53:55.394394 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c95bae5_64e1_4c85_bcce_d00d1325fc55.slice/crio-34a43cf9ca38f54d24f1dd92f9dfe7fc6faf7c6d3c5cf3872217bb3428fda801 WatchSource:0}: Error finding container 34a43cf9ca38f54d24f1dd92f9dfe7fc6faf7c6d3c5cf3872217bb3428fda801: Status 404 returned error can't find the container with id 34a43cf9ca38f54d24f1dd92f9dfe7fc6faf7c6d3c5cf3872217bb3428fda801 Jul 15 20:53:55.668945 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:55.668862 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb" event={"ID":"8c95bae5-64e1-4c85-bcce-d00d1325fc55","Type":"ContainerStarted","Data":"34a43cf9ca38f54d24f1dd92f9dfe7fc6faf7c6d3c5cf3872217bb3428fda801"} Jul 15 20:53:57.680402 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:57.680353 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb" event={"ID":"8c95bae5-64e1-4c85-bcce-d00d1325fc55","Type":"ContainerStarted","Data":"1cb428ad7ef2e1c1eefe32831a6d96fa1730bb32f3d5e9b636f37f355bd1b3da"} Jul 15 20:53:57.704422 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:53:57.704374 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9n9qb" podStartSLOduration=1.62606149 podStartE2EDuration="3.704355941s" totalImagesPullingTime="2.078294451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:53:57.702610991 +0000 UTC m=+374.378100223" watchObservedRunningTime="2026-07-15 20:53:57.704355941 +0000 UTC m=+374.379845174" Jul 15 20:54:00.215839 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.215797 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5"] Jul 15 20:54:00.240597 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.240574 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:00.240747 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.240574 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5"] Jul 15 20:54:00.243820 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.243796 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 20:54:00.243820 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.243793 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 20:54:00.244891 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.244867 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t5nnx\"" Jul 15 20:54:00.380720 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.380687 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzh97\" (UniqueName: \"kubernetes.io/projected/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-kube-api-access-vzh97\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:00.380903 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.380726 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:00.380903 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.380841 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:00.481470 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.481372 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:00.481622 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.481530 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzh97\" (UniqueName: \"kubernetes.io/projected/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-kube-api-access-vzh97\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:00.481622 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.481558 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:00.481812 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.481792 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:00.481869 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.481852 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:00.492615 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.492592 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzh97\" (UniqueName: \"kubernetes.io/projected/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-kube-api-access-vzh97\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:00.549630 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.549606 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:00.707919 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:00.707842 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5"] Jul 15 20:54:00.710135 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:54:00.710107 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a3cbf4_2941_43ad_a0b9_540fdeab584b.slice/crio-29bfbbe809781a126765c1f8577865c9c932be0727c8ac680cc0b8db594628c2 WatchSource:0}: Error finding container 29bfbbe809781a126765c1f8577865c9c932be0727c8ac680cc0b8db594628c2: Status 404 returned error can't find the container with id 29bfbbe809781a126765c1f8577865c9c932be0727c8ac680cc0b8db594628c2 Jul 15 20:54:01.699182 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:01.699149 2553 generic.go:356] "Generic (PLEG): container finished" podID="d2a3cbf4-2941-43ad-a0b9-540fdeab584b" containerID="9ca487ae39b3f5d5ec43fa257034b6bf1f60d4853ce1bb4a78fda27c3049dbfe" exitCode=0 Jul 15 20:54:01.699597 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:01.699197 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" event={"ID":"d2a3cbf4-2941-43ad-a0b9-540fdeab584b","Type":"ContainerDied","Data":"9ca487ae39b3f5d5ec43fa257034b6bf1f60d4853ce1bb4a78fda27c3049dbfe"} Jul 15 20:54:01.699597 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:01.699242 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" event={"ID":"d2a3cbf4-2941-43ad-a0b9-540fdeab584b","Type":"ContainerStarted","Data":"29bfbbe809781a126765c1f8577865c9c932be0727c8ac680cc0b8db594628c2"} Jul 15 20:54:02.704947 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:02.704864 2553 generic.go:356] "Generic (PLEG): container finished" podID="d2a3cbf4-2941-43ad-a0b9-540fdeab584b" containerID="449578d08a9b5ca74dab25c58905ac38d292912526a971b3833a720d9a6627cc" exitCode=0 Jul 15 20:54:02.704947 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:02.704940 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" event={"ID":"d2a3cbf4-2941-43ad-a0b9-540fdeab584b","Type":"ContainerDied","Data":"449578d08a9b5ca74dab25c58905ac38d292912526a971b3833a720d9a6627cc"} Jul 15 20:54:03.710739 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:03.710704 2553 generic.go:356] "Generic (PLEG): container finished" podID="d2a3cbf4-2941-43ad-a0b9-540fdeab584b" containerID="72a2244683a4b649331b6ab65f4de9d8564efcd1d97f04353c7b3cd53063c4cd" exitCode=0 Jul 15 20:54:03.711125 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:03.710786 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" event={"ID":"d2a3cbf4-2941-43ad-a0b9-540fdeab584b","Type":"ContainerDied","Data":"72a2244683a4b649331b6ab65f4de9d8564efcd1d97f04353c7b3cd53063c4cd"} Jul 15 20:54:04.832674 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:04.832651 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:05.023380 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.023299 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzh97\" (UniqueName: \"kubernetes.io/projected/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-kube-api-access-vzh97\") pod \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " Jul 15 20:54:05.023380 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.023338 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-util\") pod \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " Jul 15 20:54:05.023380 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.023372 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-bundle\") pod \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\" (UID: \"d2a3cbf4-2941-43ad-a0b9-540fdeab584b\") " Jul 15 20:54:05.024148 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.024117 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-bundle" (OuterVolumeSpecName: "bundle") pod "d2a3cbf4-2941-43ad-a0b9-540fdeab584b" (UID: "d2a3cbf4-2941-43ad-a0b9-540fdeab584b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:54:05.025699 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.025670 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-kube-api-access-vzh97" (OuterVolumeSpecName: "kube-api-access-vzh97") pod "d2a3cbf4-2941-43ad-a0b9-540fdeab584b" (UID: "d2a3cbf4-2941-43ad-a0b9-540fdeab584b"). InnerVolumeSpecName "kube-api-access-vzh97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:54:05.028843 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.028807 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-util" (OuterVolumeSpecName: "util") pod "d2a3cbf4-2941-43ad-a0b9-540fdeab584b" (UID: "d2a3cbf4-2941-43ad-a0b9-540fdeab584b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:54:05.124820 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.124754 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-bundle\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:54:05.124820 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.124817 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzh97\" (UniqueName: \"kubernetes.io/projected/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-kube-api-access-vzh97\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:54:05.124820 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.124827 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2a3cbf4-2941-43ad-a0b9-540fdeab584b-util\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:54:05.722102 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.722078 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" Jul 15 20:54:05.722281 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.722072 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxl6v5" event={"ID":"d2a3cbf4-2941-43ad-a0b9-540fdeab584b","Type":"ContainerDied","Data":"29bfbbe809781a126765c1f8577865c9c932be0727c8ac680cc0b8db594628c2"} Jul 15 20:54:05.722281 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:05.722196 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29bfbbe809781a126765c1f8577865c9c932be0727c8ac680cc0b8db594628c2" Jul 15 20:54:17.372133 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.372100 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp"] Jul 15 20:54:17.372603 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.372537 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a3cbf4-2941-43ad-a0b9-540fdeab584b" containerName="util" Jul 15 20:54:17.372603 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.372557 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a3cbf4-2941-43ad-a0b9-540fdeab584b" containerName="util" Jul 15 20:54:17.372603 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.372570 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a3cbf4-2941-43ad-a0b9-540fdeab584b" containerName="pull" Jul 15 20:54:17.372603 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.372576 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a3cbf4-2941-43ad-a0b9-540fdeab584b" containerName="pull" Jul 15 20:54:17.372603 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.372596 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a3cbf4-2941-43ad-a0b9-540fdeab584b" containerName="extract" Jul 15 20:54:17.372603 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.372606 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a3cbf4-2941-43ad-a0b9-540fdeab584b" containerName="extract" Jul 15 20:54:17.372890 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.372675 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a3cbf4-2941-43ad-a0b9-540fdeab584b" containerName="extract" Jul 15 20:54:17.375835 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.375808 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.417265 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.417244 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 20:54:17.417352 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.417307 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 20:54:17.418143 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.418118 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 20:54:17.419534 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.419515 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.419620 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.419554 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.419620 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.419576 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjgxs\" (UniqueName: \"kubernetes.io/projected/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-kube-api-access-wjgxs\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.419731 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.419668 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-tmp\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.419731 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.419723 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-manifests\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.428117 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.428096 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp"] Jul 15 20:54:17.429453 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.429440 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d2vtb\"" Jul 15 20:54:17.429743 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.429730 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 20:54:17.520712 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.520681 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-manifests\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.520896 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.520719 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.520896 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.520751 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.520896 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.520786 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjgxs\" (UniqueName: \"kubernetes.io/projected/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-kube-api-access-wjgxs\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.520896 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.520828 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-tmp\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.521138 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.521118 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-manifests\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.523160 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.523136 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-tmp\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.523257 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.523225 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.523346 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.523329 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.541676 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.541650 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjgxs\" (UniqueName: \"kubernetes.io/projected/8818ac7b-9194-4c12-bc03-b3a1e0c086c3-kube-api-access-wjgxs\") pod \"opendatahub-operator-controller-manager-b849856cb-7fcnp\" (UID: \"8818ac7b-9194-4c12-bc03-b3a1e0c086c3\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.685337 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.685247 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:17.850760 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:17.846682 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp"] Jul 15 20:54:17.850760 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:54:17.846593 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8818ac7b_9194_4c12_bc03_b3a1e0c086c3.slice/crio-c15f97089bbf4109ab47ef5a1eae59cbac83c50a78a9939e12fb5517bf5ab046 WatchSource:0}: Error finding container c15f97089bbf4109ab47ef5a1eae59cbac83c50a78a9939e12fb5517bf5ab046: Status 404 returned error can't find the container with id c15f97089bbf4109ab47ef5a1eae59cbac83c50a78a9939e12fb5517bf5ab046 Jul 15 20:54:18.784781 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:18.784728 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" event={"ID":"8818ac7b-9194-4c12-bc03-b3a1e0c086c3","Type":"ContainerStarted","Data":"c15f97089bbf4109ab47ef5a1eae59cbac83c50a78a9939e12fb5517bf5ab046"} Jul 15 20:54:21.802843 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:21.802802 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" event={"ID":"8818ac7b-9194-4c12-bc03-b3a1e0c086c3","Type":"ContainerStarted","Data":"c3259b3b56174dd6000115a16a527ed0b574c97671edd975642103a0042c352d"} Jul 15 20:54:22.809189 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:22.809158 2553 generic.go:356] "Generic (PLEG): container finished" podID="8818ac7b-9194-4c12-bc03-b3a1e0c086c3" containerID="c3259b3b56174dd6000115a16a527ed0b574c97671edd975642103a0042c352d" exitCode=0 Jul 15 20:54:22.809562 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:22.809243 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" event={"ID":"8818ac7b-9194-4c12-bc03-b3a1e0c086c3","Type":"ContainerDied","Data":"c3259b3b56174dd6000115a16a527ed0b574c97671edd975642103a0042c352d"} Jul 15 20:54:23.816283 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:23.816248 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" event={"ID":"8818ac7b-9194-4c12-bc03-b3a1e0c086c3","Type":"ContainerStarted","Data":"1c16b52cc2d8dd77892be54cd96354117b1d0c5844ea7d2d19496c0246d53ca2"} Jul 15 20:54:23.816657 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:23.816320 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:23.845268 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:23.845216 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" podStartSLOduration=2.370016415 podStartE2EDuration="6.845198363s" totalImagesPullingTime="3.393186163s" totalInitContainerRuntime="1.081995785s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:54:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:54:23.844028113 +0000 UTC m=+400.519517346" watchObservedRunningTime="2026-07-15 20:54:23.845198363 +0000 UTC m=+400.520687596" Jul 15 20:54:34.823199 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:34.823170 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-7fcnp" Jul 15 20:54:37.386324 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.386289 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-796df4448b-gqdqj"] Jul 15 20:54:37.389542 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.389525 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" Jul 15 20:54:37.395825 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.395784 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 20:54:37.396175 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.396148 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9s6ks\"" Jul 15 20:54:37.396291 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.396152 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 20:54:37.405453 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.405433 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-796df4448b-gqdqj"] Jul 15 20:54:37.497265 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.497230 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0-tmp\") pod \"kube-auth-proxy-796df4448b-gqdqj\" (UID: \"8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" Jul 15 20:54:37.497265 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.497267 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4622b\" (UniqueName: \"kubernetes.io/projected/8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0-kube-api-access-4622b\") pod \"kube-auth-proxy-796df4448b-gqdqj\" (UID: \"8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" Jul 15 20:54:37.497481 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.497293 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0-tls-certs\") pod \"kube-auth-proxy-796df4448b-gqdqj\" (UID: \"8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" Jul 15 20:54:37.598444 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.598407 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0-tls-certs\") pod \"kube-auth-proxy-796df4448b-gqdqj\" (UID: \"8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" Jul 15 20:54:37.598621 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.598484 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0-tmp\") pod \"kube-auth-proxy-796df4448b-gqdqj\" (UID: \"8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" Jul 15 20:54:37.598621 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.598504 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4622b\" (UniqueName: \"kubernetes.io/projected/8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0-kube-api-access-4622b\") pod \"kube-auth-proxy-796df4448b-gqdqj\" (UID: \"8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" Jul 15 20:54:37.600755 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.600723 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0-tmp\") pod \"kube-auth-proxy-796df4448b-gqdqj\" (UID: \"8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" Jul 15 20:54:37.600905 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.600888 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0-tls-certs\") pod \"kube-auth-proxy-796df4448b-gqdqj\" (UID: \"8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" Jul 15 20:54:37.623086 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.623057 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4622b\" (UniqueName: \"kubernetes.io/projected/8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0-kube-api-access-4622b\") pod \"kube-auth-proxy-796df4448b-gqdqj\" (UID: \"8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" Jul 15 20:54:37.698951 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.698861 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" Jul 15 20:54:37.769316 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.769270 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mw7zg"] Jul 15 20:54:37.772742 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.772717 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" Jul 15 20:54:37.778230 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.778213 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 15 20:54:37.778558 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.778538 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pbx84\"" Jul 15 20:54:37.784592 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.784542 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mw7zg"] Jul 15 20:54:37.845533 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.845508 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-796df4448b-gqdqj"] Jul 15 20:54:37.846867 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:54:37.846842 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a74c9ee_f3ac_48a8_8c90_f6f75bf8c9d0.slice/crio-214e5c1dd8bbfb859e4314ad1918abe6e965e439c2f675138333d08882de196e WatchSource:0}: Error finding container 214e5c1dd8bbfb859e4314ad1918abe6e965e439c2f675138333d08882de196e: Status 404 returned error can't find the container with id 214e5c1dd8bbfb859e4314ad1918abe6e965e439c2f675138333d08882de196e Jul 15 20:54:37.883908 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.882509 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" event={"ID":"8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0","Type":"ContainerStarted","Data":"214e5c1dd8bbfb859e4314ad1918abe6e965e439c2f675138333d08882de196e"} Jul 15 20:54:37.902865 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.902831 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m2n5\" (UniqueName: \"kubernetes.io/projected/17646633-3d76-4b92-b06b-3a345b34fbe8-kube-api-access-6m2n5\") pod \"odh-model-controller-7998c67dc4-mw7zg\" (UID: \"17646633-3d76-4b92-b06b-3a345b34fbe8\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" Jul 15 20:54:37.902992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:37.902937 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17646633-3d76-4b92-b06b-3a345b34fbe8-cert\") pod \"odh-model-controller-7998c67dc4-mw7zg\" (UID: \"17646633-3d76-4b92-b06b-3a345b34fbe8\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" Jul 15 20:54:38.003971 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.003892 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17646633-3d76-4b92-b06b-3a345b34fbe8-cert\") pod \"odh-model-controller-7998c67dc4-mw7zg\" (UID: \"17646633-3d76-4b92-b06b-3a345b34fbe8\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" Jul 15 20:54:38.003971 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.003955 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m2n5\" (UniqueName: \"kubernetes.io/projected/17646633-3d76-4b92-b06b-3a345b34fbe8-kube-api-access-6m2n5\") pod \"odh-model-controller-7998c67dc4-mw7zg\" (UID: \"17646633-3d76-4b92-b06b-3a345b34fbe8\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" Jul 15 20:54:38.004139 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:54:38.004043 2553 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 15 20:54:38.004139 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:54:38.004100 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17646633-3d76-4b92-b06b-3a345b34fbe8-cert podName:17646633-3d76-4b92-b06b-3a345b34fbe8 nodeName:}" failed. No retries permitted until 2026-07-15 20:54:38.504085247 +0000 UTC m=+415.179574458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/17646633-3d76-4b92-b06b-3a345b34fbe8-cert") pod "odh-model-controller-7998c67dc4-mw7zg" (UID: "17646633-3d76-4b92-b06b-3a345b34fbe8") : secret "odh-model-controller-webhook-cert" not found Jul 15 20:54:38.022380 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.022354 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m2n5\" (UniqueName: \"kubernetes.io/projected/17646633-3d76-4b92-b06b-3a345b34fbe8-kube-api-access-6m2n5\") pod \"odh-model-controller-7998c67dc4-mw7zg\" (UID: \"17646633-3d76-4b92-b06b-3a345b34fbe8\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" Jul 15 20:54:38.507901 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.507872 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17646633-3d76-4b92-b06b-3a345b34fbe8-cert\") pod \"odh-model-controller-7998c67dc4-mw7zg\" (UID: \"17646633-3d76-4b92-b06b-3a345b34fbe8\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" Jul 15 20:54:38.510198 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.510179 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17646633-3d76-4b92-b06b-3a345b34fbe8-cert\") pod \"odh-model-controller-7998c67dc4-mw7zg\" (UID: \"17646633-3d76-4b92-b06b-3a345b34fbe8\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" Jul 15 20:54:38.687133 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.687099 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" Jul 15 20:54:38.875184 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.875154 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mw7zg"] Jul 15 20:54:38.879210 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:54:38.879143 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17646633_3d76_4b92_b06b_3a345b34fbe8.slice/crio-7fe4281ee93e915fcb40bb540206933223aab755337c2414cf55bd95a5205336 WatchSource:0}: Error finding container 7fe4281ee93e915fcb40bb540206933223aab755337c2414cf55bd95a5205336: Status 404 returned error can't find the container with id 7fe4281ee93e915fcb40bb540206933223aab755337c2414cf55bd95a5205336 Jul 15 20:54:38.889665 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.889636 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" event={"ID":"17646633-3d76-4b92-b06b-3a345b34fbe8","Type":"ContainerStarted","Data":"7fe4281ee93e915fcb40bb540206933223aab755337c2414cf55bd95a5205336"} Jul 15 20:54:38.954419 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.954391 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rbxnr"] Jul 15 20:54:38.958994 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.958967 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" Jul 15 20:54:38.964672 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.964645 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-ztm7g\"" Jul 15 20:54:38.965795 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.965756 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 15 20:54:38.973047 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:38.973026 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rbxnr"] Jul 15 20:54:39.113005 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:39.112973 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhmmd\" (UniqueName: \"kubernetes.io/projected/7cd06da3-74c8-4e10-90c2-8e4f4e3073ef-kube-api-access-fhmmd\") pod \"model-serving-api-54d89bd5fc-rbxnr\" (UID: \"7cd06da3-74c8-4e10-90c2-8e4f4e3073ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" Jul 15 20:54:39.113201 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:39.113028 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd06da3-74c8-4e10-90c2-8e4f4e3073ef-tls-certs\") pod \"model-serving-api-54d89bd5fc-rbxnr\" (UID: \"7cd06da3-74c8-4e10-90c2-8e4f4e3073ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" Jul 15 20:54:39.214080 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:39.214046 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd06da3-74c8-4e10-90c2-8e4f4e3073ef-tls-certs\") pod \"model-serving-api-54d89bd5fc-rbxnr\" (UID: \"7cd06da3-74c8-4e10-90c2-8e4f4e3073ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" Jul 15 20:54:39.214248 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:39.214151 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhmmd\" (UniqueName: \"kubernetes.io/projected/7cd06da3-74c8-4e10-90c2-8e4f4e3073ef-kube-api-access-fhmmd\") pod \"model-serving-api-54d89bd5fc-rbxnr\" (UID: \"7cd06da3-74c8-4e10-90c2-8e4f4e3073ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" Jul 15 20:54:39.214248 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:54:39.214218 2553 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 15 20:54:39.214338 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:54:39.214298 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd06da3-74c8-4e10-90c2-8e4f4e3073ef-tls-certs podName:7cd06da3-74c8-4e10-90c2-8e4f4e3073ef nodeName:}" failed. No retries permitted until 2026-07-15 20:54:39.714277336 +0000 UTC m=+416.389766565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7cd06da3-74c8-4e10-90c2-8e4f4e3073ef-tls-certs") pod "model-serving-api-54d89bd5fc-rbxnr" (UID: "7cd06da3-74c8-4e10-90c2-8e4f4e3073ef") : secret "model-serving-api-tls" not found Jul 15 20:54:39.234069 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:39.234041 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhmmd\" (UniqueName: \"kubernetes.io/projected/7cd06da3-74c8-4e10-90c2-8e4f4e3073ef-kube-api-access-fhmmd\") pod \"model-serving-api-54d89bd5fc-rbxnr\" (UID: \"7cd06da3-74c8-4e10-90c2-8e4f4e3073ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" Jul 15 20:54:39.718984 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:39.718946 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd06da3-74c8-4e10-90c2-8e4f4e3073ef-tls-certs\") pod \"model-serving-api-54d89bd5fc-rbxnr\" (UID: \"7cd06da3-74c8-4e10-90c2-8e4f4e3073ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" Jul 15 20:54:39.722327 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:39.722297 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cd06da3-74c8-4e10-90c2-8e4f4e3073ef-tls-certs\") pod \"model-serving-api-54d89bd5fc-rbxnr\" (UID: \"7cd06da3-74c8-4e10-90c2-8e4f4e3073ef\") " pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" Jul 15 20:54:39.872215 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:39.872181 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" Jul 15 20:54:40.043309 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:40.043273 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rbxnr"] Jul 15 20:54:40.801140 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:54:40.801096 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd06da3_74c8_4e10_90c2_8e4f4e3073ef.slice/crio-b1323fd92db63b3766329bcbbad3ae6f8a262670c96f06d85116edb9403cf770 WatchSource:0}: Error finding container b1323fd92db63b3766329bcbbad3ae6f8a262670c96f06d85116edb9403cf770: Status 404 returned error can't find the container with id b1323fd92db63b3766329bcbbad3ae6f8a262670c96f06d85116edb9403cf770 Jul 15 20:54:40.910425 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:40.910388 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" event={"ID":"7cd06da3-74c8-4e10-90c2-8e4f4e3073ef","Type":"ContainerStarted","Data":"b1323fd92db63b3766329bcbbad3ae6f8a262670c96f06d85116edb9403cf770"} Jul 15 20:54:42.922017 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:42.921984 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" event={"ID":"17646633-3d76-4b92-b06b-3a345b34fbe8","Type":"ContainerStarted","Data":"966f4a56881aa9de1ec57443b01aa22aa1515a4a64f90b61fb7274dc14bb81ac"} Jul 15 20:54:42.922539 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:42.922185 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" Jul 15 20:54:42.923557 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:42.923533 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" event={"ID":"8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0","Type":"ContainerStarted","Data":"9906e8c2a956cfe0d5e9066fa669e5077a6ddedd3824ef2c9150669c61392c8d"} Jul 15 20:54:42.942367 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:42.942318 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" podStartSLOduration=2.695843209 podStartE2EDuration="5.94230271s" totalImagesPullingTime="3.246459501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:54:42.940689331 +0000 UTC m=+419.616178601" watchObservedRunningTime="2026-07-15 20:54:42.94230271 +0000 UTC m=+419.617791944" Jul 15 20:54:42.960951 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:42.960695 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-796df4448b-gqdqj" podStartSLOduration=1.7246497710000002 podStartE2EDuration="5.960677625s" totalImagesPullingTime="4.236027854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:54:42.958935618 +0000 UTC m=+419.634424852" watchObservedRunningTime="2026-07-15 20:54:42.960677625 +0000 UTC m=+419.636166859" Jul 15 20:54:43.929298 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:43.929258 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" event={"ID":"7cd06da3-74c8-4e10-90c2-8e4f4e3073ef","Type":"ContainerStarted","Data":"7a24163a08ac04c4080b24e8aa9d9c97a9792e810a69f12506a23165fa95804d"} Jul 15 20:54:43.929822 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:43.929442 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" Jul 15 20:54:43.956267 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:43.956214 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" podStartSLOduration=3.805098196 podStartE2EDuration="5.956201273s" totalImagesPullingTime="2.151103077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:54:43.953413373 +0000 UTC m=+420.628902605" watchObservedRunningTime="2026-07-15 20:54:43.956201273 +0000 UTC m=+420.631690506" Jul 15 20:54:44.781364 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.781328 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55"] Jul 15 20:54:44.786167 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.786148 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.793020 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.792954 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 20:54:44.793125 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.793103 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6lb96\"" Jul 15 20:54:44.829326 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.829297 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55"] Jul 15 20:54:44.868642 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.868604 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.868642 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.868643 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2kd8\" (UniqueName: \"kubernetes.io/projected/b7da38a6-c008-4417-a335-8b0fa45367be-kube-api-access-w2kd8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.868864 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.868704 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.868864 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.868789 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.868864 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.868841 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.868966 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.868869 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7da38a6-c008-4417-a335-8b0fa45367be-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.868966 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.868894 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.868966 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.868919 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7da38a6-c008-4417-a335-8b0fa45367be-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.868966 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.868955 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7da38a6-c008-4417-a335-8b0fa45367be-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.970153 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970124 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.970153 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970156 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2kd8\" (UniqueName: \"kubernetes.io/projected/b7da38a6-c008-4417-a335-8b0fa45367be-kube-api-access-w2kd8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.970675 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970189 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.970675 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970256 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.970675 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970284 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.970675 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970306 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7da38a6-c008-4417-a335-8b0fa45367be-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.970675 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970427 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.970675 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970478 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7da38a6-c008-4417-a335-8b0fa45367be-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.970675 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970508 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7da38a6-c008-4417-a335-8b0fa45367be-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.970675 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970635 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.971002 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970691 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.971002 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.970930 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.971091 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.971018 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.971186 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.971168 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7da38a6-c008-4417-a335-8b0fa45367be-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.972878 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.972855 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7da38a6-c008-4417-a335-8b0fa45367be-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.973071 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.973052 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7da38a6-c008-4417-a335-8b0fa45367be-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.986860 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.986839 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2kd8\" (UniqueName: \"kubernetes.io/projected/b7da38a6-c008-4417-a335-8b0fa45367be-kube-api-access-w2kd8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:44.988854 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:44.988838 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7da38a6-c008-4417-a335-8b0fa45367be-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46sl55\" (UID: \"b7da38a6-c008-4417-a335-8b0fa45367be\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:45.096516 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.096487 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:45.231873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.231837 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4"] Jul 15 20:54:45.236486 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.236466 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.238746 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.238710 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 20:54:45.238746 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.238735 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jd54v\"" Jul 15 20:54:45.238996 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.238711 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 20:54:45.239061 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.239047 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 20:54:45.248724 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.248687 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4"] Jul 15 20:54:45.252118 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.252065 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55"] Jul 15 20:54:45.255152 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:54:45.255130 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7da38a6_c008_4417_a335_8b0fa45367be.slice/crio-08f2d440a55f35b6fbbbb0384a27bfe2ec65490e4f6bd925cc0a84fe9eb8276b WatchSource:0}: Error finding container 08f2d440a55f35b6fbbbb0384a27bfe2ec65490e4f6bd925cc0a84fe9eb8276b: Status 404 returned error can't find the container with id 08f2d440a55f35b6fbbbb0384a27bfe2ec65490e4f6bd925cc0a84fe9eb8276b Jul 15 20:54:45.374892 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.374807 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a2ef5497-f363-494e-a99f-800727deec6b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.374892 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.374861 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j44sq\" (UniqueName: \"kubernetes.io/projected/a2ef5497-f363-494e-a99f-800727deec6b-kube-api-access-j44sq\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.375109 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.374907 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2ef5497-f363-494e-a99f-800727deec6b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.375109 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.374997 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a2ef5497-f363-494e-a99f-800727deec6b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.375109 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.375037 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a2ef5497-f363-494e-a99f-800727deec6b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.375109 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.375087 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a2ef5497-f363-494e-a99f-800727deec6b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.375302 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.375125 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2ef5497-f363-494e-a99f-800727deec6b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.475952 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.475919 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a2ef5497-f363-494e-a99f-800727deec6b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.475952 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.475955 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2ef5497-f363-494e-a99f-800727deec6b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.476157 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.475993 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a2ef5497-f363-494e-a99f-800727deec6b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.476157 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.476014 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j44sq\" (UniqueName: \"kubernetes.io/projected/a2ef5497-f363-494e-a99f-800727deec6b-kube-api-access-j44sq\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.476157 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.476045 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2ef5497-f363-494e-a99f-800727deec6b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.476157 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.476082 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a2ef5497-f363-494e-a99f-800727deec6b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.476157 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.476106 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a2ef5497-f363-494e-a99f-800727deec6b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.477036 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.477009 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a2ef5497-f363-494e-a99f-800727deec6b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.478963 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.478940 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a2ef5497-f363-494e-a99f-800727deec6b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.479079 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.478990 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2ef5497-f363-494e-a99f-800727deec6b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.479079 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.479015 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a2ef5497-f363-494e-a99f-800727deec6b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.479174 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.479143 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a2ef5497-f363-494e-a99f-800727deec6b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.490904 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.490877 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j44sq\" (UniqueName: \"kubernetes.io/projected/a2ef5497-f363-494e-a99f-800727deec6b-kube-api-access-j44sq\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.493185 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.493167 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2ef5497-f363-494e-a99f-800727deec6b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-b8vg4\" (UID: \"a2ef5497-f363-494e-a99f-800727deec6b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.547055 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.547014 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:45.695067 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.695039 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4"] Jul 15 20:54:45.940308 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.940210 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" event={"ID":"b7da38a6-c008-4417-a335-8b0fa45367be","Type":"ContainerStarted","Data":"08f2d440a55f35b6fbbbb0384a27bfe2ec65490e4f6bd925cc0a84fe9eb8276b"} Jul 15 20:54:45.941445 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:45.941416 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" event={"ID":"a2ef5497-f363-494e-a99f-800727deec6b","Type":"ContainerStarted","Data":"d9611e96c2d8ece17d6ddf24e441b5656b5c1332c343bf482a8b8a3cb201b562"} Jul 15 20:54:49.283994 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:49.283955 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 20:54:49.284275 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:49.284030 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 20:54:49.287607 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:49.287577 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 20:54:49.287693 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:49.287639 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 20:54:49.287693 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:49.287665 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 20:54:49.965601 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:49.965556 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" event={"ID":"b7da38a6-c008-4417-a335-8b0fa45367be","Type":"ContainerStarted","Data":"3a36710acff5fc777de1132f4ef684508fa5152cc7115dc55a1b7e1e10822c67"} Jul 15 20:54:49.967028 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:49.967006 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" event={"ID":"a2ef5497-f363-494e-a99f-800727deec6b","Type":"ContainerStarted","Data":"14a7f2de53dae15fb953cf649db4048d75ad02b92fa049fad26cf30fc988dd3e"} Jul 15 20:54:49.967155 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:49.967141 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:50.017190 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:50.017143 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" podStartSLOduration=1.9870292680000001 podStartE2EDuration="6.017126634s" totalImagesPullingTime="4.030097366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:54:50.015351065 +0000 UTC m=+426.690840298" watchObservedRunningTime="2026-07-15 20:54:50.017126634 +0000 UTC m=+426.692615866" Jul 15 20:54:50.071902 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:50.071851 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" podStartSLOduration=1.49409049 podStartE2EDuration="5.071834241s" totalImagesPullingTime="3.577743751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:54:50.06602782 +0000 UTC m=+426.741517054" watchObservedRunningTime="2026-07-15 20:54:50.071834241 +0000 UTC m=+426.747323473" Jul 15 20:54:50.097321 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:50.097287 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:50.102426 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:50.102403 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:50.972216 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:50.972185 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:50.973099 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:50.973076 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46sl55" Jul 15 20:54:50.973908 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:50.973889 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-b8vg4" Jul 15 20:54:53.931443 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:53.931404 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mw7zg" Jul 15 20:54:54.938355 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:54:54.938327 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-rbxnr" Jul 15 20:55:38.342469 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.342433 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5r86w"] Jul 15 20:55:38.346457 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.346432 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5r86w" Jul 15 20:55:38.347122 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.347089 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gprh\" (UniqueName: \"kubernetes.io/projected/dade32fb-f6ec-4a66-91a2-6cf9af5b82f8-kube-api-access-2gprh\") pod \"kuadrant-operator-catalog-5r86w\" (UID: \"dade32fb-f6ec-4a66-91a2-6cf9af5b82f8\") " pod="kuadrant-system/kuadrant-operator-catalog-5r86w" Jul 15 20:55:38.349405 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.349382 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 20:55:38.350955 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.350936 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 20:55:38.352451 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.352427 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6ztg9\"" Jul 15 20:55:38.361722 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.361694 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5r86w"] Jul 15 20:55:38.447584 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.447545 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gprh\" (UniqueName: \"kubernetes.io/projected/dade32fb-f6ec-4a66-91a2-6cf9af5b82f8-kube-api-access-2gprh\") pod \"kuadrant-operator-catalog-5r86w\" (UID: \"dade32fb-f6ec-4a66-91a2-6cf9af5b82f8\") " pod="kuadrant-system/kuadrant-operator-catalog-5r86w" Jul 15 20:55:38.459873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.459841 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gprh\" (UniqueName: \"kubernetes.io/projected/dade32fb-f6ec-4a66-91a2-6cf9af5b82f8-kube-api-access-2gprh\") pod \"kuadrant-operator-catalog-5r86w\" (UID: \"dade32fb-f6ec-4a66-91a2-6cf9af5b82f8\") " pod="kuadrant-system/kuadrant-operator-catalog-5r86w" Jul 15 20:55:38.657023 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.656926 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5r86w" Jul 15 20:55:38.680497 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.680466 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5r86w"] Jul 15 20:55:38.816996 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:38.816960 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5r86w"] Jul 15 20:55:38.819782 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:55:38.819742 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddade32fb_f6ec_4a66_91a2_6cf9af5b82f8.slice/crio-cc67d19719e261e72e20621ac32647900c03ad5cef5ffb01de59265061bd39e5 WatchSource:0}: Error finding container cc67d19719e261e72e20621ac32647900c03ad5cef5ffb01de59265061bd39e5: Status 404 returned error can't find the container with id cc67d19719e261e72e20621ac32647900c03ad5cef5ffb01de59265061bd39e5 Jul 15 20:55:39.203992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:39.203958 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5r86w" event={"ID":"dade32fb-f6ec-4a66-91a2-6cf9af5b82f8","Type":"ContainerStarted","Data":"cc67d19719e261e72e20621ac32647900c03ad5cef5ffb01de59265061bd39e5"} Jul 15 20:55:41.216322 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:41.216228 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5r86w" event={"ID":"dade32fb-f6ec-4a66-91a2-6cf9af5b82f8","Type":"ContainerStarted","Data":"97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50"} Jul 15 20:55:41.216322 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:41.216285 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5r86w" podUID="dade32fb-f6ec-4a66-91a2-6cf9af5b82f8" containerName="registry-server" containerID="cri-o://97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50" gracePeriod=2 Jul 15 20:55:41.253302 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:41.253255 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5r86w" podStartSLOduration=1.140091792 podStartE2EDuration="3.253236741s" totalImagesPullingTime="2.113144949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:55:41.253089166 +0000 UTC m=+477.928578401" watchObservedRunningTime="2026-07-15 20:55:41.253236741 +0000 UTC m=+477.928725973" Jul 15 20:55:41.468327 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:41.468265 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5r86w" Jul 15 20:55:41.470122 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:41.470101 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gprh\" (UniqueName: \"kubernetes.io/projected/dade32fb-f6ec-4a66-91a2-6cf9af5b82f8-kube-api-access-2gprh\") pod \"dade32fb-f6ec-4a66-91a2-6cf9af5b82f8\" (UID: \"dade32fb-f6ec-4a66-91a2-6cf9af5b82f8\") " Jul 15 20:55:41.472221 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:41.472192 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dade32fb-f6ec-4a66-91a2-6cf9af5b82f8-kube-api-access-2gprh" (OuterVolumeSpecName: "kube-api-access-2gprh") pod "dade32fb-f6ec-4a66-91a2-6cf9af5b82f8" (UID: "dade32fb-f6ec-4a66-91a2-6cf9af5b82f8"). InnerVolumeSpecName "kube-api-access-2gprh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:55:41.571400 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:41.571371 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gprh\" (UniqueName: \"kubernetes.io/projected/dade32fb-f6ec-4a66-91a2-6cf9af5b82f8-kube-api-access-2gprh\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:42.223213 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:42.223133 2553 generic.go:356] "Generic (PLEG): container finished" podID="dade32fb-f6ec-4a66-91a2-6cf9af5b82f8" containerID="97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50" exitCode=0 Jul 15 20:55:42.223213 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:42.223173 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5r86w" Jul 15 20:55:42.223213 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:42.223177 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5r86w" event={"ID":"dade32fb-f6ec-4a66-91a2-6cf9af5b82f8","Type":"ContainerDied","Data":"97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50"} Jul 15 20:55:42.223703 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:42.223233 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5r86w" event={"ID":"dade32fb-f6ec-4a66-91a2-6cf9af5b82f8","Type":"ContainerDied","Data":"cc67d19719e261e72e20621ac32647900c03ad5cef5ffb01de59265061bd39e5"} Jul 15 20:55:42.223703 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:42.223262 2553 scope.go:117] "RemoveContainer" containerID="97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50" Jul 15 20:55:42.232230 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:42.232211 2553 scope.go:117] "RemoveContainer" containerID="97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50" Jul 15 20:55:42.232472 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:55:42.232450 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50\": container with ID starting with 97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50 not found: ID does not exist" containerID="97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50" Jul 15 20:55:42.232522 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:42.232482 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50"} err="failed to get container status \"97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50\": rpc error: code = NotFound desc = could not find container \"97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50\": container with ID starting with 97fd8d0dfd11ba4e3f2e1244a2af184a85eca96e232b50f931bfcc42a5470e50 not found: ID does not exist" Jul 15 20:55:42.241749 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:42.241718 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5r86w"] Jul 15 20:55:42.245979 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:42.245956 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5r86w"] Jul 15 20:55:43.882176 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:43.882145 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dade32fb-f6ec-4a66-91a2-6cf9af5b82f8" path="/var/lib/kubelet/pods/dade32fb-f6ec-4a66-91a2-6cf9af5b82f8/volumes" Jul 15 20:55:53.780417 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.780377 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7"] Jul 15 20:55:53.780965 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.780946 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dade32fb-f6ec-4a66-91a2-6cf9af5b82f8" containerName="registry-server" Jul 15 20:55:53.781045 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.780968 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="dade32fb-f6ec-4a66-91a2-6cf9af5b82f8" containerName="registry-server" Jul 15 20:55:53.781102 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.781054 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="dade32fb-f6ec-4a66-91a2-6cf9af5b82f8" containerName="registry-server" Jul 15 20:55:53.785949 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.785929 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:53.788726 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.788701 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 20:55:53.788726 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.788715 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vb2db\"" Jul 15 20:55:53.788890 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.788715 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 20:55:53.795113 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.795090 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7"] Jul 15 20:55:53.874281 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.874251 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5pzl\" (UniqueName: \"kubernetes.io/projected/06141e22-5910-4e62-8b08-881f35c37118-kube-api-access-x5pzl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:53.874444 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.874291 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:53.874444 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.874341 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:53.974743 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.974711 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5pzl\" (UniqueName: \"kubernetes.io/projected/06141e22-5910-4e62-8b08-881f35c37118-kube-api-access-x5pzl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:53.974920 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.974752 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:53.974920 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.974795 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:53.975103 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.975083 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:53.975143 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.975129 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:53.984530 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:53.984496 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5pzl\" (UniqueName: \"kubernetes.io/projected/06141e22-5910-4e62-8b08-881f35c37118-kube-api-access-x5pzl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:54.095447 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.095411 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:54.171233 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.171199 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7"] Jul 15 20:55:54.176053 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.176020 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:54.187649 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.187616 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7"] Jul 15 20:55:54.238365 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.238343 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7"] Jul 15 20:55:54.240231 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:55:54.240203 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06141e22_5910_4e62_8b08_881f35c37118.slice/crio-c1afc837281d5d3bc290c218bd389d1504a5191c0b3d3a0e115bdb3f53c1a7ca WatchSource:0}: Error finding container c1afc837281d5d3bc290c218bd389d1504a5191c0b3d3a0e115bdb3f53c1a7ca: Status 404 returned error can't find the container with id c1afc837281d5d3bc290c218bd389d1504a5191c0b3d3a0e115bdb3f53c1a7ca Jul 15 20:55:54.276718 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.276689 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:54.276865 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.276728 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:54.276865 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.276760 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc9k2\" (UniqueName: \"kubernetes.io/projected/a60ae8f1-2683-476d-92e6-99687716987d-kube-api-access-jc9k2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:54.286305 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.286279 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" event={"ID":"06141e22-5910-4e62-8b08-881f35c37118","Type":"ContainerStarted","Data":"c1afc837281d5d3bc290c218bd389d1504a5191c0b3d3a0e115bdb3f53c1a7ca"} Jul 15 20:55:54.378047 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.377963 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9k2\" (UniqueName: \"kubernetes.io/projected/a60ae8f1-2683-476d-92e6-99687716987d-kube-api-access-jc9k2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:54.378229 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.378054 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:54.378229 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.378074 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:54.378439 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.378422 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:54.378484 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.378459 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:54.389183 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.389158 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc9k2\" (UniqueName: \"kubernetes.io/projected/a60ae8f1-2683-476d-92e6-99687716987d-kube-api-access-jc9k2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:54.487586 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.487554 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:54.632675 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.632646 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7"] Jul 15 20:55:54.633843 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:55:54.633815 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60ae8f1_2683_476d_92e6_99687716987d.slice/crio-d4eff77fffd83caffb07f0a8ed0c0f3546d3c8c6ca0b93769225a51a4e5e9031 WatchSource:0}: Error finding container d4eff77fffd83caffb07f0a8ed0c0f3546d3c8c6ca0b93769225a51a4e5e9031: Status 404 returned error can't find the container with id d4eff77fffd83caffb07f0a8ed0c0f3546d3c8c6ca0b93769225a51a4e5e9031 Jul 15 20:55:54.822562 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.822521 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6"] Jul 15 20:55:54.826277 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.826255 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:54.838566 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.838538 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6"] Jul 15 20:55:54.883341 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.883248 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wzpd\" (UniqueName: \"kubernetes.io/projected/8ceb52eb-0882-4044-aa5c-ff123f10507e-kube-api-access-8wzpd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:54.883489 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.883341 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:54.883489 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.883398 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:54.984122 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.984093 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:54.984277 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.984161 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wzpd\" (UniqueName: \"kubernetes.io/projected/8ceb52eb-0882-4044-aa5c-ff123f10507e-kube-api-access-8wzpd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:54.984277 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.984204 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:54.984571 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.984552 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:54.984571 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.984561 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:54.995290 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:54.995258 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wzpd\" (UniqueName: \"kubernetes.io/projected/8ceb52eb-0882-4044-aa5c-ff123f10507e-kube-api-access-8wzpd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:55.134523 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.134420 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:55.273684 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.273658 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6"] Jul 15 20:55:55.275876 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:55:55.275850 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ceb52eb_0882_4044_aa5c_ff123f10507e.slice/crio-3e6d24cd9bff76afc9943c1b87e24d57bef2425e7499de747725a36fb801dca9 WatchSource:0}: Error finding container 3e6d24cd9bff76afc9943c1b87e24d57bef2425e7499de747725a36fb801dca9: Status 404 returned error can't find the container with id 3e6d24cd9bff76afc9943c1b87e24d57bef2425e7499de747725a36fb801dca9 Jul 15 20:55:55.293723 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.293702 2553 generic.go:356] "Generic (PLEG): container finished" podID="06141e22-5910-4e62-8b08-881f35c37118" containerID="9a4d27bd990bc9ef5cb4ac93768dc87384c482e411ba27db30180ce1aac1da55" exitCode=0 Jul 15 20:55:55.293812 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.293790 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" event={"ID":"06141e22-5910-4e62-8b08-881f35c37118","Type":"ContainerDied","Data":"9a4d27bd990bc9ef5cb4ac93768dc87384c482e411ba27db30180ce1aac1da55"} Jul 15 20:55:55.295159 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.295136 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" event={"ID":"8ceb52eb-0882-4044-aa5c-ff123f10507e","Type":"ContainerStarted","Data":"3e6d24cd9bff76afc9943c1b87e24d57bef2425e7499de747725a36fb801dca9"} Jul 15 20:55:55.297152 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.296918 2553 generic.go:356] "Generic (PLEG): container finished" podID="a60ae8f1-2683-476d-92e6-99687716987d" containerID="b5f7a9fe8224d3fb9339effdcf53c280f737dd9d10351370711d21cda184179c" exitCode=0 Jul 15 20:55:55.297152 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.296974 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" event={"ID":"a60ae8f1-2683-476d-92e6-99687716987d","Type":"ContainerDied","Data":"b5f7a9fe8224d3fb9339effdcf53c280f737dd9d10351370711d21cda184179c"} Jul 15 20:55:55.297152 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.297011 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" event={"ID":"a60ae8f1-2683-476d-92e6-99687716987d","Type":"ContainerStarted","Data":"d4eff77fffd83caffb07f0a8ed0c0f3546d3c8c6ca0b93769225a51a4e5e9031"} Jul 15 20:55:55.366164 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.366121 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf"] Jul 15 20:55:55.369917 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.369892 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:55.380727 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.380700 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf"] Jul 15 20:55:55.488006 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.487919 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:55.488006 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.487954 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvp6\" (UniqueName: \"kubernetes.io/projected/e108a811-f795-41aa-9549-e8ed51d7c6ee-kube-api-access-khvp6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:55.488174 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.488032 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:55.589333 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.589301 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:55.589569 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.589366 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:55.589569 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.589388 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khvp6\" (UniqueName: \"kubernetes.io/projected/e108a811-f795-41aa-9549-e8ed51d7c6ee-kube-api-access-khvp6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:55.589730 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.589668 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:55.589730 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.589706 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:55.599335 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.599314 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvp6\" (UniqueName: \"kubernetes.io/projected/e108a811-f795-41aa-9549-e8ed51d7c6ee-kube-api-access-khvp6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:55.725529 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.725495 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:55.872480 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:55.872449 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf"] Jul 15 20:55:55.875583 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:55:55.875553 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode108a811_f795_41aa_9549_e8ed51d7c6ee.slice/crio-6d917c3c131d7a3bab40373fec2c8c8ab34d829d9e2df9d0c7e6e534ac1e2fd5 WatchSource:0}: Error finding container 6d917c3c131d7a3bab40373fec2c8c8ab34d829d9e2df9d0c7e6e534ac1e2fd5: Status 404 returned error can't find the container with id 6d917c3c131d7a3bab40373fec2c8c8ab34d829d9e2df9d0c7e6e534ac1e2fd5 Jul 15 20:55:56.303665 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:56.303628 2553 generic.go:356] "Generic (PLEG): container finished" podID="8ceb52eb-0882-4044-aa5c-ff123f10507e" containerID="d7e06a5a06ae050461af48214df4b792f3293726cebed8cd6e03b2e6a2a4390e" exitCode=0 Jul 15 20:55:56.303871 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:56.303681 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" event={"ID":"8ceb52eb-0882-4044-aa5c-ff123f10507e","Type":"ContainerDied","Data":"d7e06a5a06ae050461af48214df4b792f3293726cebed8cd6e03b2e6a2a4390e"} Jul 15 20:55:56.305345 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:56.305321 2553 generic.go:356] "Generic (PLEG): container finished" podID="e108a811-f795-41aa-9549-e8ed51d7c6ee" containerID="7b685aca087265ac0ea22d2d4670970122cedee4f0a35318282aef97e74f7f1a" exitCode=0 Jul 15 20:55:56.305458 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:56.305398 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" event={"ID":"e108a811-f795-41aa-9549-e8ed51d7c6ee","Type":"ContainerDied","Data":"7b685aca087265ac0ea22d2d4670970122cedee4f0a35318282aef97e74f7f1a"} Jul 15 20:55:56.305458 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:56.305440 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" event={"ID":"e108a811-f795-41aa-9549-e8ed51d7c6ee","Type":"ContainerStarted","Data":"6d917c3c131d7a3bab40373fec2c8c8ab34d829d9e2df9d0c7e6e534ac1e2fd5"} Jul 15 20:55:56.307385 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:56.307331 2553 generic.go:356] "Generic (PLEG): container finished" podID="06141e22-5910-4e62-8b08-881f35c37118" containerID="8e256afea62201e8c59d549f51614163df97d86720b9f0f525beb386b9f7cad6" exitCode=0 Jul 15 20:55:56.307385 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:56.307370 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" event={"ID":"06141e22-5910-4e62-8b08-881f35c37118","Type":"ContainerDied","Data":"8e256afea62201e8c59d549f51614163df97d86720b9f0f525beb386b9f7cad6"} Jul 15 20:55:57.314569 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:57.314534 2553 generic.go:356] "Generic (PLEG): container finished" podID="a60ae8f1-2683-476d-92e6-99687716987d" containerID="cc87ecdd070feb58381da1b3182c3492818b2c48afb4bb24155b615477652535" exitCode=0 Jul 15 20:55:57.315026 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:57.314565 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" event={"ID":"a60ae8f1-2683-476d-92e6-99687716987d","Type":"ContainerDied","Data":"cc87ecdd070feb58381da1b3182c3492818b2c48afb4bb24155b615477652535"} Jul 15 20:55:57.317197 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:57.317172 2553 generic.go:356] "Generic (PLEG): container finished" podID="06141e22-5910-4e62-8b08-881f35c37118" containerID="23bb03a7aeb72d958270998dcae9aa89d62055344318f11ed0ed561cebb336a0" exitCode=0 Jul 15 20:55:57.317328 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:57.317258 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" event={"ID":"06141e22-5910-4e62-8b08-881f35c37118","Type":"ContainerDied","Data":"23bb03a7aeb72d958270998dcae9aa89d62055344318f11ed0ed561cebb336a0"} Jul 15 20:55:57.319283 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:57.319263 2553 generic.go:356] "Generic (PLEG): container finished" podID="8ceb52eb-0882-4044-aa5c-ff123f10507e" containerID="a7fc7b1a56aef761e1fd85f37255b6634946a762973ee22e2696a70e43b7b1fd" exitCode=0 Jul 15 20:55:57.319388 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:57.319334 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" event={"ID":"8ceb52eb-0882-4044-aa5c-ff123f10507e","Type":"ContainerDied","Data":"a7fc7b1a56aef761e1fd85f37255b6634946a762973ee22e2696a70e43b7b1fd"} Jul 15 20:55:57.321462 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:57.321436 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" event={"ID":"e108a811-f795-41aa-9549-e8ed51d7c6ee","Type":"ContainerStarted","Data":"63e66f78df0f36f030d5053e72713b2090ed718ba914065429d7a3290460ae28"} Jul 15 20:55:58.328633 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.328604 2553 generic.go:356] "Generic (PLEG): container finished" podID="8ceb52eb-0882-4044-aa5c-ff123f10507e" containerID="d6c05b9e198b5922d628021096ad84136b71255fd592359572cc8e5ebc5edd47" exitCode=0 Jul 15 20:55:58.329075 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.328685 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" event={"ID":"8ceb52eb-0882-4044-aa5c-ff123f10507e","Type":"ContainerDied","Data":"d6c05b9e198b5922d628021096ad84136b71255fd592359572cc8e5ebc5edd47"} Jul 15 20:55:58.330817 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.330797 2553 generic.go:356] "Generic (PLEG): container finished" podID="e108a811-f795-41aa-9549-e8ed51d7c6ee" containerID="63e66f78df0f36f030d5053e72713b2090ed718ba914065429d7a3290460ae28" exitCode=0 Jul 15 20:55:58.330817 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.330817 2553 generic.go:356] "Generic (PLEG): container finished" podID="e108a811-f795-41aa-9549-e8ed51d7c6ee" containerID="6280dc7daebcefc39372ce3d1a12a5e230bf211c167d9fba677403d012509fa0" exitCode=0 Jul 15 20:55:58.330938 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.330877 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" event={"ID":"e108a811-f795-41aa-9549-e8ed51d7c6ee","Type":"ContainerDied","Data":"63e66f78df0f36f030d5053e72713b2090ed718ba914065429d7a3290460ae28"} Jul 15 20:55:58.330938 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.330918 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" event={"ID":"e108a811-f795-41aa-9549-e8ed51d7c6ee","Type":"ContainerDied","Data":"6280dc7daebcefc39372ce3d1a12a5e230bf211c167d9fba677403d012509fa0"} Jul 15 20:55:58.332914 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.332897 2553 generic.go:356] "Generic (PLEG): container finished" podID="a60ae8f1-2683-476d-92e6-99687716987d" containerID="919ca4a62840c64e2f819576af73aea73b35ad568523208c59165e6d754e27e2" exitCode=0 Jul 15 20:55:58.333002 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.332963 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" event={"ID":"a60ae8f1-2683-476d-92e6-99687716987d","Type":"ContainerDied","Data":"919ca4a62840c64e2f819576af73aea73b35ad568523208c59165e6d754e27e2"} Jul 15 20:55:58.466206 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.466178 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:58.520060 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.520030 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-util\") pod \"06141e22-5910-4e62-8b08-881f35c37118\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " Jul 15 20:55:58.520194 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.520080 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-bundle\") pod \"06141e22-5910-4e62-8b08-881f35c37118\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " Jul 15 20:55:58.520194 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.520112 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5pzl\" (UniqueName: \"kubernetes.io/projected/06141e22-5910-4e62-8b08-881f35c37118-kube-api-access-x5pzl\") pod \"06141e22-5910-4e62-8b08-881f35c37118\" (UID: \"06141e22-5910-4e62-8b08-881f35c37118\") " Jul 15 20:55:58.520582 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.520539 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-bundle" (OuterVolumeSpecName: "bundle") pod "06141e22-5910-4e62-8b08-881f35c37118" (UID: "06141e22-5910-4e62-8b08-881f35c37118"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:55:58.522273 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.522249 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06141e22-5910-4e62-8b08-881f35c37118-kube-api-access-x5pzl" (OuterVolumeSpecName: "kube-api-access-x5pzl") pod "06141e22-5910-4e62-8b08-881f35c37118" (UID: "06141e22-5910-4e62-8b08-881f35c37118"). InnerVolumeSpecName "kube-api-access-x5pzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:55:58.527381 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.527355 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-util" (OuterVolumeSpecName: "util") pod "06141e22-5910-4e62-8b08-881f35c37118" (UID: "06141e22-5910-4e62-8b08-881f35c37118"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:55:58.621199 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.621116 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-util\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:58.621199 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.621143 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06141e22-5910-4e62-8b08-881f35c37118-bundle\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:58.621199 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:58.621152 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5pzl\" (UniqueName: \"kubernetes.io/projected/06141e22-5910-4e62-8b08-881f35c37118-kube-api-access-x5pzl\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:59.086936 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.086900 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d794d6d77-9vvs4"] Jul 15 20:55:59.087653 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.087631 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06141e22-5910-4e62-8b08-881f35c37118" containerName="extract" Jul 15 20:55:59.087762 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.087752 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="06141e22-5910-4e62-8b08-881f35c37118" containerName="extract" Jul 15 20:55:59.087935 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.087921 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06141e22-5910-4e62-8b08-881f35c37118" containerName="util" Jul 15 20:55:59.088019 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.088008 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="06141e22-5910-4e62-8b08-881f35c37118" containerName="util" Jul 15 20:55:59.088094 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.088077 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06141e22-5910-4e62-8b08-881f35c37118" containerName="pull" Jul 15 20:55:59.088157 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.088095 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="06141e22-5910-4e62-8b08-881f35c37118" containerName="pull" Jul 15 20:55:59.088233 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.088221 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="06141e22-5910-4e62-8b08-881f35c37118" containerName="extract" Jul 15 20:55:59.092192 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.092170 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.094684 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.094661 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 20:55:59.094802 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.094698 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nmh6g\"" Jul 15 20:55:59.094802 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.094718 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 20:55:59.094802 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.094741 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 20:55:59.095402 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.095386 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 20:55:59.095563 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.095547 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 20:55:59.095639 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.095581 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 20:55:59.095764 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.095743 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 20:55:59.108918 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.108889 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d794d6d77-9vvs4"] Jul 15 20:55:59.110546 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.110520 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 20:55:59.227605 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.227572 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-console-config\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.227844 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.227620 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-service-ca\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.227844 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.227640 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-oauth-serving-cert\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.227844 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.227666 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbn9f\" (UniqueName: \"kubernetes.io/projected/5c695b46-a64c-4921-a8db-7d3e85d443cb-kube-api-access-fbn9f\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.227844 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.227832 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-trusted-ca-bundle\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.228042 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.227877 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c695b46-a64c-4921-a8db-7d3e85d443cb-console-serving-cert\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.228042 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.227904 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c695b46-a64c-4921-a8db-7d3e85d443cb-console-oauth-config\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.328965 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.328925 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-trusted-ca-bundle\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.328965 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.328970 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c695b46-a64c-4921-a8db-7d3e85d443cb-console-serving-cert\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.329623 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.328988 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c695b46-a64c-4921-a8db-7d3e85d443cb-console-oauth-config\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.329623 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.329024 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-console-config\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.329623 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.329056 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-service-ca\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.329623 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.329070 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-oauth-serving-cert\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.329623 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.329087 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbn9f\" (UniqueName: \"kubernetes.io/projected/5c695b46-a64c-4921-a8db-7d3e85d443cb-kube-api-access-fbn9f\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.329957 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.329932 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-console-config\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.330015 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.329952 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-oauth-serving-cert\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.330015 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.330003 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-service-ca\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.330115 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.330068 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c695b46-a64c-4921-a8db-7d3e85d443cb-trusted-ca-bundle\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.331618 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.331592 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c695b46-a64c-4921-a8db-7d3e85d443cb-console-oauth-config\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.331701 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.331621 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c695b46-a64c-4921-a8db-7d3e85d443cb-console-serving-cert\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.338153 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.338103 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbn9f\" (UniqueName: \"kubernetes.io/projected/5c695b46-a64c-4921-a8db-7d3e85d443cb-kube-api-access-fbn9f\") pod \"console-5d794d6d77-9vvs4\" (UID: \"5c695b46-a64c-4921-a8db-7d3e85d443cb\") " pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.340854 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.340830 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" Jul 15 20:55:59.340951 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.340843 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7" event={"ID":"06141e22-5910-4e62-8b08-881f35c37118","Type":"ContainerDied","Data":"c1afc837281d5d3bc290c218bd389d1504a5191c0b3d3a0e115bdb3f53c1a7ca"} Jul 15 20:55:59.340951 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.340892 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1afc837281d5d3bc290c218bd389d1504a5191c0b3d3a0e115bdb3f53c1a7ca" Jul 15 20:55:59.415753 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.415711 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:55:59.494048 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.493658 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:55:59.518895 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.518867 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:55:59.537119 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.537098 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:55:59.591211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.591186 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d794d6d77-9vvs4"] Jul 15 20:55:59.592791 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:55:59.592749 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c695b46_a64c_4921_a8db_7d3e85d443cb.slice/crio-85ee94aedd1f55cf5e211fcdd1b679b9e1a5cdb05fd47d63d542ab5ffc0dbd8a WatchSource:0}: Error finding container 85ee94aedd1f55cf5e211fcdd1b679b9e1a5cdb05fd47d63d542ab5ffc0dbd8a: Status 404 returned error can't find the container with id 85ee94aedd1f55cf5e211fcdd1b679b9e1a5cdb05fd47d63d542ab5ffc0dbd8a Jul 15 20:55:59.632148 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.632127 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-util\") pod \"8ceb52eb-0882-4044-aa5c-ff123f10507e\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " Jul 15 20:55:59.632268 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.632216 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-util\") pod \"a60ae8f1-2683-476d-92e6-99687716987d\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " Jul 15 20:55:59.632268 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.632260 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khvp6\" (UniqueName: \"kubernetes.io/projected/e108a811-f795-41aa-9549-e8ed51d7c6ee-kube-api-access-khvp6\") pod \"e108a811-f795-41aa-9549-e8ed51d7c6ee\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " Jul 15 20:55:59.632374 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.632295 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-bundle\") pod \"e108a811-f795-41aa-9549-e8ed51d7c6ee\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " Jul 15 20:55:59.632374 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.632335 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wzpd\" (UniqueName: \"kubernetes.io/projected/8ceb52eb-0882-4044-aa5c-ff123f10507e-kube-api-access-8wzpd\") pod \"8ceb52eb-0882-4044-aa5c-ff123f10507e\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " Jul 15 20:55:59.632472 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.632372 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc9k2\" (UniqueName: \"kubernetes.io/projected/a60ae8f1-2683-476d-92e6-99687716987d-kube-api-access-jc9k2\") pod \"a60ae8f1-2683-476d-92e6-99687716987d\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " Jul 15 20:55:59.632472 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.632395 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-util\") pod \"e108a811-f795-41aa-9549-e8ed51d7c6ee\" (UID: \"e108a811-f795-41aa-9549-e8ed51d7c6ee\") " Jul 15 20:55:59.632472 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.632427 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-bundle\") pod \"a60ae8f1-2683-476d-92e6-99687716987d\" (UID: \"a60ae8f1-2683-476d-92e6-99687716987d\") " Jul 15 20:55:59.632609 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.632499 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-bundle\") pod \"8ceb52eb-0882-4044-aa5c-ff123f10507e\" (UID: \"8ceb52eb-0882-4044-aa5c-ff123f10507e\") " Jul 15 20:55:59.633165 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.633044 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-bundle" (OuterVolumeSpecName: "bundle") pod "e108a811-f795-41aa-9549-e8ed51d7c6ee" (UID: "e108a811-f795-41aa-9549-e8ed51d7c6ee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:55:59.633863 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.633613 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-bundle" (OuterVolumeSpecName: "bundle") pod "8ceb52eb-0882-4044-aa5c-ff123f10507e" (UID: "8ceb52eb-0882-4044-aa5c-ff123f10507e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:55:59.634053 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.634021 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-bundle" (OuterVolumeSpecName: "bundle") pod "a60ae8f1-2683-476d-92e6-99687716987d" (UID: "a60ae8f1-2683-476d-92e6-99687716987d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:55:59.635294 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.635271 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ceb52eb-0882-4044-aa5c-ff123f10507e-kube-api-access-8wzpd" (OuterVolumeSpecName: "kube-api-access-8wzpd") pod "8ceb52eb-0882-4044-aa5c-ff123f10507e" (UID: "8ceb52eb-0882-4044-aa5c-ff123f10507e"). InnerVolumeSpecName "kube-api-access-8wzpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:55:59.635392 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.635313 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e108a811-f795-41aa-9549-e8ed51d7c6ee-kube-api-access-khvp6" (OuterVolumeSpecName: "kube-api-access-khvp6") pod "e108a811-f795-41aa-9549-e8ed51d7c6ee" (UID: "e108a811-f795-41aa-9549-e8ed51d7c6ee"). InnerVolumeSpecName "kube-api-access-khvp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:55:59.636579 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.636560 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a60ae8f1-2683-476d-92e6-99687716987d-kube-api-access-jc9k2" (OuterVolumeSpecName: "kube-api-access-jc9k2") pod "a60ae8f1-2683-476d-92e6-99687716987d" (UID: "a60ae8f1-2683-476d-92e6-99687716987d"). InnerVolumeSpecName "kube-api-access-jc9k2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:55:59.639911 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.639886 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-util" (OuterVolumeSpecName: "util") pod "e108a811-f795-41aa-9549-e8ed51d7c6ee" (UID: "e108a811-f795-41aa-9549-e8ed51d7c6ee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:55:59.641639 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.641596 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-util" (OuterVolumeSpecName: "util") pod "8ceb52eb-0882-4044-aa5c-ff123f10507e" (UID: "8ceb52eb-0882-4044-aa5c-ff123f10507e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:55:59.641992 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.641965 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-util" (OuterVolumeSpecName: "util") pod "a60ae8f1-2683-476d-92e6-99687716987d" (UID: "a60ae8f1-2683-476d-92e6-99687716987d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 20:55:59.733920 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.733861 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-util\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:59.733920 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.733888 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khvp6\" (UniqueName: \"kubernetes.io/projected/e108a811-f795-41aa-9549-e8ed51d7c6ee-kube-api-access-khvp6\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:59.733920 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.733898 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-bundle\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:59.733920 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.733907 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wzpd\" (UniqueName: \"kubernetes.io/projected/8ceb52eb-0882-4044-aa5c-ff123f10507e-kube-api-access-8wzpd\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:59.733920 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.733915 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc9k2\" (UniqueName: \"kubernetes.io/projected/a60ae8f1-2683-476d-92e6-99687716987d-kube-api-access-jc9k2\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:59.733920 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.733923 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e108a811-f795-41aa-9549-e8ed51d7c6ee-util\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:59.733920 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.733930 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60ae8f1-2683-476d-92e6-99687716987d-bundle\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:59.734250 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.733940 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-bundle\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:55:59.734250 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:55:59.733947 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ceb52eb-0882-4044-aa5c-ff123f10507e-util\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:56:00.348700 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.348678 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" Jul 15 20:56:00.349127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.348674 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf" event={"ID":"e108a811-f795-41aa-9549-e8ed51d7c6ee","Type":"ContainerDied","Data":"6d917c3c131d7a3bab40373fec2c8c8ab34d829d9e2df9d0c7e6e534ac1e2fd5"} Jul 15 20:56:00.349127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.348826 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d917c3c131d7a3bab40373fec2c8c8ab34d829d9e2df9d0c7e6e534ac1e2fd5" Jul 15 20:56:00.350755 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.350729 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" event={"ID":"a60ae8f1-2683-476d-92e6-99687716987d","Type":"ContainerDied","Data":"d4eff77fffd83caffb07f0a8ed0c0f3546d3c8c6ca0b93769225a51a4e5e9031"} Jul 15 20:56:00.350872 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.350763 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7" Jul 15 20:56:00.350872 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.350800 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4eff77fffd83caffb07f0a8ed0c0f3546d3c8c6ca0b93769225a51a4e5e9031" Jul 15 20:56:00.352468 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.352436 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d794d6d77-9vvs4" event={"ID":"5c695b46-a64c-4921-a8db-7d3e85d443cb","Type":"ContainerStarted","Data":"f4f122afaf16472c7330adabb4541894a02967460a08329c8183dddda1bf442c"} Jul 15 20:56:00.352584 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.352484 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d794d6d77-9vvs4" event={"ID":"5c695b46-a64c-4921-a8db-7d3e85d443cb","Type":"ContainerStarted","Data":"85ee94aedd1f55cf5e211fcdd1b679b9e1a5cdb05fd47d63d542ab5ffc0dbd8a"} Jul 15 20:56:00.354295 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.354273 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" event={"ID":"8ceb52eb-0882-4044-aa5c-ff123f10507e","Type":"ContainerDied","Data":"3e6d24cd9bff76afc9943c1b87e24d57bef2425e7499de747725a36fb801dca9"} Jul 15 20:56:00.354397 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.354311 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6" Jul 15 20:56:00.354397 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.354310 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e6d24cd9bff76afc9943c1b87e24d57bef2425e7499de747725a36fb801dca9" Jul 15 20:56:00.390716 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:00.390671 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d794d6d77-9vvs4" podStartSLOduration=1.390656441 podStartE2EDuration="1.390656441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:55:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:56:00.387870317 +0000 UTC m=+497.063359549" watchObservedRunningTime="2026-07-15 20:56:00.390656441 +0000 UTC m=+497.066145735" Jul 15 20:56:04.727332 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727302 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k"] Jul 15 20:56:04.727716 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727681 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60ae8f1-2683-476d-92e6-99687716987d" containerName="util" Jul 15 20:56:04.727716 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727694 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60ae8f1-2683-476d-92e6-99687716987d" containerName="util" Jul 15 20:56:04.727716 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727703 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60ae8f1-2683-476d-92e6-99687716987d" containerName="extract" Jul 15 20:56:04.727716 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727709 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60ae8f1-2683-476d-92e6-99687716987d" containerName="extract" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727719 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ceb52eb-0882-4044-aa5c-ff123f10507e" containerName="extract" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727728 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ceb52eb-0882-4044-aa5c-ff123f10507e" containerName="extract" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727740 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e108a811-f795-41aa-9549-e8ed51d7c6ee" containerName="pull" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727745 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e108a811-f795-41aa-9549-e8ed51d7c6ee" containerName="pull" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727756 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e108a811-f795-41aa-9549-e8ed51d7c6ee" containerName="util" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727761 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e108a811-f795-41aa-9549-e8ed51d7c6ee" containerName="util" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727781 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60ae8f1-2683-476d-92e6-99687716987d" containerName="pull" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727790 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60ae8f1-2683-476d-92e6-99687716987d" containerName="pull" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727801 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e108a811-f795-41aa-9549-e8ed51d7c6ee" containerName="extract" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727806 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e108a811-f795-41aa-9549-e8ed51d7c6ee" containerName="extract" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727813 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ceb52eb-0882-4044-aa5c-ff123f10507e" containerName="pull" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727818 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ceb52eb-0882-4044-aa5c-ff123f10507e" containerName="pull" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727825 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ceb52eb-0882-4044-aa5c-ff123f10507e" containerName="util" Jul 15 20:56:04.727873 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727830 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ceb52eb-0882-4044-aa5c-ff123f10507e" containerName="util" Jul 15 20:56:04.728236 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727894 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ceb52eb-0882-4044-aa5c-ff123f10507e" containerName="extract" Jul 15 20:56:04.728236 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727902 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a60ae8f1-2683-476d-92e6-99687716987d" containerName="extract" Jul 15 20:56:04.728236 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.727907 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e108a811-f795-41aa-9549-e8ed51d7c6ee" containerName="extract" Jul 15 20:56:04.731117 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.731098 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:04.734027 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.734006 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 20:56:04.734151 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.734051 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 20:56:04.734991 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.734973 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xwflx\"" Jul 15 20:56:04.763317 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.763291 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k"] Jul 15 20:56:04.879380 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.879341 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xctw7\" (UniqueName: \"kubernetes.io/projected/904382a4-6b8f-4cdb-801f-6e0f77b3af7c-kube-api-access-xctw7\") pod \"limitador-operator-controller-manager-859d7b78bd-5hx4k\" (UID: \"904382a4-6b8f-4cdb-801f-6e0f77b3af7c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:04.980348 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.980265 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctw7\" (UniqueName: \"kubernetes.io/projected/904382a4-6b8f-4cdb-801f-6e0f77b3af7c-kube-api-access-xctw7\") pod \"limitador-operator-controller-manager-859d7b78bd-5hx4k\" (UID: \"904382a4-6b8f-4cdb-801f-6e0f77b3af7c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:04.993012 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:04.992988 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xctw7\" (UniqueName: \"kubernetes.io/projected/904382a4-6b8f-4cdb-801f-6e0f77b3af7c-kube-api-access-xctw7\") pod \"limitador-operator-controller-manager-859d7b78bd-5hx4k\" (UID: \"904382a4-6b8f-4cdb-801f-6e0f77b3af7c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:05.041716 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:05.041684 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:05.183547 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:05.183516 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k"] Jul 15 20:56:05.183892 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:56:05.183871 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904382a4_6b8f_4cdb_801f_6e0f77b3af7c.slice/crio-af0bfaaff71ebb484128ce6d4b89fbf44113c756e4d6b46f703edee0072460a7 WatchSource:0}: Error finding container af0bfaaff71ebb484128ce6d4b89fbf44113c756e4d6b46f703edee0072460a7: Status 404 returned error can't find the container with id af0bfaaff71ebb484128ce6d4b89fbf44113c756e4d6b46f703edee0072460a7 Jul 15 20:56:05.383719 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:05.383684 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" event={"ID":"904382a4-6b8f-4cdb-801f-6e0f77b3af7c","Type":"ContainerStarted","Data":"af0bfaaff71ebb484128ce6d4b89fbf44113c756e4d6b46f703edee0072460a7"} Jul 15 20:56:07.396340 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:07.396303 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" event={"ID":"904382a4-6b8f-4cdb-801f-6e0f77b3af7c","Type":"ContainerStarted","Data":"28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602"} Jul 15 20:56:07.396818 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:07.396442 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:07.429013 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:07.428961 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" podStartSLOduration=1.577907958 podStartE2EDuration="3.428946149s" totalImagesPullingTime="1.851038191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:56:07.426907169 +0000 UTC m=+504.102396401" watchObservedRunningTime="2026-07-15 20:56:07.428946149 +0000 UTC m=+504.104435448" Jul 15 20:56:09.416470 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:09.416442 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:56:09.416936 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:09.416575 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:56:09.421349 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:09.421330 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:56:10.416976 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:10.416950 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d794d6d77-9vvs4" Jul 15 20:56:16.382893 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:16.382859 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b"] Jul 15 20:56:16.390704 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:16.390684 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b" Jul 15 20:56:16.393419 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:16.393400 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 15 20:56:16.393657 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:16.393639 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-m7z4v\"" Jul 15 20:56:16.404020 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:16.403999 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b"] Jul 15 20:56:16.487045 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:16.487011 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98j9g\" (UniqueName: \"kubernetes.io/projected/2cff022a-3f34-4ac0-a4ab-7a537b6b6380-kube-api-access-98j9g\") pod \"dns-operator-controller-manager-864dd78c4c-rdm8b\" (UID: \"2cff022a-3f34-4ac0-a4ab-7a537b6b6380\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b" Jul 15 20:56:16.588055 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:16.588020 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98j9g\" (UniqueName: \"kubernetes.io/projected/2cff022a-3f34-4ac0-a4ab-7a537b6b6380-kube-api-access-98j9g\") pod \"dns-operator-controller-manager-864dd78c4c-rdm8b\" (UID: \"2cff022a-3f34-4ac0-a4ab-7a537b6b6380\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b" Jul 15 20:56:16.601236 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:16.601211 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98j9g\" (UniqueName: \"kubernetes.io/projected/2cff022a-3f34-4ac0-a4ab-7a537b6b6380-kube-api-access-98j9g\") pod \"dns-operator-controller-manager-864dd78c4c-rdm8b\" (UID: \"2cff022a-3f34-4ac0-a4ab-7a537b6b6380\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b" Jul 15 20:56:16.701154 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:16.701062 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b" Jul 15 20:56:16.850233 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:16.850210 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b"] Jul 15 20:56:16.852576 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:56:16.852551 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cff022a_3f34_4ac0_a4ab_7a537b6b6380.slice/crio-272dfda23831dd7ee97da6af0851d5f5cbc08d98e3d14d41729382dd38a13dd8 WatchSource:0}: Error finding container 272dfda23831dd7ee97da6af0851d5f5cbc08d98e3d14d41729382dd38a13dd8: Status 404 returned error can't find the container with id 272dfda23831dd7ee97da6af0851d5f5cbc08d98e3d14d41729382dd38a13dd8 Jul 15 20:56:17.451851 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:17.451819 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b" event={"ID":"2cff022a-3f34-4ac0-a4ab-7a537b6b6380","Type":"ContainerStarted","Data":"272dfda23831dd7ee97da6af0851d5f5cbc08d98e3d14d41729382dd38a13dd8"} Jul 15 20:56:18.404681 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:18.404652 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:19.464830 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:19.464792 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b" event={"ID":"2cff022a-3f34-4ac0-a4ab-7a537b6b6380","Type":"ContainerStarted","Data":"07727a05dfdba948fc69ac817006e562795c1b7bcdc86a512607456a89c5687a"} Jul 15 20:56:19.465239 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:19.464930 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b" Jul 15 20:56:19.489890 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:19.489836 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b" podStartSLOduration=1.443096066 podStartE2EDuration="3.489818318s" totalImagesPullingTime="2.046722252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:56:19.489171997 +0000 UTC m=+516.164661243" watchObservedRunningTime="2026-07-15 20:56:19.489818318 +0000 UTC m=+516.165307551" Jul 15 20:56:30.473166 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:30.473137 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rdm8b" Jul 15 20:56:31.017048 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.017018 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k"] Jul 15 20:56:31.017253 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.017216 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" podUID="904382a4-6b8f-4cdb-801f-6e0f77b3af7c" containerName="manager" containerID="cri-o://28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602" gracePeriod=2 Jul 15 20:56:31.021310 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:56:31.021270 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5hx4k\" is forbidden: User \"system:node:ip-10-0-138-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-248.ec2.internal' and this object" podUID="904382a4-6b8f-4cdb-801f-6e0f77b3af7c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:31.022505 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.022481 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k"] Jul 15 20:56:31.067752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.067722 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8"] Jul 15 20:56:31.068165 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.068142 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="904382a4-6b8f-4cdb-801f-6e0f77b3af7c" containerName="manager" Jul 15 20:56:31.068165 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.068164 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="904382a4-6b8f-4cdb-801f-6e0f77b3af7c" containerName="manager" Jul 15 20:56:31.068294 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.068283 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="904382a4-6b8f-4cdb-801f-6e0f77b3af7c" containerName="manager" Jul 15 20:56:31.071534 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.071516 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8" Jul 15 20:56:31.088857 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.088833 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8"] Jul 15 20:56:31.112148 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.112119 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlj5p\" (UniqueName: \"kubernetes.io/projected/2a4bd032-1358-412f-8ff6-8314cdd49ff3-kube-api-access-dlj5p\") pod \"limitador-operator-controller-manager-859d7b78bd-b9gl8\" (UID: \"2a4bd032-1358-412f-8ff6-8314cdd49ff3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8" Jul 15 20:56:31.123223 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:56:31.123183 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5hx4k\" is forbidden: User \"system:node:ip-10-0-138-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-248.ec2.internal' and this object" podUID="904382a4-6b8f-4cdb-801f-6e0f77b3af7c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:31.213339 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.213308 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlj5p\" (UniqueName: \"kubernetes.io/projected/2a4bd032-1358-412f-8ff6-8314cdd49ff3-kube-api-access-dlj5p\") pod \"limitador-operator-controller-manager-859d7b78bd-b9gl8\" (UID: \"2a4bd032-1358-412f-8ff6-8314cdd49ff3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8" Jul 15 20:56:31.224700 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.224676 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlj5p\" (UniqueName: \"kubernetes.io/projected/2a4bd032-1358-412f-8ff6-8314cdd49ff3-kube-api-access-dlj5p\") pod \"limitador-operator-controller-manager-859d7b78bd-b9gl8\" (UID: \"2a4bd032-1358-412f-8ff6-8314cdd49ff3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8" Jul 15 20:56:31.268279 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.268223 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:31.270791 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:56:31.270757 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5hx4k\" is forbidden: User \"system:node:ip-10-0-138-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-248.ec2.internal' and this object" podUID="904382a4-6b8f-4cdb-801f-6e0f77b3af7c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:31.313670 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.313640 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xctw7\" (UniqueName: \"kubernetes.io/projected/904382a4-6b8f-4cdb-801f-6e0f77b3af7c-kube-api-access-xctw7\") pod \"904382a4-6b8f-4cdb-801f-6e0f77b3af7c\" (UID: \"904382a4-6b8f-4cdb-801f-6e0f77b3af7c\") " Jul 15 20:56:31.315670 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.315641 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/904382a4-6b8f-4cdb-801f-6e0f77b3af7c-kube-api-access-xctw7" (OuterVolumeSpecName: "kube-api-access-xctw7") pod "904382a4-6b8f-4cdb-801f-6e0f77b3af7c" (UID: "904382a4-6b8f-4cdb-801f-6e0f77b3af7c"). InnerVolumeSpecName "kube-api-access-xctw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:56:31.401305 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.401278 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8" Jul 15 20:56:31.414998 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.414977 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xctw7\" (UniqueName: \"kubernetes.io/projected/904382a4-6b8f-4cdb-801f-6e0f77b3af7c-kube-api-access-xctw7\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:56:31.531308 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.531235 2553 generic.go:356] "Generic (PLEG): container finished" podID="904382a4-6b8f-4cdb-801f-6e0f77b3af7c" containerID="28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602" exitCode=0 Jul 15 20:56:31.531308 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.531285 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:31.531802 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.531319 2553 scope.go:117] "RemoveContainer" containerID="28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602" Jul 15 20:56:31.533497 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:56:31.533454 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5hx4k\" is forbidden: User \"system:node:ip-10-0-138-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-248.ec2.internal' and this object" podUID="904382a4-6b8f-4cdb-801f-6e0f77b3af7c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:31.538868 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.538835 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8"] Jul 15 20:56:31.542662 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.542638 2553 scope.go:117] "RemoveContainer" containerID="28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602" Jul 15 20:56:31.543017 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:56:31.542987 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602\": container with ID starting with 28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602 not found: ID does not exist" containerID="28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602" Jul 15 20:56:31.543123 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.543013 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602"} err="failed to get container status \"28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602\": rpc error: code = NotFound desc = could not find container \"28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602\": container with ID starting with 28beca58b91f5ef6451e9bf2140c2650a12f1fcaadb78c99f2a0f34adb19d602 not found: ID does not exist" Jul 15 20:56:31.543123 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:56:31.543067 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5hx4k\" is forbidden: User \"system:node:ip-10-0-138-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-248.ec2.internal' and this object" podUID="904382a4-6b8f-4cdb-801f-6e0f77b3af7c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5hx4k" Jul 15 20:56:31.544009 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:56:31.543986 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4bd032_1358_412f_8ff6_8314cdd49ff3.slice/crio-88d32abbea030c1d3579571a80ed53c97724c2e19efec3b370371cf4ae2fcdf1 WatchSource:0}: Error finding container 88d32abbea030c1d3579571a80ed53c97724c2e19efec3b370371cf4ae2fcdf1: Status 404 returned error can't find the container with id 88d32abbea030c1d3579571a80ed53c97724c2e19efec3b370371cf4ae2fcdf1 Jul 15 20:56:31.882197 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:31.882165 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="904382a4-6b8f-4cdb-801f-6e0f77b3af7c" path="/var/lib/kubelet/pods/904382a4-6b8f-4cdb-801f-6e0f77b3af7c/volumes" Jul 15 20:56:32.538478 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:32.538442 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8" event={"ID":"2a4bd032-1358-412f-8ff6-8314cdd49ff3","Type":"ContainerStarted","Data":"847bc2e7e4385176a666d760b6bdb320e502244ff42b68a9e896ef9388ebbe0a"} Jul 15 20:56:32.538929 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:32.538496 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8" event={"ID":"2a4bd032-1358-412f-8ff6-8314cdd49ff3","Type":"ContainerStarted","Data":"88d32abbea030c1d3579571a80ed53c97724c2e19efec3b370371cf4ae2fcdf1"} Jul 15 20:56:32.538929 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:32.538526 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8" Jul 15 20:56:32.559072 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:32.559023 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8" podStartSLOduration=1.5590063490000001 podStartE2EDuration="1.559006349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:56:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:56:32.556847758 +0000 UTC m=+529.232336993" watchObservedRunningTime="2026-07-15 20:56:32.559006349 +0000 UTC m=+529.234495581" Jul 15 20:56:43.547319 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:56:43.547246 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b9gl8" Jul 15 20:57:01.360371 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.360341 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5"] Jul 15 20:57:01.367042 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.367018 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.369409 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.369381 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ktqpj\"" Jul 15 20:57:01.377457 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.377433 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5"] Jul 15 20:57:01.485460 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.485427 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43d84421-d13b-4166-bdb8-71434af867b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.485642 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.485496 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.485642 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.485528 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.485642 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.485573 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.485642 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.485600 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43d84421-d13b-4166-bdb8-71434af867b0-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.485642 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.485627 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43d84421-d13b-4166-bdb8-71434af867b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.485876 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.485701 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.485876 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.485764 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brc4d\" (UniqueName: \"kubernetes.io/projected/43d84421-d13b-4166-bdb8-71434af867b0-kube-api-access-brc4d\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.485876 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.485818 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.586820 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.586787 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43d84421-d13b-4166-bdb8-71434af867b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.587029 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.586859 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.587029 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.587017 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.587144 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.587075 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.587144 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.587109 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43d84421-d13b-4166-bdb8-71434af867b0-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.587255 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.587152 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43d84421-d13b-4166-bdb8-71434af867b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.587255 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.587189 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.587255 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.587245 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brc4d\" (UniqueName: \"kubernetes.io/projected/43d84421-d13b-4166-bdb8-71434af867b0-kube-api-access-brc4d\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.587400 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.587275 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.587658 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.587315 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.588156 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.588131 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.588327 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.588264 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43d84421-d13b-4166-bdb8-71434af867b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.588684 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.588663 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.588803 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.588675 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.590277 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.590253 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43d84421-d13b-4166-bdb8-71434af867b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.590552 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.590529 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43d84421-d13b-4166-bdb8-71434af867b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.595644 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.595611 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43d84421-d13b-4166-bdb8-71434af867b0-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.595787 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.595749 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brc4d\" (UniqueName: \"kubernetes.io/projected/43d84421-d13b-4166-bdb8-71434af867b0-kube-api-access-brc4d\") pod \"maas-default-gateway-openshift-default-56654dcf7-blfs5\" (UID: \"43d84421-d13b-4166-bdb8-71434af867b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.679131 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.679035 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:01.836447 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.836424 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5"] Jul 15 20:57:01.838376 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:57:01.838346 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d84421_d13b_4166_bdb8_71434af867b0.slice/crio-08fc4366a1f3a330b6af68059256cd5a970460e8a347dd7e5a4f35f48e1d5f91 WatchSource:0}: Error finding container 08fc4366a1f3a330b6af68059256cd5a970460e8a347dd7e5a4f35f48e1d5f91: Status 404 returned error can't find the container with id 08fc4366a1f3a330b6af68059256cd5a970460e8a347dd7e5a4f35f48e1d5f91 Jul 15 20:57:01.840637 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.840608 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 20:57:01.840691 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.840674 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 20:57:01.840730 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:01.840701 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 20:57:02.708583 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:02.708548 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" event={"ID":"43d84421-d13b-4166-bdb8-71434af867b0","Type":"ContainerStarted","Data":"09120c422409ea928b5d75715cecd43a00395443db0045f0e72894a4263d1e5a"} Jul 15 20:57:02.709000 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:02.708604 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" event={"ID":"43d84421-d13b-4166-bdb8-71434af867b0","Type":"ContainerStarted","Data":"08fc4366a1f3a330b6af68059256cd5a970460e8a347dd7e5a4f35f48e1d5f91"} Jul 15 20:57:02.738001 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:02.737948 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" podStartSLOduration=1.737931415 podStartE2EDuration="1.737931415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:57:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:57:02.735186705 +0000 UTC m=+559.410675951" watchObservedRunningTime="2026-07-15 20:57:02.737931415 +0000 UTC m=+559.413420649" Jul 15 20:57:03.679583 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.679551 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:03.684443 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.684415 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:03.713811 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.713764 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:03.714729 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.714712 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:57:03.808376 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.808348 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k5xl"] Jul 15 20:57:03.812322 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.812304 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:03.814843 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.814819 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 20:57:03.814957 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.814824 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vb2db\"" Jul 15 20:57:03.820204 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.819933 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k5xl"] Jul 15 20:57:03.903309 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.903270 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k5xl"] Jul 15 20:57:03.906843 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.906818 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2qkw\" (UniqueName: \"kubernetes.io/projected/ca0fa24c-b950-4f15-a8c8-f68db54c1828-kube-api-access-t2qkw\") pod \"limitador-limitador-64c94fd64f-7k5xl\" (UID: \"ca0fa24c-b950-4f15-a8c8-f68db54c1828\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:03.906969 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:03.906920 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca0fa24c-b950-4f15-a8c8-f68db54c1828-config-file\") pod \"limitador-limitador-64c94fd64f-7k5xl\" (UID: \"ca0fa24c-b950-4f15-a8c8-f68db54c1828\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:04.008234 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:04.008146 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca0fa24c-b950-4f15-a8c8-f68db54c1828-config-file\") pod \"limitador-limitador-64c94fd64f-7k5xl\" (UID: \"ca0fa24c-b950-4f15-a8c8-f68db54c1828\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:04.008384 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:04.008311 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2qkw\" (UniqueName: \"kubernetes.io/projected/ca0fa24c-b950-4f15-a8c8-f68db54c1828-kube-api-access-t2qkw\") pod \"limitador-limitador-64c94fd64f-7k5xl\" (UID: \"ca0fa24c-b950-4f15-a8c8-f68db54c1828\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:04.008809 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:04.008785 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca0fa24c-b950-4f15-a8c8-f68db54c1828-config-file\") pod \"limitador-limitador-64c94fd64f-7k5xl\" (UID: \"ca0fa24c-b950-4f15-a8c8-f68db54c1828\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:04.016967 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:04.016946 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2qkw\" (UniqueName: \"kubernetes.io/projected/ca0fa24c-b950-4f15-a8c8-f68db54c1828-kube-api-access-t2qkw\") pod \"limitador-limitador-64c94fd64f-7k5xl\" (UID: \"ca0fa24c-b950-4f15-a8c8-f68db54c1828\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:04.123825 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:04.123765 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:04.267612 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:04.267585 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k5xl"] Jul 15 20:57:04.269726 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:57:04.269697 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0fa24c_b950_4f15_a8c8_f68db54c1828.slice/crio-a28a65f07d890a5e763a69d6bd78482763cb54c34d5b038d36a0bd12378d4898 WatchSource:0}: Error finding container a28a65f07d890a5e763a69d6bd78482763cb54c34d5b038d36a0bd12378d4898: Status 404 returned error can't find the container with id a28a65f07d890a5e763a69d6bd78482763cb54c34d5b038d36a0bd12378d4898 Jul 15 20:57:04.720595 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:04.720554 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" event={"ID":"ca0fa24c-b950-4f15-a8c8-f68db54c1828","Type":"ContainerStarted","Data":"a28a65f07d890a5e763a69d6bd78482763cb54c34d5b038d36a0bd12378d4898"} Jul 15 20:57:07.740937 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:07.740895 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" event={"ID":"ca0fa24c-b950-4f15-a8c8-f68db54c1828","Type":"ContainerStarted","Data":"7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10"} Jul 15 20:57:07.741329 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:07.741002 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:07.764708 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:07.764655 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" podStartSLOduration=2.052650559 podStartE2EDuration="4.76463949s" totalImagesPullingTime="2.711988931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:57:07.763692932 +0000 UTC m=+564.439182162" watchObservedRunningTime="2026-07-15 20:57:07.76463949 +0000 UTC m=+564.440128780" Jul 15 20:57:18.747233 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:18.747204 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:21.599347 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:21.599313 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k5xl"] Jul 15 20:57:21.599809 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:21.599541 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" podUID="ca0fa24c-b950-4f15-a8c8-f68db54c1828" containerName="limitador" containerID="cri-o://7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10" gracePeriod=30 Jul 15 20:57:22.161337 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.161277 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:22.176491 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.176467 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca0fa24c-b950-4f15-a8c8-f68db54c1828-config-file\") pod \"ca0fa24c-b950-4f15-a8c8-f68db54c1828\" (UID: \"ca0fa24c-b950-4f15-a8c8-f68db54c1828\") " Jul 15 20:57:22.176583 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.176545 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2qkw\" (UniqueName: \"kubernetes.io/projected/ca0fa24c-b950-4f15-a8c8-f68db54c1828-kube-api-access-t2qkw\") pod \"ca0fa24c-b950-4f15-a8c8-f68db54c1828\" (UID: \"ca0fa24c-b950-4f15-a8c8-f68db54c1828\") " Jul 15 20:57:22.176813 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.176793 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca0fa24c-b950-4f15-a8c8-f68db54c1828-config-file" (OuterVolumeSpecName: "config-file") pod "ca0fa24c-b950-4f15-a8c8-f68db54c1828" (UID: "ca0fa24c-b950-4f15-a8c8-f68db54c1828"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 20:57:22.178443 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.178420 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca0fa24c-b950-4f15-a8c8-f68db54c1828-kube-api-access-t2qkw" (OuterVolumeSpecName: "kube-api-access-t2qkw") pod "ca0fa24c-b950-4f15-a8c8-f68db54c1828" (UID: "ca0fa24c-b950-4f15-a8c8-f68db54c1828"). InnerVolumeSpecName "kube-api-access-t2qkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 20:57:22.277200 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.277166 2553 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca0fa24c-b950-4f15-a8c8-f68db54c1828-config-file\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:57:22.277200 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.277196 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2qkw\" (UniqueName: \"kubernetes.io/projected/ca0fa24c-b950-4f15-a8c8-f68db54c1828-kube-api-access-t2qkw\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 20:57:22.825330 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.825296 2553 generic.go:356] "Generic (PLEG): container finished" podID="ca0fa24c-b950-4f15-a8c8-f68db54c1828" containerID="7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10" exitCode=0 Jul 15 20:57:22.825794 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.825339 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" Jul 15 20:57:22.825794 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.825352 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" event={"ID":"ca0fa24c-b950-4f15-a8c8-f68db54c1828","Type":"ContainerDied","Data":"7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10"} Jul 15 20:57:22.825794 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.825395 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7k5xl" event={"ID":"ca0fa24c-b950-4f15-a8c8-f68db54c1828","Type":"ContainerDied","Data":"a28a65f07d890a5e763a69d6bd78482763cb54c34d5b038d36a0bd12378d4898"} Jul 15 20:57:22.825794 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.825416 2553 scope.go:117] "RemoveContainer" containerID="7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10" Jul 15 20:57:22.834652 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.834635 2553 scope.go:117] "RemoveContainer" containerID="7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10" Jul 15 20:57:22.834923 ip-10-0-138-248 kubenswrapper[2553]: E0715 20:57:22.834904 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10\": container with ID starting with 7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10 not found: ID does not exist" containerID="7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10" Jul 15 20:57:22.834993 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.834931 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10"} err="failed to get container status \"7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10\": rpc error: code = NotFound desc = could not find container \"7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10\": container with ID starting with 7870d4d2d6bc58792dbf5a6ffbd546038099362a0e668dad7e493d7ab9f1cd10 not found: ID does not exist" Jul 15 20:57:22.847957 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.847934 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k5xl"] Jul 15 20:57:22.851729 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:22.851708 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7k5xl"] Jul 15 20:57:23.881844 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:23.881814 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca0fa24c-b950-4f15-a8c8-f68db54c1828" path="/var/lib/kubelet/pods/ca0fa24c-b950-4f15-a8c8-f68db54c1828/volumes" Jul 15 20:57:25.607014 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.606977 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-275bb"] Jul 15 20:57:25.607595 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.607579 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca0fa24c-b950-4f15-a8c8-f68db54c1828" containerName="limitador" Jul 15 20:57:25.607634 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.607598 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca0fa24c-b950-4f15-a8c8-f68db54c1828" containerName="limitador" Jul 15 20:57:25.607729 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.607717 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca0fa24c-b950-4f15-a8c8-f68db54c1828" containerName="limitador" Jul 15 20:57:25.616604 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.616581 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" Jul 15 20:57:25.619224 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.619202 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 15 20:57:25.619348 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.619229 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 20:57:25.620152 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.620132 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 20:57:25.620259 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.620217 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7k8vq\"" Jul 15 20:57:25.623570 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.623547 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-275bb"] Jul 15 20:57:25.705100 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.705065 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c75e36e4-f1ee-4f36-a5a9-495955255aa3-data\") pod \"postgres-69fb4594cf-275bb\" (UID: \"c75e36e4-f1ee-4f36-a5a9-495955255aa3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" Jul 15 20:57:25.705100 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.705104 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-869cv\" (UniqueName: \"kubernetes.io/projected/c75e36e4-f1ee-4f36-a5a9-495955255aa3-kube-api-access-869cv\") pod \"postgres-69fb4594cf-275bb\" (UID: \"c75e36e4-f1ee-4f36-a5a9-495955255aa3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" Jul 15 20:57:25.806070 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.806035 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c75e36e4-f1ee-4f36-a5a9-495955255aa3-data\") pod \"postgres-69fb4594cf-275bb\" (UID: \"c75e36e4-f1ee-4f36-a5a9-495955255aa3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" Jul 15 20:57:25.806070 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.806071 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-869cv\" (UniqueName: \"kubernetes.io/projected/c75e36e4-f1ee-4f36-a5a9-495955255aa3-kube-api-access-869cv\") pod \"postgres-69fb4594cf-275bb\" (UID: \"c75e36e4-f1ee-4f36-a5a9-495955255aa3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" Jul 15 20:57:25.806407 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.806387 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c75e36e4-f1ee-4f36-a5a9-495955255aa3-data\") pod \"postgres-69fb4594cf-275bb\" (UID: \"c75e36e4-f1ee-4f36-a5a9-495955255aa3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" Jul 15 20:57:25.814916 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.814890 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-869cv\" (UniqueName: \"kubernetes.io/projected/c75e36e4-f1ee-4f36-a5a9-495955255aa3-kube-api-access-869cv\") pod \"postgres-69fb4594cf-275bb\" (UID: \"c75e36e4-f1ee-4f36-a5a9-495955255aa3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" Jul 15 20:57:25.927651 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:25.927565 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" Jul 15 20:57:26.061940 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:26.061917 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-275bb"] Jul 15 20:57:26.063555 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:57:26.063512 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75e36e4_f1ee_4f36_a5a9_495955255aa3.slice/crio-26224bbcec14c20e42da51b5ed353c656da91794e02b9a22df68760f21618a53 WatchSource:0}: Error finding container 26224bbcec14c20e42da51b5ed353c656da91794e02b9a22df68760f21618a53: Status 404 returned error can't find the container with id 26224bbcec14c20e42da51b5ed353c656da91794e02b9a22df68760f21618a53 Jul 15 20:57:26.850087 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:26.850054 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" event={"ID":"c75e36e4-f1ee-4f36-a5a9-495955255aa3","Type":"ContainerStarted","Data":"26224bbcec14c20e42da51b5ed353c656da91794e02b9a22df68760f21618a53"} Jul 15 20:57:31.885062 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:31.885016 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" event={"ID":"c75e36e4-f1ee-4f36-a5a9-495955255aa3","Type":"ContainerStarted","Data":"a3a7730b77da63a89894f467706f533a26cec3fa3bc5b68c576ba9615a974387"} Jul 15 20:57:31.885469 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:31.885105 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" Jul 15 20:57:31.907806 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:31.907742 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" podStartSLOduration=1.899250388 podStartE2EDuration="6.907724846s" totalImagesPullingTime="5.008474458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:57:31.90539126 +0000 UTC m=+588.580880494" watchObservedRunningTime="2026-07-15 20:57:31.907724846 +0000 UTC m=+588.583214079" Jul 15 20:57:37.921888 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:37.921848 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-275bb" Jul 15 20:57:43.721904 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:43.721872 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 20:57:43.722427 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:57:43.721952 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 20:58:22.135597 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.135559 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn"] Jul 15 20:58:22.139127 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.139106 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:22.142835 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.142814 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-s2l9d\"" Jul 15 20:58:22.143656 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.143635 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 15 20:58:22.153947 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.153919 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn"] Jul 15 20:58:22.227861 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.227828 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg28b\" (UniqueName: \"kubernetes.io/projected/e208687f-db9a-443c-9a1e-3e0f5876ad78-kube-api-access-jg28b\") pod \"maas-api-5f7778bd68-47hkn\" (UID: \"e208687f-db9a-443c-9a1e-3e0f5876ad78\") " pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:22.228039 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.227880 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e208687f-db9a-443c-9a1e-3e0f5876ad78-openshift-service-ca\") pod \"maas-api-5f7778bd68-47hkn\" (UID: \"e208687f-db9a-443c-9a1e-3e0f5876ad78\") " pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:22.228039 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.227932 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e208687f-db9a-443c-9a1e-3e0f5876ad78-maas-api-tls\") pod \"maas-api-5f7778bd68-47hkn\" (UID: \"e208687f-db9a-443c-9a1e-3e0f5876ad78\") " pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:22.329186 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.329152 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg28b\" (UniqueName: \"kubernetes.io/projected/e208687f-db9a-443c-9a1e-3e0f5876ad78-kube-api-access-jg28b\") pod \"maas-api-5f7778bd68-47hkn\" (UID: \"e208687f-db9a-443c-9a1e-3e0f5876ad78\") " pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:22.329350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.329203 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e208687f-db9a-443c-9a1e-3e0f5876ad78-openshift-service-ca\") pod \"maas-api-5f7778bd68-47hkn\" (UID: \"e208687f-db9a-443c-9a1e-3e0f5876ad78\") " pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:22.329350 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.329222 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e208687f-db9a-443c-9a1e-3e0f5876ad78-maas-api-tls\") pod \"maas-api-5f7778bd68-47hkn\" (UID: \"e208687f-db9a-443c-9a1e-3e0f5876ad78\") " pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:22.329879 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.329852 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e208687f-db9a-443c-9a1e-3e0f5876ad78-openshift-service-ca\") pod \"maas-api-5f7778bd68-47hkn\" (UID: \"e208687f-db9a-443c-9a1e-3e0f5876ad78\") " pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:22.331613 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.331586 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e208687f-db9a-443c-9a1e-3e0f5876ad78-maas-api-tls\") pod \"maas-api-5f7778bd68-47hkn\" (UID: \"e208687f-db9a-443c-9a1e-3e0f5876ad78\") " pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:22.345707 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.345685 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg28b\" (UniqueName: \"kubernetes.io/projected/e208687f-db9a-443c-9a1e-3e0f5876ad78-kube-api-access-jg28b\") pod \"maas-api-5f7778bd68-47hkn\" (UID: \"e208687f-db9a-443c-9a1e-3e0f5876ad78\") " pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:22.450642 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.450558 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:22.612670 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.612640 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn"] Jul 15 20:58:22.614269 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:58:22.614244 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode208687f_db9a_443c_9a1e_3e0f5876ad78.slice/crio-bd4a10e4c7934a3c531cc49321a97aaf104d4914fbb8436bc8688ba7eba61d3d WatchSource:0}: Error finding container bd4a10e4c7934a3c531cc49321a97aaf104d4914fbb8436bc8688ba7eba61d3d: Status 404 returned error can't find the container with id bd4a10e4c7934a3c531cc49321a97aaf104d4914fbb8436bc8688ba7eba61d3d Jul 15 20:58:22.615721 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:22.615698 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 20:58:23.181400 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.181295 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" event={"ID":"e208687f-db9a-443c-9a1e-3e0f5876ad78","Type":"ContainerStarted","Data":"bd4a10e4c7934a3c531cc49321a97aaf104d4914fbb8436bc8688ba7eba61d3d"} Jul 15 20:58:23.249850 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.249817 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-h9ft6"] Jul 15 20:58:23.253634 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.253605 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" Jul 15 20:58:23.257110 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.257073 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9xlbk\"" Jul 15 20:58:23.257249 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.257206 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 20:58:23.268272 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.268237 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-h9ft6"] Jul 15 20:58:23.338418 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.338346 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb39f08d-c4a6-45eb-bf54-eb1b0d29d330-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-h9ft6\" (UID: \"bb39f08d-c4a6-45eb-bf54-eb1b0d29d330\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" Jul 15 20:58:23.338822 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.338741 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-452zd\" (UniqueName: \"kubernetes.io/projected/bb39f08d-c4a6-45eb-bf54-eb1b0d29d330-kube-api-access-452zd\") pod \"payload-processing-f9b8d9b9b-h9ft6\" (UID: \"bb39f08d-c4a6-45eb-bf54-eb1b0d29d330\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" Jul 15 20:58:23.439613 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.439524 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb39f08d-c4a6-45eb-bf54-eb1b0d29d330-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-h9ft6\" (UID: \"bb39f08d-c4a6-45eb-bf54-eb1b0d29d330\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" Jul 15 20:58:23.439613 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.439601 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-452zd\" (UniqueName: \"kubernetes.io/projected/bb39f08d-c4a6-45eb-bf54-eb1b0d29d330-kube-api-access-452zd\") pod \"payload-processing-f9b8d9b9b-h9ft6\" (UID: \"bb39f08d-c4a6-45eb-bf54-eb1b0d29d330\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" Jul 15 20:58:23.440472 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.440448 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb39f08d-c4a6-45eb-bf54-eb1b0d29d330-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-h9ft6\" (UID: \"bb39f08d-c4a6-45eb-bf54-eb1b0d29d330\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" Jul 15 20:58:23.449162 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.449133 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-452zd\" (UniqueName: \"kubernetes.io/projected/bb39f08d-c4a6-45eb-bf54-eb1b0d29d330-kube-api-access-452zd\") pod \"payload-processing-f9b8d9b9b-h9ft6\" (UID: \"bb39f08d-c4a6-45eb-bf54-eb1b0d29d330\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" Jul 15 20:58:23.571373 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.571338 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" Jul 15 20:58:23.766271 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:23.766229 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-h9ft6"] Jul 15 20:58:23.768493 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:58:23.768425 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb39f08d_c4a6_45eb_bf54_eb1b0d29d330.slice/crio-c0315d847942b7a1069608beffc8f6bedb3d1a048a14e060cab3600fc3476b86 WatchSource:0}: Error finding container c0315d847942b7a1069608beffc8f6bedb3d1a048a14e060cab3600fc3476b86: Status 404 returned error can't find the container with id c0315d847942b7a1069608beffc8f6bedb3d1a048a14e060cab3600fc3476b86 Jul 15 20:58:24.211594 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:24.211547 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" event={"ID":"bb39f08d-c4a6-45eb-bf54-eb1b0d29d330","Type":"ContainerStarted","Data":"c0315d847942b7a1069608beffc8f6bedb3d1a048a14e060cab3600fc3476b86"} Jul 15 20:58:26.226363 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:26.226325 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" event={"ID":"e208687f-db9a-443c-9a1e-3e0f5876ad78","Type":"ContainerStarted","Data":"5e8c8738aa61c06187b14dfa99c05c9846c33a27415dfe455760e7d3a104f1a3"} Jul 15 20:58:26.226839 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:26.226405 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:26.246752 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:26.246706 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" podStartSLOduration=1.4507300810000001 podStartE2EDuration="4.246689163s" totalImagesPullingTime="2.795959082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:58:26.244015105 +0000 UTC m=+642.919504338" watchObservedRunningTime="2026-07-15 20:58:26.246689163 +0000 UTC m=+642.922178397" Jul 15 20:58:27.234067 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:27.234035 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" event={"ID":"bb39f08d-c4a6-45eb-bf54-eb1b0d29d330","Type":"ContainerStarted","Data":"aaf0ddf607308f21e0c5dc597eb804e6c24b62ca318b3644e28a16dc155d4b12"} Jul 15 20:58:27.251888 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:27.251846 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" podStartSLOduration=1.6515256900000002 podStartE2EDuration="4.251829697s" totalImagesPullingTime="2.600304007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:58:27.250273326 +0000 UTC m=+643.925762582" watchObservedRunningTime="2026-07-15 20:58:27.251829697 +0000 UTC m=+643.927318929" Jul 15 20:58:28.239635 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:28.239550 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" Jul 15 20:58:31.267193 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:31.267158 2553 generic.go:356] "Generic (PLEG): container finished" podID="43d84421-d13b-4166-bdb8-71434af867b0" containerID="09120c422409ea928b5d75715cecd43a00395443db0045f0e72894a4263d1e5a" exitCode=0 Jul 15 20:58:31.267819 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:31.267233 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" event={"ID":"43d84421-d13b-4166-bdb8-71434af867b0","Type":"ContainerDied","Data":"09120c422409ea928b5d75715cecd43a00395443db0045f0e72894a4263d1e5a"} Jul 15 20:58:31.267819 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:31.267721 2553 scope.go:117] "RemoveContainer" containerID="09120c422409ea928b5d75715cecd43a00395443db0045f0e72894a4263d1e5a" Jul 15 20:58:31.268796 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:31.268757 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 20:58:31.268862 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:31.268831 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 20:58:31.268898 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:31.268863 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 20:58:32.240994 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:32.240965 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5f7778bd68-47hkn" Jul 15 20:58:32.276625 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:32.276596 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" event={"ID":"43d84421-d13b-4166-bdb8-71434af867b0","Type":"ContainerStarted","Data":"ec5ea0ebe4c70c09ca6b13e00c13df9b691e85e5a14c1282debdda45bfc76ede"} Jul 15 20:58:32.679349 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:32.679312 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:58:32.680788 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:32.680734 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-blfs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 15 20:58:32.680939 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:32.680828 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" podUID="43d84421-d13b-4166-bdb8-71434af867b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 15 20:58:33.679484 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:33.679450 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-blfs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 15 20:58:33.679965 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:33.679503 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" podUID="43d84421-d13b-4166-bdb8-71434af867b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 15 20:58:33.714065 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:33.714022 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:58:34.680036 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:34.679995 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-blfs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 15 20:58:34.680523 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:34.680077 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" podUID="43d84421-d13b-4166-bdb8-71434af867b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 15 20:58:35.679444 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:35.679404 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-blfs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 15 20:58:35.679628 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:35.679460 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" podUID="43d84421-d13b-4166-bdb8-71434af867b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 15 20:58:36.683765 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:36.683734 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:58:36.684972 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:36.684953 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-blfs5" Jul 15 20:58:39.249968 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:58:39.249935 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-h9ft6" Jul 15 20:59:23.844809 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:23.844762 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd"] Jul 15 20:59:23.848460 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:23.848439 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:23.851116 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:23.851088 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 20:59:23.852024 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:23.852002 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4f6jp\"" Jul 15 20:59:23.852179 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:23.852063 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 20:59:23.852344 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:23.852309 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 15 20:59:23.860020 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:23.859997 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd"] Jul 15 20:59:24.014211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.014177 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.014211 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.014212 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vw84\" (UniqueName: \"kubernetes.io/projected/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-kube-api-access-4vw84\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.014426 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.014313 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.014426 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.014357 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.014426 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.014392 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.014540 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.014517 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.115466 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.115373 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.115466 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.115413 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vw84\" (UniqueName: \"kubernetes.io/projected/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-kube-api-access-4vw84\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.115696 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.115471 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.115696 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.115494 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.115696 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.115520 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.115696 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.115551 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.115983 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.115947 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.115983 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.115962 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.116147 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.116015 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.117783 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.117751 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.118058 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.118040 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.124329 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.124295 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vw84\" (UniqueName: \"kubernetes.io/projected/51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81-kube-api-access-4vw84\") pod \"e2e-trlp-test-simulated-kserve-598466548d-p27xd\" (UID: \"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.160704 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.160670 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:24.303139 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.303114 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd"] Jul 15 20:59:24.304964 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:59:24.304934 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b13ef2_0c3e_47f4_b7f4_3f8284ad6c81.slice/crio-bf7559abef080b442bcba9f40a018bfcd9a20a2780e3881800d8ec04790ebb3d WatchSource:0}: Error finding container bf7559abef080b442bcba9f40a018bfcd9a20a2780e3881800d8ec04790ebb3d: Status 404 returned error can't find the container with id bf7559abef080b442bcba9f40a018bfcd9a20a2780e3881800d8ec04790ebb3d Jul 15 20:59:24.577021 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:24.576986 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" event={"ID":"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81","Type":"ContainerStarted","Data":"bf7559abef080b442bcba9f40a018bfcd9a20a2780e3881800d8ec04790ebb3d"} Jul 15 20:59:25.585581 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:25.585474 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" event={"ID":"51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81","Type":"ContainerStarted","Data":"6e2012cd9cc8c01cabd488227a02f043f61ab18f8749b165a4f8a26dba8fe078"} Jul 15 20:59:25.606814 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:25.606728 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" podStartSLOduration=1.5795337900000002 podStartE2EDuration="2.606706689s" totalImagesPullingTime="1.027172899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:25.605329672 +0000 UTC m=+702.280818918" watchObservedRunningTime="2026-07-15 20:59:25.606706689 +0000 UTC m=+702.282195922" Jul 15 20:59:33.242106 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.242064 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq"] Jul 15 20:59:33.246074 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.246053 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.249537 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.249510 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 20:59:33.257874 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.257846 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq"] Jul 15 20:59:33.307571 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.307537 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.307571 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.307569 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91902fa6-f79f-444c-be6b-9141b999d1cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.307823 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.307596 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.307823 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.307719 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.307823 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.307792 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7hr7\" (UniqueName: \"kubernetes.io/projected/91902fa6-f79f-444c-be6b-9141b999d1cc-kube-api-access-d7hr7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.307951 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.307839 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.409016 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.408981 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7hr7\" (UniqueName: \"kubernetes.io/projected/91902fa6-f79f-444c-be6b-9141b999d1cc-kube-api-access-d7hr7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.409184 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.409050 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.409184 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.409125 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.409184 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.409150 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91902fa6-f79f-444c-be6b-9141b999d1cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.409292 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.409187 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.409430 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.409401 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.409638 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.409608 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.409638 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.409625 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.409834 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.409717 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.411305 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.411285 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91902fa6-f79f-444c-be6b-9141b999d1cc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.411571 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.411553 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91902fa6-f79f-444c-be6b-9141b999d1cc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.419346 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.419320 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7hr7\" (UniqueName: \"kubernetes.io/projected/91902fa6-f79f-444c-be6b-9141b999d1cc-kube-api-access-d7hr7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq\" (UID: \"91902fa6-f79f-444c-be6b-9141b999d1cc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.557476 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.557387 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:33.700293 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:33.700263 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq"] Jul 15 20:59:33.701922 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:59:33.701893 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91902fa6_f79f_444c_be6b_9141b999d1cc.slice/crio-236c2a6a12568421e6d29c44471918b2ba9c1f61bbc0f14ca39564d5cd3590b1 WatchSource:0}: Error finding container 236c2a6a12568421e6d29c44471918b2ba9c1f61bbc0f14ca39564d5cd3590b1: Status 404 returned error can't find the container with id 236c2a6a12568421e6d29c44471918b2ba9c1f61bbc0f14ca39564d5cd3590b1 Jul 15 20:59:34.160938 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:34.160901 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:34.161118 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:34.160976 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:34.173989 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:34.173969 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:34.636580 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:34.636544 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" event={"ID":"91902fa6-f79f-444c-be6b-9141b999d1cc","Type":"ContainerStarted","Data":"4e6426dcefc4dab221dfdb0c18f4d37c63ba23650392e553d5f818d44c5d964f"} Jul 15 20:59:34.637010 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:34.636599 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" event={"ID":"91902fa6-f79f-444c-be6b-9141b999d1cc","Type":"ContainerStarted","Data":"236c2a6a12568421e6d29c44471918b2ba9c1f61bbc0f14ca39564d5cd3590b1"} Jul 15 20:59:34.647860 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:34.647839 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-p27xd" Jul 15 20:59:34.659139 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:34.659096 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" podStartSLOduration=1.400213739 podStartE2EDuration="1.659081296s" totalImagesPullingTime="258.867557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:34.656759676 +0000 UTC m=+711.332248910" watchObservedRunningTime="2026-07-15 20:59:34.659081296 +0000 UTC m=+711.334570528" Jul 15 20:59:43.557957 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:43.557918 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:43.558358 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:43.557984 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:43.570461 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:43.570435 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:43.708740 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:43.708711 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq" Jul 15 20:59:51.540987 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.540949 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2"] Jul 15 20:59:51.544674 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.544657 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.547150 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.547128 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 20:59:51.553351 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.553327 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2"] Jul 15 20:59:51.689673 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.689642 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.689868 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.689719 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83984dfa-ffc2-4f02-a80e-795765291db3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.689868 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.689740 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.689868 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.689804 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.689984 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.689904 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppqln\" (UniqueName: \"kubernetes.io/projected/83984dfa-ffc2-4f02-a80e-795765291db3-kube-api-access-ppqln\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.689984 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.689935 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.791618 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.791508 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.791618 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.791597 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.792003 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.791678 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83984dfa-ffc2-4f02-a80e-795765291db3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.792003 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.791705 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.792003 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.791799 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.792003 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.791938 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppqln\" (UniqueName: \"kubernetes.io/projected/83984dfa-ffc2-4f02-a80e-795765291db3-kube-api-access-ppqln\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.792341 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.792102 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.792410 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.792331 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.792742 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.792721 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.793983 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.793952 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83984dfa-ffc2-4f02-a80e-795765291db3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.794531 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.794508 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83984dfa-ffc2-4f02-a80e-795765291db3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.801252 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.801196 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppqln\" (UniqueName: \"kubernetes.io/projected/83984dfa-ffc2-4f02-a80e-795765291db3-kube-api-access-ppqln\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7zjh2\" (UID: \"83984dfa-ffc2-4f02-a80e-795765291db3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:51.855868 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:51.855812 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 20:59:52.006248 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:52.006223 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2"] Jul 15 20:59:52.009121 ip-10-0-138-248 kubenswrapper[2553]: W0715 20:59:52.009086 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83984dfa_ffc2_4f02_a80e_795765291db3.slice/crio-4f537d87943ba6e5f268b28e6b0f4695d84b5e661752c20849e18128c1212f79 WatchSource:0}: Error finding container 4f537d87943ba6e5f268b28e6b0f4695d84b5e661752c20849e18128c1212f79: Status 404 returned error can't find the container with id 4f537d87943ba6e5f268b28e6b0f4695d84b5e661752c20849e18128c1212f79 Jul 15 20:59:52.743941 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:52.743908 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" event={"ID":"83984dfa-ffc2-4f02-a80e-795765291db3","Type":"ContainerStarted","Data":"aa9dd0862f77bb092de2d494d4b583a28f0177147e7b82c5a86b77867858408a"} Jul 15 20:59:52.744320 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:52.743957 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" event={"ID":"83984dfa-ffc2-4f02-a80e-795765291db3","Type":"ContainerStarted","Data":"4f537d87943ba6e5f268b28e6b0f4695d84b5e661752c20849e18128c1212f79"} Jul 15 20:59:52.764040 ip-10-0-138-248 kubenswrapper[2553]: I0715 20:59:52.763969 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" podStartSLOduration=1.5226746439999999 podStartE2EDuration="1.763953972s" totalImagesPullingTime="241.279328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:52.7633024 +0000 UTC m=+729.438791632" watchObservedRunningTime="2026-07-15 20:59:52.763953972 +0000 UTC m=+729.439443204" Jul 15 21:00:01.856489 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:00:01.856440 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 21:00:01.857058 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:00:01.856518 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 21:00:01.869464 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:00:01.869436 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 21:00:02.812826 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:00:02.812795 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7zjh2" Jul 15 21:02:43.760136 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:02:43.760104 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:02:43.763082 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:02:43.763059 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:07:43.803165 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:07:43.803137 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:07:43.806172 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:07:43.806148 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:12:43.847614 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:12:43.847580 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:12:43.850945 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:12:43.850912 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:17:43.895425 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:17:43.895400 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:17:43.899806 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:17:43.899764 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:22:43.933479 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:22:43.933449 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:22:43.939245 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:22:43.939218 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:27:43.972120 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:27:43.972093 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:27:43.981028 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:27:43.981005 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:28:13.883332 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:13.883260 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5"] Jul 15 21:28:13.886871 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:13.886855 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5" Jul 15 21:28:13.890256 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:13.890164 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zsrf5\"" Jul 15 21:28:13.893846 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:13.893815 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5"] Jul 15 21:28:13.947369 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:13.947326 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a647ebe4-27d0-4579-97cb-3a3b113b992d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5\" (UID: \"a647ebe4-27d0-4579-97cb-3a3b113b992d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5" Jul 15 21:28:14.047958 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:14.047919 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a647ebe4-27d0-4579-97cb-3a3b113b992d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5\" (UID: \"a647ebe4-27d0-4579-97cb-3a3b113b992d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5" Jul 15 21:28:14.048549 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:14.048529 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a647ebe4-27d0-4579-97cb-3a3b113b992d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5\" (UID: \"a647ebe4-27d0-4579-97cb-3a3b113b992d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5" Jul 15 21:28:14.200424 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:14.200344 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5" Jul 15 21:28:14.344856 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:14.344830 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5"] Jul 15 21:28:14.346818 ip-10-0-138-248 kubenswrapper[2553]: W0715 21:28:14.346792 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda647ebe4_27d0_4579_97cb_3a3b113b992d.slice/crio-c59500968efd3e9e4b62d6b6974ce81ca13c3e2c78d3014ec4a0e8e4345dff6c WatchSource:0}: Error finding container c59500968efd3e9e4b62d6b6974ce81ca13c3e2c78d3014ec4a0e8e4345dff6c: Status 404 returned error can't find the container with id c59500968efd3e9e4b62d6b6974ce81ca13c3e2c78d3014ec4a0e8e4345dff6c Jul 15 21:28:14.348797 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:14.348765 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:28:14.600533 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:14.600498 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5" event={"ID":"a647ebe4-27d0-4579-97cb-3a3b113b992d","Type":"ContainerStarted","Data":"c59500968efd3e9e4b62d6b6974ce81ca13c3e2c78d3014ec4a0e8e4345dff6c"} Jul 15 21:28:17.619720 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:17.619680 2553 generic.go:356] "Generic (PLEG): container finished" podID="a647ebe4-27d0-4579-97cb-3a3b113b992d" containerID="5a1c8b84ecaf05d8384d4fdb8235d401c122955aa4afd78eb2dff20384234a0d" exitCode=0 Jul 15 21:28:17.620112 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:17.619727 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5" event={"ID":"a647ebe4-27d0-4579-97cb-3a3b113b992d","Type":"ContainerDied","Data":"5a1c8b84ecaf05d8384d4fdb8235d401c122955aa4afd78eb2dff20384234a0d"} Jul 15 21:28:18.766308 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:18.766282 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5" Jul 15 21:28:18.798574 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:18.798538 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a647ebe4-27d0-4579-97cb-3a3b113b992d-maas-api-service-ca\") pod \"a647ebe4-27d0-4579-97cb-3a3b113b992d\" (UID: \"a647ebe4-27d0-4579-97cb-3a3b113b992d\") " Jul 15 21:28:18.798990 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:18.798965 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a647ebe4-27d0-4579-97cb-3a3b113b992d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a647ebe4-27d0-4579-97cb-3a3b113b992d" (UID: "a647ebe4-27d0-4579-97cb-3a3b113b992d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:28:18.899736 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:18.899647 2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a647ebe4-27d0-4579-97cb-3a3b113b992d-maas-api-service-ca\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 21:28:19.633012 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:19.632985 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5" Jul 15 21:28:19.633186 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:19.633034 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5" event={"ID":"a647ebe4-27d0-4579-97cb-3a3b113b992d","Type":"ContainerDied","Data":"c59500968efd3e9e4b62d6b6974ce81ca13c3e2c78d3014ec4a0e8e4345dff6c"} Jul 15 21:28:19.633186 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:19.633080 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c59500968efd3e9e4b62d6b6974ce81ca13c3e2c78d3014ec4a0e8e4345dff6c" Jul 15 21:28:40.152237 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.152202 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47"] Jul 15 21:28:40.152840 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.152821 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a647ebe4-27d0-4579-97cb-3a3b113b992d" containerName="revoke-keys" Jul 15 21:28:40.152952 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.152844 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a647ebe4-27d0-4579-97cb-3a3b113b992d" containerName="revoke-keys" Jul 15 21:28:40.153009 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.152986 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a647ebe4-27d0-4579-97cb-3a3b113b992d" containerName="revoke-keys" Jul 15 21:28:40.156308 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.156286 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47" Jul 15 21:28:40.158858 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.158841 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zsrf5\"" Jul 15 21:28:40.164335 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.164089 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47"] Jul 15 21:28:40.316284 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.316250 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a53e0b0-2fc4-4301-9beb-d7471f5ef05c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-659e77-75f47\" (UID: \"1a53e0b0-2fc4-4301-9beb-d7471f5ef05c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47" Jul 15 21:28:40.417342 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.417262 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a53e0b0-2fc4-4301-9beb-d7471f5ef05c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-659e77-75f47\" (UID: \"1a53e0b0-2fc4-4301-9beb-d7471f5ef05c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47" Jul 15 21:28:40.417926 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.417907 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a53e0b0-2fc4-4301-9beb-d7471f5ef05c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-659e77-75f47\" (UID: \"1a53e0b0-2fc4-4301-9beb-d7471f5ef05c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47" Jul 15 21:28:40.469047 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.469016 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47" Jul 15 21:28:40.615150 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.615124 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47"] Jul 15 21:28:40.617840 ip-10-0-138-248 kubenswrapper[2553]: W0715 21:28:40.617810 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a53e0b0_2fc4_4301_9beb_d7471f5ef05c.slice/crio-88d9d84c70a315aaa918736ccd949503bcd521f4dd2a658e852462ba309aa53a WatchSource:0}: Error finding container 88d9d84c70a315aaa918736ccd949503bcd521f4dd2a658e852462ba309aa53a: Status 404 returned error can't find the container with id 88d9d84c70a315aaa918736ccd949503bcd521f4dd2a658e852462ba309aa53a Jul 15 21:28:40.765506 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:40.765416 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47" event={"ID":"1a53e0b0-2fc4-4301-9beb-d7471f5ef05c","Type":"ContainerStarted","Data":"88d9d84c70a315aaa918736ccd949503bcd521f4dd2a658e852462ba309aa53a"} Jul 15 21:28:41.772710 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:41.772675 2553 generic.go:356] "Generic (PLEG): container finished" podID="1a53e0b0-2fc4-4301-9beb-d7471f5ef05c" containerID="bb9b4bf7668cefeda6380de4ca31cb2242777fe0f97875fecbb00c7790346698" exitCode=0 Jul 15 21:28:41.773121 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:41.772741 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47" event={"ID":"1a53e0b0-2fc4-4301-9beb-d7471f5ef05c","Type":"ContainerDied","Data":"bb9b4bf7668cefeda6380de4ca31cb2242777fe0f97875fecbb00c7790346698"} Jul 15 21:28:42.917416 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:42.917387 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47" Jul 15 21:28:43.042182 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:43.042087 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a53e0b0-2fc4-4301-9beb-d7471f5ef05c-maas-api-service-ca\") pod \"1a53e0b0-2fc4-4301-9beb-d7471f5ef05c\" (UID: \"1a53e0b0-2fc4-4301-9beb-d7471f5ef05c\") " Jul 15 21:28:43.042448 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:43.042423 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a53e0b0-2fc4-4301-9beb-d7471f5ef05c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1a53e0b0-2fc4-4301-9beb-d7471f5ef05c" (UID: "1a53e0b0-2fc4-4301-9beb-d7471f5ef05c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:28:43.143954 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:43.143909 2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a53e0b0-2fc4-4301-9beb-d7471f5ef05c-maas-api-service-ca\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 21:28:43.793354 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:43.793328 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47" Jul 15 21:28:43.793532 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:43.793323 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-659e77-75f47" event={"ID":"1a53e0b0-2fc4-4301-9beb-d7471f5ef05c","Type":"ContainerDied","Data":"88d9d84c70a315aaa918736ccd949503bcd521f4dd2a658e852462ba309aa53a"} Jul 15 21:28:43.793532 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:28:43.793471 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88d9d84c70a315aaa918736ccd949503bcd521f4dd2a658e852462ba309aa53a" Jul 15 21:29:30.967933 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:30.967894 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h"] Jul 15 21:29:30.968425 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:30.968349 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a53e0b0-2fc4-4301-9beb-d7471f5ef05c" containerName="revoke-keys" Jul 15 21:29:30.968425 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:30.968360 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a53e0b0-2fc4-4301-9beb-d7471f5ef05c" containerName="revoke-keys" Jul 15 21:29:30.968504 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:30.968429 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a53e0b0-2fc4-4301-9beb-d7471f5ef05c" containerName="revoke-keys" Jul 15 21:29:30.971631 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:30.971614 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" Jul 15 21:29:30.975390 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:30.975370 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zsrf5\"" Jul 15 21:29:30.981495 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:30.981475 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h"] Jul 15 21:29:31.112130 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:31.112096 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10e21a12-8eb8-4125-b5ab-4de7ea7a22d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h\" (UID: \"10e21a12-8eb8-4125-b5ab-4de7ea7a22d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" Jul 15 21:29:31.213538 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:31.213497 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10e21a12-8eb8-4125-b5ab-4de7ea7a22d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h\" (UID: \"10e21a12-8eb8-4125-b5ab-4de7ea7a22d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" Jul 15 21:29:31.214196 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:31.214178 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10e21a12-8eb8-4125-b5ab-4de7ea7a22d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h\" (UID: \"10e21a12-8eb8-4125-b5ab-4de7ea7a22d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" Jul 15 21:29:31.284396 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:31.284314 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" Jul 15 21:29:31.432679 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:31.432649 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h"] Jul 15 21:29:31.434254 ip-10-0-138-248 kubenswrapper[2553]: W0715 21:29:31.434227 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e21a12_8eb8_4125_b5ab_4de7ea7a22d9.slice/crio-0066b56949cc0645037d1b50bd6fed8d2b5e9c1542caf6c070d3b48b6c4d694b WatchSource:0}: Error finding container 0066b56949cc0645037d1b50bd6fed8d2b5e9c1542caf6c070d3b48b6c4d694b: Status 404 returned error can't find the container with id 0066b56949cc0645037d1b50bd6fed8d2b5e9c1542caf6c070d3b48b6c4d694b Jul 15 21:29:32.080832 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:32.080789 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" event={"ID":"10e21a12-8eb8-4125-b5ab-4de7ea7a22d9","Type":"ContainerStarted","Data":"7e218ae384919378b1715be7674a06dcd8afbf706d8f4a8552352e6cabb6c117"} Jul 15 21:29:32.081209 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:32.080861 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" event={"ID":"10e21a12-8eb8-4125-b5ab-4de7ea7a22d9","Type":"ContainerStarted","Data":"0066b56949cc0645037d1b50bd6fed8d2b5e9c1542caf6c070d3b48b6c4d694b"} Jul 15 21:29:32.103106 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:32.103049 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" podStartSLOduration=2.103028246 podStartE2EDuration="2.103028246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:32.101542378 +0000 UTC m=+2508.777031616" watchObservedRunningTime="2026-07-15 21:29:32.103028246 +0000 UTC m=+2508.778517479" Jul 15 21:29:33.088540 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:33.088507 2553 generic.go:356] "Generic (PLEG): container finished" podID="10e21a12-8eb8-4125-b5ab-4de7ea7a22d9" containerID="7e218ae384919378b1715be7674a06dcd8afbf706d8f4a8552352e6cabb6c117" exitCode=0 Jul 15 21:29:33.089008 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:33.088607 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" event={"ID":"10e21a12-8eb8-4125-b5ab-4de7ea7a22d9","Type":"ContainerDied","Data":"7e218ae384919378b1715be7674a06dcd8afbf706d8f4a8552352e6cabb6c117"} Jul 15 21:29:34.231825 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:34.231796 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" Jul 15 21:29:34.243961 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:34.243932 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10e21a12-8eb8-4125-b5ab-4de7ea7a22d9-maas-api-service-ca\") pod \"10e21a12-8eb8-4125-b5ab-4de7ea7a22d9\" (UID: \"10e21a12-8eb8-4125-b5ab-4de7ea7a22d9\") " Jul 15 21:29:34.244282 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:34.244257 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10e21a12-8eb8-4125-b5ab-4de7ea7a22d9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "10e21a12-8eb8-4125-b5ab-4de7ea7a22d9" (UID: "10e21a12-8eb8-4125-b5ab-4de7ea7a22d9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:29:34.344926 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:34.344827 2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10e21a12-8eb8-4125-b5ab-4de7ea7a22d9-maas-api-service-ca\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 21:29:35.101436 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:35.101359 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" Jul 15 21:29:35.101436 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:35.101399 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h" event={"ID":"10e21a12-8eb8-4125-b5ab-4de7ea7a22d9","Type":"ContainerDied","Data":"0066b56949cc0645037d1b50bd6fed8d2b5e9c1542caf6c070d3b48b6c4d694b"} Jul 15 21:29:35.101641 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:35.101444 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0066b56949cc0645037d1b50bd6fed8d2b5e9c1542caf6c070d3b48b6c4d694b" Jul 15 21:29:57.206513 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.206470 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl"] Jul 15 21:29:57.207130 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.207110 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10e21a12-8eb8-4125-b5ab-4de7ea7a22d9" containerName="revoke-keys" Jul 15 21:29:57.207211 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.207134 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="10e21a12-8eb8-4125-b5ab-4de7ea7a22d9" containerName="revoke-keys" Jul 15 21:29:57.207287 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.207274 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="10e21a12-8eb8-4125-b5ab-4de7ea7a22d9" containerName="revoke-keys" Jul 15 21:29:57.210600 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.210581 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" Jul 15 21:29:57.213502 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.213484 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zsrf5\"" Jul 15 21:29:57.220609 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.220585 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl"] Jul 15 21:29:57.374904 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.374864 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b20693e-426a-43b5-b3ff-eb1bfb968c69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-843ced-64gbl\" (UID: \"9b20693e-426a-43b5-b3ff-eb1bfb968c69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" Jul 15 21:29:57.476447 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.476348 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b20693e-426a-43b5-b3ff-eb1bfb968c69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-843ced-64gbl\" (UID: \"9b20693e-426a-43b5-b3ff-eb1bfb968c69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" Jul 15 21:29:57.477065 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.477046 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b20693e-426a-43b5-b3ff-eb1bfb968c69-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-843ced-64gbl\" (UID: \"9b20693e-426a-43b5-b3ff-eb1bfb968c69\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" Jul 15 21:29:57.523405 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.523368 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" Jul 15 21:29:57.670010 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:57.669977 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl"] Jul 15 21:29:57.670990 ip-10-0-138-248 kubenswrapper[2553]: W0715 21:29:57.670964 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b20693e_426a_43b5_b3ff_eb1bfb968c69.slice/crio-e283c470b1aabbe41ae3f565cf567a83a690688827be486305b1d0c8484b7b3f WatchSource:0}: Error finding container e283c470b1aabbe41ae3f565cf567a83a690688827be486305b1d0c8484b7b3f: Status 404 returned error can't find the container with id e283c470b1aabbe41ae3f565cf567a83a690688827be486305b1d0c8484b7b3f Jul 15 21:29:58.243216 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:58.243112 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" event={"ID":"9b20693e-426a-43b5-b3ff-eb1bfb968c69","Type":"ContainerStarted","Data":"499ba2903cf1e22bd86a0a99fd9104f672f00f83aedb250351132da3af7b5111"} Jul 15 21:29:58.243216 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:58.243170 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" event={"ID":"9b20693e-426a-43b5-b3ff-eb1bfb968c69","Type":"ContainerStarted","Data":"e283c470b1aabbe41ae3f565cf567a83a690688827be486305b1d0c8484b7b3f"} Jul 15 21:29:58.262407 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:58.262355 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" podStartSLOduration=1.2623400280000001 podStartE2EDuration="1.262340028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:58.260730078 +0000 UTC m=+2534.936219313" watchObservedRunningTime="2026-07-15 21:29:58.262340028 +0000 UTC m=+2534.937829262" Jul 15 21:29:59.250476 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:59.250441 2553 generic.go:356] "Generic (PLEG): container finished" podID="9b20693e-426a-43b5-b3ff-eb1bfb968c69" containerID="499ba2903cf1e22bd86a0a99fd9104f672f00f83aedb250351132da3af7b5111" exitCode=0 Jul 15 21:29:59.250954 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:29:59.250507 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" event={"ID":"9b20693e-426a-43b5-b3ff-eb1bfb968c69","Type":"ContainerDied","Data":"499ba2903cf1e22bd86a0a99fd9104f672f00f83aedb250351132da3af7b5111"} Jul 15 21:30:00.398585 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:30:00.398562 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" Jul 15 21:30:00.507069 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:30:00.506979 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b20693e-426a-43b5-b3ff-eb1bfb968c69-maas-api-service-ca\") pod \"9b20693e-426a-43b5-b3ff-eb1bfb968c69\" (UID: \"9b20693e-426a-43b5-b3ff-eb1bfb968c69\") " Jul 15 21:30:00.507300 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:30:00.507275 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b20693e-426a-43b5-b3ff-eb1bfb968c69-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9b20693e-426a-43b5-b3ff-eb1bfb968c69" (UID: "9b20693e-426a-43b5-b3ff-eb1bfb968c69"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:30:00.608292 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:30:00.608260 2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b20693e-426a-43b5-b3ff-eb1bfb968c69-maas-api-service-ca\") on node \"ip-10-0-138-248.ec2.internal\" DevicePath \"\"" Jul 15 21:30:01.263676 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:30:01.263645 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" Jul 15 21:30:01.263676 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:30:01.263669 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-843ced-64gbl" event={"ID":"9b20693e-426a-43b5-b3ff-eb1bfb968c69","Type":"ContainerDied","Data":"e283c470b1aabbe41ae3f565cf567a83a690688827be486305b1d0c8484b7b3f"} Jul 15 21:30:01.263931 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:30:01.263711 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e283c470b1aabbe41ae3f565cf567a83a690688827be486305b1d0c8484b7b3f" Jul 15 21:32:44.015466 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:32:44.015394 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:32:44.025425 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:32:44.025401 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:37:44.063388 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:37:44.063354 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:37:44.068677 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:37:44.068657 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:38:17.275630 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:17.275603 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rbxnr_7cd06da3-74c8-4e10-90c2-8e4f4e3073ef/server/0.log" Jul 15 21:38:17.396044 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:17.396014 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mw7zg_17646633-3d76-4b92-b06b-3a345b34fbe8/manager/0.log" Jul 15 21:38:17.516154 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:17.516119 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b849856cb-7fcnp_8818ac7b-9194-4c12-bc03-b3a1e0c086c3/copy-manifests/0.log" Jul 15 21:38:17.523124 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:17.523104 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b849856cb-7fcnp_8818ac7b-9194-4c12-bc03-b3a1e0c086c3/manager/0.log" Jul 15 21:38:18.166104 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:18.166073 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5f7778bd68-47hkn_e208687f-db9a-443c-9a1e-3e0f5876ad78/maas-api/0.log" Jul 15 21:38:18.896587 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:18.896559 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-f5fcf1-nq46h_10e21a12-8eb8-4125-b5ab-4de7ea7a22d9/revoke-keys/0.log" Jul 15 21:38:19.012977 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:19.012948 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-843ced-64gbl_9b20693e-426a-43b5-b3ff-eb1bfb968c69/revoke-keys/0.log" Jul 15 21:38:19.250646 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:19.250550 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-d87a1e-mvgs5_a647ebe4-27d0-4579-97cb-3a3b113b992d/revoke-keys/0.log" Jul 15 21:38:19.368610 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:19.368568 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-659e77-75f47_1a53e0b0-2fc4-4301-9beb-d7471f5ef05c/revoke-keys/0.log" Jul 15 21:38:20.080989 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:20.080949 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-275bb_c75e36e4-f1ee-4f36-a5a9-495955255aa3/postgres/0.log" Jul 15 21:38:20.866845 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:20.866817 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7_06141e22-5910-4e62-8b08-881f35c37118/util/0.log" Jul 15 21:38:20.874241 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:20.874210 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7_06141e22-5910-4e62-8b08-881f35c37118/pull/0.log" Jul 15 21:38:20.881307 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:20.881282 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7_06141e22-5910-4e62-8b08-881f35c37118/extract/0.log" Jul 15 21:38:20.996836 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:20.996807 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6_8ceb52eb-0882-4044-aa5c-ff123f10507e/util/0.log" Jul 15 21:38:21.003580 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:21.003555 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6_8ceb52eb-0882-4044-aa5c-ff123f10507e/pull/0.log" Jul 15 21:38:21.010379 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:21.010359 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6_8ceb52eb-0882-4044-aa5c-ff123f10507e/extract/0.log" Jul 15 21:38:21.125764 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:21.125693 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7_a60ae8f1-2683-476d-92e6-99687716987d/extract/0.log" Jul 15 21:38:21.132307 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:21.132286 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7_a60ae8f1-2683-476d-92e6-99687716987d/util/0.log" Jul 15 21:38:21.139282 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:21.139265 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7_a60ae8f1-2683-476d-92e6-99687716987d/pull/0.log" Jul 15 21:38:21.258575 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:21.258548 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf_e108a811-f795-41aa-9549-e8ed51d7c6ee/util/0.log" Jul 15 21:38:21.265270 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:21.265248 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf_e108a811-f795-41aa-9549-e8ed51d7c6ee/pull/0.log" Jul 15 21:38:21.271933 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:21.271914 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf_e108a811-f795-41aa-9549-e8ed51d7c6ee/extract/0.log" Jul 15 21:38:21.629531 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:21.629498 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rdm8b_2cff022a-3f34-4ac0-a4ab-7a537b6b6380/manager/0.log" Jul 15 21:38:22.236330 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:22.236297 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b9gl8_2a4bd032-1358-412f-8ff6-8314cdd49ff3/manager/0.log" Jul 15 21:38:22.610196 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:22.610169 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46sl55_b7da38a6-c008-4417-a335-8b0fa45367be/istio-proxy/0.log" Jul 15 21:38:22.734895 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:22.734868 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-b8vg4_a2ef5497-f363-494e-a99f-800727deec6b/discovery/0.log" Jul 15 21:38:22.961833 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:22.961736 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-796df4448b-gqdqj_8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0/kube-auth-proxy/0.log" Jul 15 21:38:23.078634 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:23.078600 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-blfs5_43d84421-d13b-4166-bdb8-71434af867b0/istio-proxy/1.log" Jul 15 21:38:23.317486 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:23.317414 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-h9ft6_bb39f08d-c4a6-45eb-bf54-eb1b0d29d330/payload-processing/0.log" Jul 15 21:38:23.435683 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:23.435656 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cb6f979db-vqk9s_27a97da1-f66f-45c9-aaa9-a16df8672253/router/0.log" Jul 15 21:38:23.998168 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:23.998132 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-p27xd_51b13ef2-0c3e-47f4-b7f4-3f8284ad6c81/main/0.log" Jul 15 21:38:24.111502 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:24.111474 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbghcmq_91902fa6-f79f-444c-be6b-9141b999d1cc/main/0.log" Jul 15 21:38:24.223046 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:24.223018 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-7zjh2_83984dfa-ffc2-4f02-a80e-795765291db3/main/0.log" Jul 15 21:38:32.918787 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:32.918745 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wc5wg_4ebbda4f-407d-4093-9a52-90a25e0345cb/global-pull-secret-syncer/0.log" Jul 15 21:38:33.043895 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:33.043861 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bqdbw_57186567-8d5d-4c5b-9d34-6248a420c405/konnectivity-agent/0.log" Jul 15 21:38:33.146514 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:33.146493 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-248.ec2.internal_d2a10535261cd6acdc45b882f26431ac/haproxy/0.log" Jul 15 21:38:37.713108 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:37.713065 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7_06141e22-5910-4e62-8b08-881f35c37118/extract/0.log" Jul 15 21:38:37.741271 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:37.741243 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7_06141e22-5910-4e62-8b08-881f35c37118/util/0.log" Jul 15 21:38:37.765109 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:37.765080 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xb6l7_06141e22-5910-4e62-8b08-881f35c37118/pull/0.log" Jul 15 21:38:37.794324 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:37.794297 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6_8ceb52eb-0882-4044-aa5c-ff123f10507e/extract/0.log" Jul 15 21:38:37.818346 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:37.818317 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6_8ceb52eb-0882-4044-aa5c-ff123f10507e/util/0.log" Jul 15 21:38:37.842365 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:37.842343 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0w9ns6_8ceb52eb-0882-4044-aa5c-ff123f10507e/pull/0.log" Jul 15 21:38:37.876080 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:37.876049 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7_a60ae8f1-2683-476d-92e6-99687716987d/extract/0.log" Jul 15 21:38:37.909236 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:37.909204 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7_a60ae8f1-2683-476d-92e6-99687716987d/util/0.log" Jul 15 21:38:37.949644 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:37.949617 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xdlf7_a60ae8f1-2683-476d-92e6-99687716987d/pull/0.log" Jul 15 21:38:37.986098 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:37.986002 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf_e108a811-f795-41aa-9549-e8ed51d7c6ee/extract/0.log" Jul 15 21:38:38.016111 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:38.016084 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf_e108a811-f795-41aa-9549-e8ed51d7c6ee/util/0.log" Jul 15 21:38:38.042877 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:38.042853 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1695gf_e108a811-f795-41aa-9549-e8ed51d7c6ee/pull/0.log" Jul 15 21:38:38.606257 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:38.606229 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rdm8b_2cff022a-3f34-4ac0-a4ab-7a537b6b6380/manager/0.log" Jul 15 21:38:38.921491 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:38.921403 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b9gl8_2a4bd032-1358-412f-8ff6-8314cdd49ff3/manager/0.log" Jul 15 21:38:41.035826 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:41.035791 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-4g6v2_7d900b98-fa9b-457c-acc8-7c65df59d4e0/cluster-monitoring-operator/0.log" Jul 15 21:38:41.284857 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:41.284828 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6769df564c-c4wbr_35064ca7-bed4-440e-addf-37e3b33e0384/metrics-server/0.log" Jul 15 21:38:41.471745 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:41.471714 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nd2cb_9fe46a68-91e1-48b4-8203-9f14eb83391e/node-exporter/0.log" Jul 15 21:38:41.499846 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:41.499814 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nd2cb_9fe46a68-91e1-48b4-8203-9f14eb83391e/kube-rbac-proxy/0.log" Jul 15 21:38:41.538327 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:41.538301 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nd2cb_9fe46a68-91e1-48b4-8203-9f14eb83391e/init-textfile/0.log" Jul 15 21:38:41.683518 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:41.683488 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-cgsj2_c72f8fd4-1b35-4851-9052-4fbaa700c0ea/kube-rbac-proxy-main/0.log" Jul 15 21:38:41.718077 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:41.718049 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-cgsj2_c72f8fd4-1b35-4851-9052-4fbaa700c0ea/kube-rbac-proxy-self/0.log" Jul 15 21:38:41.743314 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:41.743248 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-cgsj2_c72f8fd4-1b35-4851-9052-4fbaa700c0ea/openshift-state-metrics/0.log" Jul 15 21:38:42.033148 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.033067 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-gb9d9_35399360-2c40-4cc5-92fd-fef7993b03d8/prometheus-operator-admission-webhook/0.log" Jul 15 21:38:42.169123 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.169098 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd6d97c5-8vpbg_37cb2e18-83ef-49cc-a132-ea4917bbd802/thanos-query/0.log" Jul 15 21:38:42.194362 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.194337 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd6d97c5-8vpbg_37cb2e18-83ef-49cc-a132-ea4917bbd802/kube-rbac-proxy-web/0.log" Jul 15 21:38:42.218478 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.218443 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd6d97c5-8vpbg_37cb2e18-83ef-49cc-a132-ea4917bbd802/kube-rbac-proxy/0.log" Jul 15 21:38:42.242292 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.242264 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd6d97c5-8vpbg_37cb2e18-83ef-49cc-a132-ea4917bbd802/prom-label-proxy/0.log" Jul 15 21:38:42.267163 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.267138 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd6d97c5-8vpbg_37cb2e18-83ef-49cc-a132-ea4917bbd802/kube-rbac-proxy-rules/0.log" Jul 15 21:38:42.294054 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.293981 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd6d97c5-8vpbg_37cb2e18-83ef-49cc-a132-ea4917bbd802/kube-rbac-proxy-metrics/0.log" Jul 15 21:38:42.785848 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.785821 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9"] Jul 15 21:38:42.786254 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.786241 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b20693e-426a-43b5-b3ff-eb1bfb968c69" containerName="revoke-keys" Jul 15 21:38:42.786299 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.786257 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b20693e-426a-43b5-b3ff-eb1bfb968c69" containerName="revoke-keys" Jul 15 21:38:42.786334 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.786320 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b20693e-426a-43b5-b3ff-eb1bfb968c69" containerName="revoke-keys" Jul 15 21:38:42.789561 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.789547 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.792064 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.792039 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jhrn6\"/\"openshift-service-ca.crt\"" Jul 15 21:38:42.792208 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.792132 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jhrn6\"/\"kube-root-ca.crt\"" Jul 15 21:38:42.792900 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.792883 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jhrn6\"/\"default-dockercfg-h4vxg\"" Jul 15 21:38:42.807570 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.807543 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9"] Jul 15 21:38:42.866677 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.866644 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-podres\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.866677 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.866685 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-lib-modules\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.866942 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.866704 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-sys\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.866942 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.866740 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x45pv\" (UniqueName: \"kubernetes.io/projected/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-kube-api-access-x45pv\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.866942 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.866834 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-proc\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.967559 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.967521 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-podres\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.967763 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.967567 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-lib-modules\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.967763 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.967590 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-sys\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.967763 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.967628 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x45pv\" (UniqueName: \"kubernetes.io/projected/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-kube-api-access-x45pv\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.967763 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.967657 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-proc\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.967763 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.967697 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-sys\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.967763 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.967701 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-podres\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.967763 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.967750 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-lib-modules\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.968123 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.967819 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-proc\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:42.977007 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:42.976979 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x45pv\" (UniqueName: \"kubernetes.io/projected/b2ea581b-ccd2-4a31-9952-c15d648d2fd3-kube-api-access-x45pv\") pod \"perf-node-gather-daemonset-69zr9\" (UID: \"b2ea581b-ccd2-4a31-9952-c15d648d2fd3\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:43.102611 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:43.102579 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:43.245446 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:43.245415 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9"] Jul 15 21:38:43.247139 ip-10-0-138-248 kubenswrapper[2553]: W0715 21:38:43.247114 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb2ea581b_ccd2_4a31_9952_c15d648d2fd3.slice/crio-dd2fdb75deda8e5a19eb1dec0a1a650ea07c66e2ded387fc2e6d78dc8f4c5b68 WatchSource:0}: Error finding container dd2fdb75deda8e5a19eb1dec0a1a650ea07c66e2ded387fc2e6d78dc8f4c5b68: Status 404 returned error can't find the container with id dd2fdb75deda8e5a19eb1dec0a1a650ea07c66e2ded387fc2e6d78dc8f4c5b68 Jul 15 21:38:43.399720 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:43.399691 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" event={"ID":"b2ea581b-ccd2-4a31-9952-c15d648d2fd3","Type":"ContainerStarted","Data":"a53b5a1d93e58898d9d54ccd53b0c8681f3ab361efe09d333df726ccc1c273f6"} Jul 15 21:38:43.399878 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:43.399743 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" event={"ID":"b2ea581b-ccd2-4a31-9952-c15d648d2fd3","Type":"ContainerStarted","Data":"dd2fdb75deda8e5a19eb1dec0a1a650ea07c66e2ded387fc2e6d78dc8f4c5b68"} Jul 15 21:38:43.399878 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:43.399819 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:43.422190 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:43.422138 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" podStartSLOduration=1.42212321 podStartE2EDuration="1.42212321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:38:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:43.418419138 +0000 UTC m=+3060.093908364" watchObservedRunningTime="2026-07-15 21:38:43.42212321 +0000 UTC m=+3060.097612443" Jul 15 21:38:43.548998 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:43.548968 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-vjmp5_b1461f20-8aee-40e4-99cb-5e6e94c61ab4/networking-console-plugin/0.log" Jul 15 21:38:44.105645 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:44.105612 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/1.log" Jul 15 21:38:44.110630 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:44.110607 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxr4t_4131898e-b714-49ab-bbe9-18ab20e268a0/console-operator/2.log" Jul 15 21:38:44.586838 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:44.586813 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d794d6d77-9vvs4_5c695b46-a64c-4921-a8db-7d3e85d443cb/console/0.log" Jul 15 21:38:45.255134 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:45.255106 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-pmltj_e11bbae4-d50c-46b1-a8bf-8b48ae664c3e/volume-data-source-validator/0.log" Jul 15 21:38:46.447761 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:46.447731 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s2jgz_259f06c8-f250-4e55-bf98-54ae3ac65636/dns/0.log" Jul 15 21:38:46.470123 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:46.470069 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s2jgz_259f06c8-f250-4e55-bf98-54ae3ac65636/kube-rbac-proxy/0.log" Jul 15 21:38:46.552762 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:46.552728 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8gqgn_c238bf35-7bb4-4231-b8dc-e8f0f794425e/dns-node-resolver/0.log" Jul 15 21:38:47.256399 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:47.256369 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k4wxn_bc50d127-1a8d-4a89-8a69-5eb54bef09f4/node-ca/0.log" Jul 15 21:38:48.305512 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:48.305473 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46sl55_b7da38a6-c008-4417-a335-8b0fa45367be/istio-proxy/0.log" Jul 15 21:38:48.428564 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:48.428528 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-b8vg4_a2ef5497-f363-494e-a99f-800727deec6b/discovery/0.log" Jul 15 21:38:48.485683 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:48.485652 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-796df4448b-gqdqj_8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0/kube-auth-proxy/0.log" Jul 15 21:38:48.522957 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:48.522932 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-blfs5_43d84421-d13b-4166-bdb8-71434af867b0/istio-proxy/0.log" Jul 15 21:38:48.550780 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:48.550739 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-blfs5_43d84421-d13b-4166-bdb8-71434af867b0/istio-proxy/1.log" Jul 15 21:38:48.626192 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:48.626167 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-h9ft6_bb39f08d-c4a6-45eb-bf54-eb1b0d29d330/payload-processing/0.log" Jul 15 21:38:48.651780 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:48.651748 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cb6f979db-vqk9s_27a97da1-f66f-45c9-aaa9-a16df8672253/router/0.log" Jul 15 21:38:49.352335 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:49.352307 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hv47s_6a293a93-2b99-4009-80d8-d31045b5fbd8/serve-healthcheck-canary/0.log" Jul 15 21:38:49.415230 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:49.415199 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-69zr9" Jul 15 21:38:49.938304 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:49.938272 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ljh2w_e95cdc29-c50b-4470-a2af-7d158d58d1eb/insights-operator/0.log" Jul 15 21:38:49.940007 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:49.939991 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ljh2w_e95cdc29-c50b-4470-a2af-7d158d58d1eb/insights-operator/1.log" Jul 15 21:38:49.968492 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:49.968463 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5brxm_224bab0f-56d3-42ca-b7c3-7db7b016e4f9/kube-rbac-proxy/0.log" Jul 15 21:38:50.010801 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:50.010756 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5brxm_224bab0f-56d3-42ca-b7c3-7db7b016e4f9/exporter/0.log" Jul 15 21:38:50.039915 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:50.039888 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5brxm_224bab0f-56d3-42ca-b7c3-7db7b016e4f9/extractor/0.log" Jul 15 21:38:53.112836 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:53.112809 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rbxnr_7cd06da3-74c8-4e10-90c2-8e4f4e3073ef/server/0.log" Jul 15 21:38:53.190346 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:53.190250 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mw7zg_17646633-3d76-4b92-b06b-3a345b34fbe8/manager/0.log" Jul 15 21:38:53.216004 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:53.215979 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b849856cb-7fcnp_8818ac7b-9194-4c12-bc03-b3a1e0c086c3/manager/0.log" Jul 15 21:38:53.244653 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:53.244627 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b849856cb-7fcnp_8818ac7b-9194-4c12-bc03-b3a1e0c086c3/copy-manifests/0.log" Jul 15 21:38:53.863337 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:53.863305 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46sl55_b7da38a6-c008-4417-a335-8b0fa45367be/istio-proxy/0.log" Jul 15 21:38:53.978743 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:53.978719 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-b8vg4_a2ef5497-f363-494e-a99f-800727deec6b/discovery/0.log" Jul 15 21:38:54.014753 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:54.014720 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-796df4448b-gqdqj_8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0/kube-auth-proxy/0.log" Jul 15 21:38:54.037701 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:54.037663 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-blfs5_43d84421-d13b-4166-bdb8-71434af867b0/istio-proxy/0.log" Jul 15 21:38:54.069895 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:54.069864 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-blfs5_43d84421-d13b-4166-bdb8-71434af867b0/istio-proxy/1.log" Jul 15 21:38:54.113069 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:54.113042 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-h9ft6_bb39f08d-c4a6-45eb-bf54-eb1b0d29d330/payload-processing/0.log" Jul 15 21:38:54.137929 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:54.137845 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cb6f979db-vqk9s_27a97da1-f66f-45c9-aaa9-a16df8672253/router/0.log" Jul 15 21:38:54.777621 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:54.777578 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9n9qb_8c95bae5-64e1-4c85-bcce-d00d1325fc55/openshift-lws-operator/0.log" Jul 15 21:38:55.385111 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:55.385075 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46sl55_b7da38a6-c008-4417-a335-8b0fa45367be/istio-proxy/0.log" Jul 15 21:38:55.499182 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:55.499153 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-b8vg4_a2ef5497-f363-494e-a99f-800727deec6b/discovery/0.log" Jul 15 21:38:55.530132 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:55.530090 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-796df4448b-gqdqj_8a74c9ee-f3ac-48a8-8c90-f6f75bf8c9d0/kube-auth-proxy/0.log" Jul 15 21:38:55.550430 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:55.550397 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-blfs5_43d84421-d13b-4166-bdb8-71434af867b0/istio-proxy/0.log" Jul 15 21:38:55.584633 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:55.584592 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-blfs5_43d84421-d13b-4166-bdb8-71434af867b0/istio-proxy/1.log" Jul 15 21:38:55.629282 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:55.629254 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-h9ft6_bb39f08d-c4a6-45eb-bf54-eb1b0d29d330/payload-processing/0.log" Jul 15 21:38:55.646274 ip-10-0-138-248 kubenswrapper[2553]: I0715 21:38:55.646202 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cb6f979db-vqk9s_27a97da1-f66f-45c9-aaa9-a16df8672253/router/0.log"