Jul 22 02:14:30.760876 ip-10-0-135-238 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 22 02:14:30.760890 ip-10-0-135-238 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 22 02:14:30.760899 ip-10-0-135-238 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 22 02:14:30.761256 ip-10-0-135-238 systemd[1]: Failed to start Kubernetes Kubelet. Jul 22 02:14:40.886705 ip-10-0-135-238 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 22 02:14:40.886727 ip-10-0-135-238 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ea27d3b234df42ffb2f546b8afc79161 -- Jul 22 02:16:14.807309 ip-10-0-135-238 systemd[1]: Starting Kubernetes Kubelet... Jul 22 02:16:15.253059 ip-10-0-135-238 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 02:16:15.253059 ip-10-0-135-238 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 02:16:15.253059 ip-10-0-135-238 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 02:16:15.253059 ip-10-0-135-238 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 02:16:15.253059 ip-10-0-135-238 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 02:16:15.256061 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.255966 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 02:16:15.262997 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.262977 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:15.262997 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.262996 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:15.262997 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263000 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263003 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263006 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263010 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263015 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263020 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263026 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263029 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263032 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263035 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263037 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263040 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263043 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263045 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263048 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263051 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263053 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263056 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263060 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263063 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:15.263095 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263065 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263068 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263072 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263076 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263080 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263083 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263087 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263090 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263093 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263095 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263098 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263101 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263105 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263108 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263111 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263114 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263116 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263119 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263121 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:15.263567 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263124 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263127 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263129 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263133 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263137 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263141 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263144 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263147 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263150 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263152 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263155 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263157 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263160 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263162 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263165 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263169 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263172 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263174 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263177 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263180 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:15.264291 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263183 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263186 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263188 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263191 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263193 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263196 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263198 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263201 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263203 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263206 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263208 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263211 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263213 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263216 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263218 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263220 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263223 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263226 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263228 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263231 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:15.265101 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263233 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263236 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263238 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263240 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263243 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263246 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263250 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263253 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263255 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263258 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263260 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263263 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263269 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263272 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263275 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263277 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263280 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.263282 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265852 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265870 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:15.265925 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265876 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265881 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265886 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265892 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265903 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265907 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265912 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265916 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265921 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265929 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265936 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265941 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265946 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265975 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265981 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265991 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.265995 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266001 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266006 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:15.266787 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266011 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266015 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266020 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266024 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266029 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266033 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266040 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266047 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266052 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266064 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266069 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266074 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266088 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266094 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266098 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266102 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266107 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266112 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266117 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:15.267634 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266121 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266136 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266140 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266145 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266149 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266153 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266157 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266162 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266167 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266171 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266176 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266180 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266185 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266189 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266198 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266203 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266208 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266215 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266219 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266223 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:15.268471 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266228 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266232 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266237 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266241 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266246 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266250 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266268 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266272 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266279 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266285 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266296 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266301 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266306 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266311 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266316 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266320 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266325 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266329 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266339 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266343 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:15.269349 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266347 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266352 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266356 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266360 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266365 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266369 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266373 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266378 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266382 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266387 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266391 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266399 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266405 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266410 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266415 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266420 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266424 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266428 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.266433 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267718 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:15.270266 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267728 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267734 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267738 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267749 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267755 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267764 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267769 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267773 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267778 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267782 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267787 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267794 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267801 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267806 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267812 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267842 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267850 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267860 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267865 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:15.270937 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267870 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267875 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267879 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267885 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267890 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267895 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267902 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267912 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267916 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267925 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267930 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267934 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267947 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267968 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267973 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267977 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267981 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267985 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267990 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267995 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:15.271503 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.267999 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268003 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268012 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268016 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268020 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268024 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268039 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268044 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268048 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268053 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268057 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268061 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268071 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268075 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268080 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268089 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268096 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268101 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268106 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268112 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:15.272123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268117 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268122 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268127 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268131 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268136 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268148 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268153 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268162 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268167 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268174 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268178 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268183 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268187 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268191 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268196 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268200 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268205 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268209 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268214 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268223 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:15.272866 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268231 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268236 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268240 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268245 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268250 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268254 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268259 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268264 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268268 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268273 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268277 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268282 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268292 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268297 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268301 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268306 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268310 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268315 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.268331 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268485 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268498 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 02:16:15.273405 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268514 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268522 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268529 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268534 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268547 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268561 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268566 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268571 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268577 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268582 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268588 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268593 2556 flags.go:64] FLAG: --cgroup-root="" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268599 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268608 2556 flags.go:64] FLAG: --client-ca-file="" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268613 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268618 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268629 2556 flags.go:64] FLAG: --cluster-domain="" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268634 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268640 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268646 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268652 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268662 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268667 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 02:16:15.273971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268673 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268679 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268684 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268689 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268694 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268699 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268704 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268731 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268737 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268742 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268747 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268752 2556 flags.go:64] FLAG: --enable-server="true" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268757 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268770 2556 flags.go:64] FLAG: --event-burst="100" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268775 2556 flags.go:64] FLAG: --event-qps="50" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268785 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268790 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268795 2556 flags.go:64] FLAG: --eviction-hard="" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268802 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268807 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268812 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268818 2556 flags.go:64] FLAG: --eviction-soft="" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268823 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268832 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268837 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 02:16:15.274607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268842 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268847 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268853 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268857 2556 flags.go:64] FLAG: --feature-gates="" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268864 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268869 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268879 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268889 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268894 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268900 2556 flags.go:64] FLAG: --help="false" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268905 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-135-238.ec2.internal" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268910 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268915 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268920 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268927 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268946 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268967 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268972 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268977 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268982 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268987 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268993 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.268998 2556 flags.go:64] FLAG: --kube-reserved="" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269003 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 02:16:15.275338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269013 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269018 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269022 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269028 2556 flags.go:64] FLAG: --lock-file="" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269032 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269037 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269043 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269052 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269062 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269069 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269074 2556 flags.go:64] FLAG: --logging-format="text" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269079 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269086 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269096 2556 flags.go:64] FLAG: --manifest-url="" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269104 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269112 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269118 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269129 2556 flags.go:64] FLAG: --max-pods="110" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269134 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269139 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269144 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269149 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269155 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269160 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269174 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 02:16:15.275963 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269198 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269203 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269208 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269213 2556 flags.go:64] FLAG: --pod-cidr="" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269218 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269228 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269233 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269243 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269248 2556 flags.go:64] FLAG: --port="10250" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269253 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269258 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a6113b31e6aa9511" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269264 2556 flags.go:64] FLAG: --qos-reserved="" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269269 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269275 2556 flags.go:64] FLAG: --register-node="true" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269280 2556 flags.go:64] FLAG: --register-with-taints="" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269287 2556 flags.go:64] FLAG: --registry-burst="10" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269298 2556 flags.go:64] FLAG: --registry-qps="5" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269303 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269308 2556 flags.go:64] FLAG: --reserved-memory="" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269316 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269322 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269327 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269333 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269338 2556 flags.go:64] FLAG: --runonce="false" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269353 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 02:16:15.276582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269358 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269363 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269368 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269373 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269378 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269383 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269389 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269402 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269413 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269418 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269423 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269428 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269434 2556 flags.go:64] FLAG: --system-cgroups="" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269439 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269454 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269459 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269463 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269476 2556 flags.go:64] FLAG: --tls-min-version="" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269482 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269487 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269491 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269496 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269502 2556 flags.go:64] FLAG: --v="2" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269522 2556 flags.go:64] FLAG: --version="false" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269529 2556 flags.go:64] FLAG: --vmodule="" Jul 22 02:16:15.277268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269535 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.269541 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270019 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270028 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270036 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270040 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270045 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270049 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270054 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270058 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270068 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270073 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270077 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270084 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270090 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270104 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270110 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270115 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270122 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:15.277964 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270128 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270134 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270138 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270153 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270159 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270164 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270169 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270173 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270177 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270182 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270187 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270193 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270198 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270203 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270207 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270216 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270220 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270227 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270231 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270236 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:15.278455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270240 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270245 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270249 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270254 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270258 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270262 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270267 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270271 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270279 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270291 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270296 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270301 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270306 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270317 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270322 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270327 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270331 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270336 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270340 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270344 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:15.278986 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270349 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270358 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270362 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270369 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270373 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270380 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270385 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270390 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270395 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270401 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270405 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270410 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270414 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270424 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270429 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270434 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270438 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270443 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270447 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:15.279480 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270452 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270456 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270461 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270485 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270491 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270495 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270504 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270509 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270513 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270518 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270524 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270528 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270533 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270537 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270541 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270546 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270553 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270558 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270562 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270571 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:15.279963 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270576 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270581 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.270587 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.271319 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.279060 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.279084 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.279787 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.279798 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279867 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279874 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279877 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279881 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279884 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279888 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279891 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:15.280462 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279894 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279898 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279900 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279903 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279906 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279909 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279911 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279914 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279917 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279920 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279923 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279925 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279929 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279931 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279934 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279936 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279939 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279942 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279945 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279948 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:15.280855 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279964 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279969 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279972 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279976 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279979 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279982 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279986 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279990 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279993 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279996 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.279999 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280002 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280005 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280008 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280011 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280014 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280017 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280020 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280023 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:15.281450 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280027 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280031 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280034 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280037 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280040 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280043 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280045 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280048 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280051 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280054 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280056 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280059 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280062 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280065 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280067 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280071 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280074 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280096 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280100 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280104 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:15.281909 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280108 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280111 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280114 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280117 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280120 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280123 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280126 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280129 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280132 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280134 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280137 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280140 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280143 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280146 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280150 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280154 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280157 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280160 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280162 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:15.282423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280165 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280168 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280170 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280173 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280175 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280178 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280180 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280183 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280187 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280190 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280193 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280195 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280198 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280200 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.280205 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280349 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 02:16:15.282902 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280355 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280358 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280361 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280364 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280367 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280369 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280372 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280374 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280377 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280380 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280382 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280385 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280388 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280390 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280393 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280396 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280398 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280401 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280403 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280406 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 02:16:15.283332 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280408 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280411 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280414 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280417 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280420 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280423 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280425 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280428 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280431 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280433 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280436 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280439 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280442 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280444 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280447 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280450 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280452 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280455 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280458 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280460 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 02:16:15.283845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280463 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280467 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280470 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280473 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280477 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280481 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280484 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280487 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280490 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280492 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280495 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280498 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280500 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280503 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280507 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280510 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280513 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280515 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280518 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 02:16:15.284454 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280521 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280523 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280526 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280528 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280531 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280533 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280536 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280539 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280541 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280543 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280546 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280548 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280551 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280553 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280555 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280558 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280562 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280565 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280569 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 02:16:15.284916 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280572 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280575 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280577 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280580 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280583 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280586 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280588 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280591 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280594 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280596 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280598 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280601 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280604 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280606 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280609 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280611 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280614 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280616 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280619 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 02:16:15.285497 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:15.280621 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 02:16:15.285976 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.280626 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 02:16:15.285976 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.280781 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 02:16:15.285976 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.283578 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 02:16:15.285976 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.284977 2556 server.go:1019] "Starting client certificate rotation" Jul 22 02:16:15.285976 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.285092 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 02:16:15.285976 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.285153 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 02:16:15.287468 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.287448 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 02:16:15.288930 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.288911 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 02:16:15.302831 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.302796 2556 log.go:25] "Validated CRI v1 runtime API" Jul 22 02:16:15.305535 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.305516 2556 log.go:25] "Validated CRI v1 image API" Jul 22 02:16:15.306430 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.306414 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 02:16:15.311735 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.311709 2556 fs.go:135] Filesystem UUIDs: map[78960119-1866-4977-be46-2e721edb79ff:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d463e82f-ff69-4f50-9fcf-15af97b11900:/dev/nvme0n1p4] Jul 22 02:16:15.311834 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.311732 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 02:16:15.317317 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.317291 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 02:16:15.318828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.318708 2556 manager.go:216] Machine: {Timestamp:2026-07-22 02:16:15.31726654 +0000 UTC m=+0.382280133 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3090749 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aecc9585c2942063288df614c1668 SystemUUID:ec2aecc9-585c-2942-0632-88df614c1668 BootID:ea27d3b2-34df-42ff-b2f5-46b8afc79161 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:16:cc:5d:ff:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:16:cc:5d:ff:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:38:3e:d2:54:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 02:16:15.318828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.318821 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 02:16:15.318973 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.318913 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 02:16:15.322548 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.322518 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 02:16:15.322700 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.322551 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 02:16:15.323918 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.323906 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 02:16:15.323980 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.323920 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 02:16:15.323980 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.323929 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 02:16:15.324561 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.324548 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 02:16:15.325871 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.325858 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 02:16:15.329250 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.329236 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 22 02:16:15.329387 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.329377 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 02:16:15.329424 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.329412 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 22 02:16:15.329455 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.329434 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 02:16:15.329485 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.329455 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 02:16:15.329485 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.329469 2556 kubelet.go:398] "Adding apiserver pod source" Jul 22 02:16:15.329485 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.329483 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 02:16:15.330023 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.330009 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 02:16:15.330099 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.330030 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 02:16:15.332315 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.332293 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 02:16:15.333823 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.333808 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 02:16:15.333868 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.333840 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 02:16:15.334547 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334535 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 02:16:15.334593 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334552 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 02:16:15.334593 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334559 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 02:16:15.334593 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334567 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 02:16:15.334593 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334588 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 02:16:15.334697 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334597 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 02:16:15.334697 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334609 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 02:16:15.334697 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334617 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 02:16:15.334697 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334627 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 02:16:15.334697 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334636 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 02:16:15.334697 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334648 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 02:16:15.334697 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.334654 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 02:16:15.335380 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.335368 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 02:16:15.335380 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.335379 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 02:16:15.338758 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.338741 2556 server.go:1268] "Started kubelet" Jul 22 02:16:15.338903 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.338845 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 02:16:15.338983 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.338930 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 02:16:15.339087 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.339051 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 02:16:15.339623 ip-10-0-135-238 systemd[1]: Started Kubernetes Kubelet. Jul 22 02:16:15.340398 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.340269 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 02:16:15.340675 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.340662 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 02:16:15.340853 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.340829 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 02:16:15.340921 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.340882 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 02:16:15.341358 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.341339 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 22 02:16:15.345481 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.345440 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 02:16:15.351821 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.350668 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-238.ec2.internal.18c47afc0e78da05 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-238.ec2.internal,UID:ip-10-0-135-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-238.ec2.internal,},FirstTimestamp:2026-07-22 02:16:15.338707461 +0000 UTC m=+0.403721053,LastTimestamp:2026-07-22 02:16:15.338707461 +0000 UTC m=+0.403721053,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-238.ec2.internal,}" Jul 22 02:16:15.355330 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.355313 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 02:16:15.355426 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.355366 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 02:16:15.355476 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.355436 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:15.356341 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356321 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 02:16:15.356341 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356341 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 02:16:15.356486 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356320 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 02:16:15.356486 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356423 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 22 02:16:15.356486 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356431 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 22 02:16:15.356618 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356535 2556 factory.go:153] Registering CRI-O factory Jul 22 02:16:15.356618 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356552 2556 factory.go:223] Registration of the crio container factory successfully Jul 22 02:16:15.356618 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356608 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 02:16:15.356618 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356618 2556 factory.go:55] Registering systemd factory Jul 22 02:16:15.356793 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356625 2556 factory.go:223] Registration of the systemd container factory successfully Jul 22 02:16:15.356793 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356649 2556 factory.go:103] Registering Raw factory Jul 22 02:16:15.356793 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.356667 2556 manager.go:1196] Started watching for new ooms in manager Jul 22 02:16:15.357135 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.357121 2556 manager.go:349] Starting recovery of all containers Jul 22 02:16:15.358738 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.358700 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 02:16:15.359863 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.358475 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 02:16:15.366235 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.366194 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 02:16:15.369842 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.369822 2556 manager.go:354] Recovery completed Jul 22 02:16:15.374346 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.374327 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:15.376158 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.376139 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:15.376230 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.376176 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:15.376230 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.376190 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:15.376799 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.376782 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 02:16:15.376799 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.376795 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 02:16:15.376928 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.376799 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:15.376928 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.376810 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 22 02:16:15.377230 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.377212 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r4g27" Jul 22 02:16:15.377544 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.377530 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:15.377608 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.377555 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:15.377608 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.377565 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:15.378083 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.378068 2556 policy_none.go:49] "None policy: Start" Jul 22 02:16:15.378164 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.378090 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 02:16:15.378164 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.378101 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 02:16:15.379125 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.379114 2556 policy_none.go:47] "Start" Jul 22 02:16:15.385575 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.385558 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r4g27" Jul 22 02:16:15.386524 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.386448 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-238.ec2.internal.18c47afc10b451bb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-238.ec2.internal,UID:ip-10-0-135-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-238.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-238.ec2.internal,},FirstTimestamp:2026-07-22 02:16:15.376159163 +0000 UTC m=+0.441172757,LastTimestamp:2026-07-22 02:16:15.376159163 +0000 UTC m=+0.441172757,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-238.ec2.internal,}" Jul 22 02:16:15.430948 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.417571 2556 manager.go:337] "Starting Device Plugin manager" Jul 22 02:16:15.430948 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.417611 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 02:16:15.430948 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.417625 2556 server.go:87] "Starting device plugin registration server" Jul 22 02:16:15.430948 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.417912 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 02:16:15.430948 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.417928 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 02:16:15.430948 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.418081 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 02:16:15.430948 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.418175 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 02:16:15.430948 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.418183 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 02:16:15.430948 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.419007 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 02:16:15.430948 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.419053 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:15.459396 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.459243 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 02:16:15.459533 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.459415 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 02:16:15.459533 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.459437 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 02:16:15.459533 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.459470 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 02:16:15.462472 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.462448 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:15.519069 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.518983 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:15.520336 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.520318 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:15.520410 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.520353 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:15.520410 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.520392 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:15.520487 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.520432 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-238.ec2.internal" Jul 22 02:16:15.532136 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.532111 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-238.ec2.internal" Jul 22 02:16:15.532136 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.532138 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-238.ec2.internal\": node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:15.559609 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.559574 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-238.ec2.internal"] Jul 22 02:16:15.559770 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.559662 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:15.561098 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.561084 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:15.561155 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.561112 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:15.561155 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.561122 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:15.562367 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.562354 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:15.562469 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.562455 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" Jul 22 02:16:15.562503 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.562492 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:15.563256 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.563237 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:15.563361 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.563268 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:15.563361 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.563280 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:15.563361 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.563237 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:15.563361 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.563337 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:15.563361 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.563351 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:15.564640 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.564623 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-238.ec2.internal" Jul 22 02:16:15.564758 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.564667 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 02:16:15.565453 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.565437 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientMemory" Jul 22 02:16:15.565545 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.565463 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 02:16:15.565545 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.565475 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeHasSufficientPID" Jul 22 02:16:15.592817 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.592791 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-238.ec2.internal\" not found" node="ip-10-0-135-238.ec2.internal" Jul 22 02:16:15.595003 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.594981 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:15.597406 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.597388 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-238.ec2.internal\" not found" node="ip-10-0-135-238.ec2.internal" Jul 22 02:16:15.657555 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.657522 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/233e7ab40d6c94cf412611ca0a9e2f56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal\" (UID: \"233e7ab40d6c94cf412611ca0a9e2f56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" Jul 22 02:16:15.657555 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.657555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/233e7ab40d6c94cf412611ca0a9e2f56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal\" (UID: \"233e7ab40d6c94cf412611ca0a9e2f56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" Jul 22 02:16:15.657703 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:15.657579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43547df299046b716198ac6f0727dbc5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-238.ec2.internal\" (UID: \"43547df299046b716198ac6f0727dbc5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-238.ec2.internal" Jul 22 02:16:15.695850 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:15.695824 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:17.317615 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.317583 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/233e7ab40d6c94cf412611ca0a9e2f56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal\" (UID: \"233e7ab40d6c94cf412611ca0a9e2f56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" Jul 22 02:16:17.317615 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.317616 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43547df299046b716198ac6f0727dbc5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-238.ec2.internal\" (UID: \"43547df299046b716198ac6f0727dbc5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-238.ec2.internal" Jul 22 02:16:17.317750 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.317634 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/233e7ab40d6c94cf412611ca0a9e2f56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal\" (UID: \"233e7ab40d6c94cf412611ca0a9e2f56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" Jul 22 02:16:17.317750 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.317678 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/233e7ab40d6c94cf412611ca0a9e2f56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal\" (UID: \"233e7ab40d6c94cf412611ca0a9e2f56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" Jul 22 02:16:17.317750 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.317743 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/233e7ab40d6c94cf412611ca0a9e2f56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal\" (UID: \"233e7ab40d6c94cf412611ca0a9e2f56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" Jul 22 02:16:17.317842 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.317775 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43547df299046b716198ac6f0727dbc5-config\") pod \"kube-apiserver-proxy-ip-10-0-135-238.ec2.internal\" (UID: \"43547df299046b716198ac6f0727dbc5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-238.ec2.internal" Jul 22 02:16:17.355914 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:17.355849 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:17.453651 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.453610 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" Jul 22 02:16:17.455967 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:17.455947 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:17.460380 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.460358 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-238.ec2.internal" Jul 22 02:16:17.556393 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:17.556344 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:17.656881 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:17.656810 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:17.757399 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:17.757362 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:17.843879 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.843843 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 02:16:17.844311 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.844019 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 02:16:17.858176 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:17.858154 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:17.949643 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.949545 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 02:11:16 +0000 UTC" deadline="2028-04-15 16:36:47.94538809 +0000 UTC" Jul 22 02:16:17.949643 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:17.949580 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15206h20m29.995811829s" Jul 22 02:16:17.958709 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:17.958678 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:18.058922 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:18.058883 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-238.ec2.internal\" not found" Jul 22 02:16:18.087022 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.086994 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:18.090678 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:18.090641 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod233e7ab40d6c94cf412611ca0a9e2f56.slice/crio-8dd9d53d9da9a4abf7c705dfac2b06bbc42636afbb6fd12c1c31fd602c5c5d85 WatchSource:0}: Error finding container 8dd9d53d9da9a4abf7c705dfac2b06bbc42636afbb6fd12c1c31fd602c5c5d85: Status 404 returned error can't find the container with id 8dd9d53d9da9a4abf7c705dfac2b06bbc42636afbb6fd12c1c31fd602c5c5d85 Jul 22 02:16:18.091165 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:18.091145 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43547df299046b716198ac6f0727dbc5.slice/crio-db7287484865139bcd996aecd62e3a9a8defbef9941bfb8ab7b6375f68db0543 WatchSource:0}: Error finding container db7287484865139bcd996aecd62e3a9a8defbef9941bfb8ab7b6375f68db0543: Status 404 returned error can't find the container with id db7287484865139bcd996aecd62e3a9a8defbef9941bfb8ab7b6375f68db0543 Jul 22 02:16:18.096208 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.096182 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:16:18.115131 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.115100 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" Jul 22 02:16:18.129603 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.129574 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 02:16:18.131673 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.131653 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-238.ec2.internal" Jul 22 02:16:18.141246 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.141220 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 02:16:18.316111 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.316023 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:18.461648 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.461615 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:18.889818 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.889790 2556 apiserver.go:52] "Watching apiserver" Jul 22 02:16:18.897035 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.897008 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 02:16:18.897424 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.897402 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-whfqq","kube-system/konnectivity-agent-xxxj8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56","openshift-multus/multus-additional-cni-plugins-7vfd6","openshift-multus/multus-mk7bq","openshift-multus/network-metrics-daemon-nknbl","openshift-network-diagnostics/network-check-target-t66zg","openshift-network-operator/iptables-alerter-tjt2t","kube-system/kube-apiserver-proxy-ip-10-0-135-238.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9fk6s","openshift-dns/node-resolver-8hjrj","openshift-image-registry/node-ca-79gb4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-gx5c8"] Jul 22 02:16:18.898940 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.898919 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:18.899054 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:18.899012 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:18.900802 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.900787 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8hjrj" Jul 22 02:16:18.902081 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.902050 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:18.903172 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.903153 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 02:16:18.903271 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.903188 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 02:16:18.903271 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.903217 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6l9d4\"" Jul 22 02:16:18.904074 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.904055 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8sfsg\"" Jul 22 02:16:18.904760 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.904329 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 02:16:18.904760 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.904551 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:18.904889 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.904777 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 02:16:18.905086 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.905064 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 02:16:18.906423 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.906405 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.906939 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.906921 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 02:16:18.908044 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.907971 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 02:16:18.911221 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.908417 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 02:16:18.911221 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.908452 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vr886\"" Jul 22 02:16:18.911221 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.908821 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 02:16:18.911221 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.909009 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 02:16:18.911221 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.909257 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8rmtw\"" Jul 22 02:16:18.911221 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.909420 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 02:16:18.911221 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.909609 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:18.911221 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:18.909689 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:18.911878 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.911356 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.912456 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.912438 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tjt2t" Jul 22 02:16:18.914163 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.914142 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 02:16:18.914373 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.914356 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 02:16:18.914453 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.914413 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 02:16:18.914678 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.914661 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:18.915368 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.915346 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 02:16:18.915527 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.915488 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x7whw\"" Jul 22 02:16:18.915640 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.915617 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 02:16:18.915743 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.915643 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 02:16:18.916374 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.916279 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 02:16:18.916374 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.916298 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 02:16:18.916509 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.916487 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:16:18.916566 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.916537 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.916618 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.916602 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2cjg\"" Jul 22 02:16:18.916670 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.916649 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 02:16:18.917091 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.917073 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l4fjd\"" Jul 22 02:16:18.917227 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.917208 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 02:16:18.917335 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.917164 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 02:16:18.918096 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.918023 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:18.918296 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:18.918268 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:18.919378 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.918910 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:16:18.919378 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.919010 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 02:16:18.919378 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.919296 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4rmgv\"" Jul 22 02:16:18.919794 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.919772 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-79gb4" Jul 22 02:16:18.921761 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.921743 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 02:16:18.921966 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.921952 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 02:16:18.922071 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.922060 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 02:16:18.922229 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.922213 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mgp4t\"" Jul 22 02:16:18.926673 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.926648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-node-log\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.926773 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.926738 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-cni-bin\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.926773 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.926764 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-lib-modules\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.926886 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.926824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-var-lib-cni-bin\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.926886 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.926880 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-sys\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.927025 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.926904 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/90829ff4-eea6-4fab-bbbc-c03855b2f347-hosts-file\") pod \"node-resolver-8hjrj\" (UID: \"90829ff4-eea6-4fab-bbbc-c03855b2f347\") " pod="openshift-dns/node-resolver-8hjrj" Jul 22 02:16:18.927025 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.926954 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-device-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:18.927025 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-cnibin\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.927184 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-run-openvswitch\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.927184 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-ovnkube-script-lib\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.927184 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnh6f\" (UniqueName: \"kubernetes.io/projected/a8213007-e56c-4d28-b527-7b4bdadc93bf-kube-api-access-hnh6f\") pod \"iptables-alerter-tjt2t\" (UID: \"a8213007-e56c-4d28-b527-7b4bdadc93bf\") " pod="openshift-network-operator/iptables-alerter-tjt2t" Jul 22 02:16:18.927184 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927163 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/952f0b8d-d367-4aad-a348-9c808ac7e554-cni-binary-copy\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.927376 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85gvw\" (UniqueName: \"kubernetes.io/projected/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-kube-api-access-85gvw\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.927376 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927236 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-sysctl-conf\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.927376 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927279 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80c1edab-fed5-4b64-b763-4afd12faa9f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:18.927376 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927323 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-etc-kubernetes\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.927376 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927349 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-cni-netd\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.927631 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927413 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h427\" (UniqueName: \"kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427\") pod \"network-check-target-t66zg\" (UID: \"5e549457-84be-4f37-93be-3134c87472dd\") " pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:18.927631 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927443 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-registration-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:18.927631 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927473 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5vcc\" (UniqueName: \"kubernetes.io/projected/80c1edab-fed5-4b64-b763-4afd12faa9f6-kube-api-access-v5vcc\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:18.927631 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927502 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-run-netns\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.927631 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptmnl\" (UniqueName: \"kubernetes.io/projected/952f0b8d-d367-4aad-a348-9c808ac7e554-kube-api-access-ptmnl\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.927631 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927591 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-var-lib-kubelet\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.927631 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927617 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-socket-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-etc-selinux\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927677 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-var-lib-cni-multus\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927707 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb9601e3-b459-493e-b6ba-0c195220abb7-agent-certs\") pod \"konnectivity-agent-xxxj8\" (UID: \"bb9601e3-b459-493e-b6ba-0c195220abb7\") " pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927752 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-run-ovn\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d06eb219-0708-42d0-a92d-1e63cd73b8dd-tmp\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927782 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927808 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80c1edab-fed5-4b64-b763-4afd12faa9f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927826 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-cni-dir\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927853 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-run-k8s-cni-cncf-io\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8213007-e56c-4d28-b527-7b4bdadc93bf-iptables-alerter-script\") pod \"iptables-alerter-tjt2t\" (UID: \"a8213007-e56c-4d28-b527-7b4bdadc93bf\") " pod="openshift-network-operator/iptables-alerter-tjt2t" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927912 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-slash\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.927931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927933 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-run\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927956 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl8nl\" (UniqueName: \"kubernetes.io/projected/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-kube-api-access-tl8nl\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927954 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.927996 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-run-multus-certs\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-run-netns\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-sysctl-d\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928098 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfz5d\" (UniqueName: \"kubernetes.io/projected/d06eb219-0708-42d0-a92d-1e63cd73b8dd-kube-api-access-sfz5d\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928148 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-system-cni-dir\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-os-release\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928205 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-var-lib-kubelet\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928229 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-kubelet\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928257 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-log-socket\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928293 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8213007-e56c-4d28-b527-7b4bdadc93bf-host-slash\") pod \"iptables-alerter-tjt2t\" (UID: \"a8213007-e56c-4d28-b527-7b4bdadc93bf\") " pod="openshift-network-operator/iptables-alerter-tjt2t" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928322 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-conf-dir\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdncq\" (UniqueName: \"kubernetes.io/projected/b4fdd84d-94fb-4906-b6f1-eb49521f2377-kube-api-access-zdncq\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928396 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb9601e3-b459-493e-b6ba-0c195220abb7-konnectivity-ca\") pod \"konnectivity-agent-xxxj8\" (UID: \"bb9601e3-b459-493e-b6ba-0c195220abb7\") " pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928420 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.928571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-ovn-node-metrics-cert\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928477 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-systemd\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928530 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-host\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928554 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-socket-dir-parent\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-modprobe-d\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928599 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-systemd-units\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-var-lib-openvswitch\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928651 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928675 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-kubernetes\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928732 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-tuned\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928754 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvn8l\" (UniqueName: \"kubernetes.io/projected/90829ff4-eea6-4fab-bbbc-c03855b2f347-kube-api-access-hvn8l\") pod \"node-resolver-8hjrj\" (UID: \"90829ff4-eea6-4fab-bbbc-c03855b2f347\") " pod="openshift-dns/node-resolver-8hjrj" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928779 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80c1edab-fed5-4b64-b763-4afd12faa9f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928806 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-system-cni-dir\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928827 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-hostroot\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-etc-openvswitch\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928885 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-run-systemd\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.929528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928909 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-ovnkube-config\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.930209 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928940 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-env-overrides\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:18.930209 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.928966 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90829ff4-eea6-4fab-bbbc-c03855b2f347-tmp-dir\") pod \"node-resolver-8hjrj\" (UID: \"90829ff4-eea6-4fab-bbbc-c03855b2f347\") " pod="openshift-dns/node-resolver-8hjrj" Jul 22 02:16:18.930209 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.929006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-sys-fs\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:18.930209 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.929031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-os-release\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:18.930209 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.929055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:18.930209 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.929079 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-sysconfig\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:18.930209 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.929163 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-cnibin\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:18.930209 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.929187 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-daemon-config\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:18.950885 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.950855 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmq98" Jul 22 02:16:18.959147 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:18.958992 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmq98" Jul 22 02:16:19.016757 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.016692 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 02:16:19.027470 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.027413 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-238.ec2.internal" event={"ID":"43547df299046b716198ac6f0727dbc5","Type":"ContainerStarted","Data":"db7287484865139bcd996aecd62e3a9a8defbef9941bfb8ab7b6375f68db0543"} Jul 22 02:16:19.029075 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029045 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" event={"ID":"233e7ab40d6c94cf412611ca0a9e2f56","Type":"ContainerStarted","Data":"8dd9d53d9da9a4abf7c705dfac2b06bbc42636afbb6fd12c1c31fd602c5c5d85"} Jul 22 02:16:19.029596 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029571 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-modprobe-d\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.029672 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-systemd-units\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.029672 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-var-lib-openvswitch\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.029672 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.029828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-kubernetes\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.029828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029700 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-tuned\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.029828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-dbus\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:19.029828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57d753f0-2e81-4640-ae5f-ec2649d0a1f5-serviceca\") pod \"node-ca-79gb4\" (UID: \"57d753f0-2e81-4640-ae5f-ec2649d0a1f5\") " pod="openshift-image-registry/node-ca-79gb4" Jul 22 02:16:19.029828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029748 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-modprobe-d\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.029828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029768 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvn8l\" (UniqueName: \"kubernetes.io/projected/90829ff4-eea6-4fab-bbbc-c03855b2f347-kube-api-access-hvn8l\") pod \"node-resolver-8hjrj\" (UID: \"90829ff4-eea6-4fab-bbbc-c03855b2f347\") " pod="openshift-dns/node-resolver-8hjrj" Jul 22 02:16:19.029828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029794 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80c1edab-fed5-4b64-b763-4afd12faa9f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.029828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029805 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-kubernetes\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.029828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029824 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-system-cni-dir\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-hostroot\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029881 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029886 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-var-lib-openvswitch\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029913 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-etc-openvswitch\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029935 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-run-systemd\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-ovnkube-config\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-env-overrides\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030033 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90829ff4-eea6-4fab-bbbc-c03855b2f347-tmp-dir\") pod \"node-resolver-8hjrj\" (UID: \"90829ff4-eea6-4fab-bbbc-c03855b2f347\") " pod="openshift-dns/node-resolver-8hjrj" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-sys-fs\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030077 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-os-release\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030101 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030123 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-sysconfig\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-cnibin\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030177 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-daemon-config\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030202 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-node-log\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030226 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-cni-bin\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.030255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030249 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-lib-modules\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-var-lib-cni-bin\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030273 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n54ps\" (UniqueName: \"kubernetes.io/projected/57d753f0-2e81-4640-ae5f-ec2649d0a1f5-kube-api-access-n54ps\") pod \"node-ca-79gb4\" (UID: \"57d753f0-2e81-4640-ae5f-ec2649d0a1f5\") " pod="openshift-image-registry/node-ca-79gb4" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030334 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-sys\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030353 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/90829ff4-eea6-4fab-bbbc-c03855b2f347-hosts-file\") pod \"node-resolver-8hjrj\" (UID: \"90829ff4-eea6-4fab-bbbc-c03855b2f347\") " pod="openshift-dns/node-resolver-8hjrj" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-device-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-cnibin\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030416 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-kubelet-config\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030443 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-run-openvswitch\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-ovnkube-script-lib\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030492 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnh6f\" (UniqueName: \"kubernetes.io/projected/a8213007-e56c-4d28-b527-7b4bdadc93bf-kube-api-access-hnh6f\") pod \"iptables-alerter-tjt2t\" (UID: \"a8213007-e56c-4d28-b527-7b4bdadc93bf\") " pod="openshift-network-operator/iptables-alerter-tjt2t" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/952f0b8d-d367-4aad-a348-9c808ac7e554-cni-binary-copy\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85gvw\" (UniqueName: \"kubernetes.io/projected/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-kube-api-access-85gvw\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030552 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030563 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-sysctl-conf\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030596 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80c1edab-fed5-4b64-b763-4afd12faa9f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030620 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-etc-openvswitch\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.030815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030632 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-etc-kubernetes\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030659 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-cni-netd\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030683 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h427\" (UniqueName: \"kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427\") pod \"network-check-target-t66zg\" (UID: \"5e549457-84be-4f37-93be-3134c87472dd\") " pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-registration-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030732 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5vcc\" (UniqueName: \"kubernetes.io/projected/80c1edab-fed5-4b64-b763-4afd12faa9f6-kube-api-access-v5vcc\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-run-netns\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030780 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptmnl\" (UniqueName: \"kubernetes.io/projected/952f0b8d-d367-4aad-a348-9c808ac7e554-kube-api-access-ptmnl\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030804 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-var-lib-kubelet\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-socket-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-etc-selinux\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d753f0-2e81-4640-ae5f-ec2649d0a1f5-host\") pod \"node-ca-79gb4\" (UID: \"57d753f0-2e81-4640-ae5f-ec2649d0a1f5\") " pod="openshift-image-registry/node-ca-79gb4" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030919 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-var-lib-cni-multus\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030942 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030968 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb9601e3-b459-493e-b6ba-0c195220abb7-agent-certs\") pod \"konnectivity-agent-xxxj8\" (UID: \"bb9601e3-b459-493e-b6ba-0c195220abb7\") " pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-run-ovn\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031031 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d06eb219-0708-42d0-a92d-1e63cd73b8dd-tmp\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.031514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031082 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80c1edab-fed5-4b64-b763-4afd12faa9f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031109 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-cni-dir\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031140 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-run-k8s-cni-cncf-io\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8213007-e56c-4d28-b527-7b4bdadc93bf-iptables-alerter-script\") pod \"iptables-alerter-tjt2t\" (UID: \"a8213007-e56c-4d28-b527-7b4bdadc93bf\") " pod="openshift-network-operator/iptables-alerter-tjt2t" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031193 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-slash\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-run\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031247 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl8nl\" (UniqueName: \"kubernetes.io/projected/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-kube-api-access-tl8nl\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031274 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-run-multus-certs\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031300 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-run-netns\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-sysctl-d\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031330 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-ovnkube-config\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031372 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-sysconfig\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfz5d\" (UniqueName: \"kubernetes.io/projected/d06eb219-0708-42d0-a92d-1e63cd73b8dd-kube-api-access-sfz5d\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031415 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-system-cni-dir\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031430 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-cnibin\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031441 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-os-release\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031468 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-var-lib-kubelet\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.032263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031484 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-node-log\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031484 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031495 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-kubelet\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031536 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-log-socket\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031541 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-system-cni-dir\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8213007-e56c-4d28-b527-7b4bdadc93bf-host-slash\") pod \"iptables-alerter-tjt2t\" (UID: \"a8213007-e56c-4d28-b527-7b4bdadc93bf\") " pod="openshift-network-operator/iptables-alerter-tjt2t" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031585 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-hostroot\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-conf-dir\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031625 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdncq\" (UniqueName: \"kubernetes.io/projected/b4fdd84d-94fb-4906-b6f1-eb49521f2377-kube-api-access-zdncq\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031651 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb9601e3-b459-493e-b6ba-0c195220abb7-konnectivity-ca\") pod \"konnectivity-agent-xxxj8\" (UID: \"bb9601e3-b459-493e-b6ba-0c195220abb7\") " pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031679 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-ovn-node-metrics-cert\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031735 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-systemd\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-host\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-socket-dir-parent\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031866 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-system-cni-dir\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031950 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-socket-dir-parent\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031960 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-os-release\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.033073 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031962 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-daemon-config\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.031443 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-sysctl-d\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032010 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-kubelet\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032015 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-cni-bin\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032067 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-cni-netd\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.030659 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-run-systemd\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032109 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-sysctl-conf\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032116 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-lib-modules\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032151 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-var-lib-kubelet\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032160 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-var-lib-cni-bin\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032188 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-etc-kubernetes\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032216 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-sys\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032280 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-registration-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032563 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-etc-selinux\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032584 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-socket-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032643 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-var-lib-cni-multus\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.032673 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:19.033858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032681 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-run-netns\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.032740 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs podName:b4fdd84d-94fb-4906-b6f1-eb49521f2377 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:19.532716308 +0000 UTC m=+3.038702742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs") pod "network-metrics-daemon-nknbl" (UID: "b4fdd84d-94fb-4906-b6f1-eb49521f2377") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032893 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-var-lib-kubelet\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032924 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90829ff4-eea6-4fab-bbbc-c03855b2f347-tmp-dir\") pod \"node-resolver-8hjrj\" (UID: \"90829ff4-eea6-4fab-bbbc-c03855b2f347\") " pod="openshift-dns/node-resolver-8hjrj" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.032963 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-env-overrides\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033012 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/90829ff4-eea6-4fab-bbbc-c03855b2f347-hosts-file\") pod \"node-resolver-8hjrj\" (UID: \"90829ff4-eea6-4fab-bbbc-c03855b2f347\") " pod="openshift-dns/node-resolver-8hjrj" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033069 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-device-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033070 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80c1edab-fed5-4b64-b763-4afd12faa9f6-os-release\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033069 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-sys-fs\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033111 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033160 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-conf-dir\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.029855 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-systemd-units\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033245 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80c1edab-fed5-4b64-b763-4afd12faa9f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033567 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-ovnkube-script-lib\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033586 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-slash\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033637 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-cnibin\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033669 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-run\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.034716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033698 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-run-openvswitch\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033716 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-run-multus-certs\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033738 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-log-socket\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033754 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8213007-e56c-4d28-b527-7b4bdadc93bf-host-slash\") pod \"iptables-alerter-tjt2t\" (UID: \"a8213007-e56c-4d28-b527-7b4bdadc93bf\") " pod="openshift-network-operator/iptables-alerter-tjt2t" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033784 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-host-run-netns\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033789 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/952f0b8d-d367-4aad-a348-9c808ac7e554-cni-binary-copy\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033801 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-host\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033862 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-systemd\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033867 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb9601e3-b459-493e-b6ba-0c195220abb7-konnectivity-ca\") pod \"konnectivity-agent-xxxj8\" (UID: \"bb9601e3-b459-493e-b6ba-0c195220abb7\") " pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033886 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8213007-e56c-4d28-b527-7b4bdadc93bf-iptables-alerter-script\") pod \"iptables-alerter-tjt2t\" (UID: \"a8213007-e56c-4d28-b527-7b4bdadc93bf\") " pod="openshift-network-operator/iptables-alerter-tjt2t" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033871 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033949 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-host-run-k8s-cni-cncf-io\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.033998 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/952f0b8d-d367-4aad-a348-9c808ac7e554-multus-cni-dir\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.034110 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-run-ovn\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.034443 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80c1edab-fed5-4b64-b763-4afd12faa9f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.035540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.034498 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80c1edab-fed5-4b64-b763-4afd12faa9f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.037202 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.037176 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb9601e3-b459-493e-b6ba-0c195220abb7-agent-certs\") pod \"konnectivity-agent-xxxj8\" (UID: \"bb9601e3-b459-493e-b6ba-0c195220abb7\") " pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:19.037781 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.037756 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d06eb219-0708-42d0-a92d-1e63cd73b8dd-etc-tuned\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.038631 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.038591 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d06eb219-0708-42d0-a92d-1e63cd73b8dd-tmp\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.040801 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.040150 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-ovn-node-metrics-cert\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.041793 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.040942 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:19.041793 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.040965 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:19.041793 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.040997 2556 projected.go:196] Error preparing data for projected volume kube-api-access-2h427 for pod openshift-network-diagnostics/network-check-target-t66zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:19.041793 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.041055 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427 podName:5e549457-84be-4f37-93be-3134c87472dd nodeName:}" failed. No retries permitted until 2026-07-22 02:16:19.541036459 +0000 UTC m=+3.047022910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2h427" (UniqueName: "kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427") pod "network-check-target-t66zg" (UID: "5e549457-84be-4f37-93be-3134c87472dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:19.045733 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.045708 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptmnl\" (UniqueName: \"kubernetes.io/projected/952f0b8d-d367-4aad-a348-9c808ac7e554-kube-api-access-ptmnl\") pod \"multus-mk7bq\" (UID: \"952f0b8d-d367-4aad-a348-9c808ac7e554\") " pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.045847 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.045771 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnh6f\" (UniqueName: \"kubernetes.io/projected/a8213007-e56c-4d28-b527-7b4bdadc93bf-kube-api-access-hnh6f\") pod \"iptables-alerter-tjt2t\" (UID: \"a8213007-e56c-4d28-b527-7b4bdadc93bf\") " pod="openshift-network-operator/iptables-alerter-tjt2t" Jul 22 02:16:19.047509 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.046331 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfz5d\" (UniqueName: \"kubernetes.io/projected/d06eb219-0708-42d0-a92d-1e63cd73b8dd-kube-api-access-sfz5d\") pod \"tuned-9fk6s\" (UID: \"d06eb219-0708-42d0-a92d-1e63cd73b8dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.047509 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.046784 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5vcc\" (UniqueName: \"kubernetes.io/projected/80c1edab-fed5-4b64-b763-4afd12faa9f6-kube-api-access-v5vcc\") pod \"multus-additional-cni-plugins-7vfd6\" (UID: \"80c1edab-fed5-4b64-b763-4afd12faa9f6\") " pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.047657 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.047510 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 02:16:19.048375 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.048332 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl8nl\" (UniqueName: \"kubernetes.io/projected/fb79e0ed-ec41-4a48-9d73-5673b6eb43d4-kube-api-access-tl8nl\") pod \"aws-ebs-csi-driver-node-5pq56\" (UID: \"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.048959 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.048917 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdncq\" (UniqueName: \"kubernetes.io/projected/b4fdd84d-94fb-4906-b6f1-eb49521f2377-kube-api-access-zdncq\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:19.050099 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.050075 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85gvw\" (UniqueName: \"kubernetes.io/projected/932b05c4-02a6-428a-b8ad-d0a7fb2e73d4-kube-api-access-85gvw\") pod \"ovnkube-node-gx5c8\" (UID: \"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.050309 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.050265 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvn8l\" (UniqueName: \"kubernetes.io/projected/90829ff4-eea6-4fab-bbbc-c03855b2f347-kube-api-access-hvn8l\") pod \"node-resolver-8hjrj\" (UID: \"90829ff4-eea6-4fab-bbbc-c03855b2f347\") " pod="openshift-dns/node-resolver-8hjrj" Jul 22 02:16:19.132675 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.132630 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-dbus\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:19.132856 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.132685 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57d753f0-2e81-4640-ae5f-ec2649d0a1f5-serviceca\") pod \"node-ca-79gb4\" (UID: \"57d753f0-2e81-4640-ae5f-ec2649d0a1f5\") " pod="openshift-image-registry/node-ca-79gb4" Jul 22 02:16:19.132856 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.132784 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-dbus\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:19.132856 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.132823 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:19.133046 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.132874 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n54ps\" (UniqueName: \"kubernetes.io/projected/57d753f0-2e81-4640-ae5f-ec2649d0a1f5-kube-api-access-n54ps\") pod \"node-ca-79gb4\" (UID: \"57d753f0-2e81-4640-ae5f-ec2649d0a1f5\") " pod="openshift-image-registry/node-ca-79gb4" Jul 22 02:16:19.133046 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.132915 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-kubelet-config\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:19.133046 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.132993 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d753f0-2e81-4640-ae5f-ec2649d0a1f5-host\") pod \"node-ca-79gb4\" (UID: \"57d753f0-2e81-4640-ae5f-ec2649d0a1f5\") " pod="openshift-image-registry/node-ca-79gb4" Jul 22 02:16:19.133198 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.133110 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d753f0-2e81-4640-ae5f-ec2649d0a1f5-host\") pod \"node-ca-79gb4\" (UID: \"57d753f0-2e81-4640-ae5f-ec2649d0a1f5\") " pod="openshift-image-registry/node-ca-79gb4" Jul 22 02:16:19.133198 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.133164 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-kubelet-config\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:19.133301 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.133202 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57d753f0-2e81-4640-ae5f-ec2649d0a1f5-serviceca\") pod \"node-ca-79gb4\" (UID: \"57d753f0-2e81-4640-ae5f-ec2649d0a1f5\") " pod="openshift-image-registry/node-ca-79gb4" Jul 22 02:16:19.133301 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.133242 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:19.133301 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.133300 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret podName:8f0076ef-a5ed-46b5-b528-b73e33cebcf1 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:19.633283426 +0000 UTC m=+3.139269870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret") pod "global-pull-secret-syncer-whfqq" (UID: "8f0076ef-a5ed-46b5-b528-b73e33cebcf1") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:19.142792 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.142709 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n54ps\" (UniqueName: \"kubernetes.io/projected/57d753f0-2e81-4640-ae5f-ec2649d0a1f5-kube-api-access-n54ps\") pod \"node-ca-79gb4\" (UID: \"57d753f0-2e81-4640-ae5f-ec2649d0a1f5\") " pod="openshift-image-registry/node-ca-79gb4" Jul 22 02:16:19.213932 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.213893 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8hjrj" Jul 22 02:16:19.224320 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.224283 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" Jul 22 02:16:19.233480 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.233445 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7vfd6" Jul 22 02:16:19.240264 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.240238 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mk7bq" Jul 22 02:16:19.250299 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.250267 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:19.260309 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.260272 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tjt2t" Jul 22 02:16:19.268279 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.268254 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:19.283589 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.283562 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" Jul 22 02:16:19.288580 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.288555 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-79gb4" Jul 22 02:16:19.535227 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.535128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:19.535378 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.535311 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:19.535420 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.535381 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs podName:b4fdd84d-94fb-4906-b6f1-eb49521f2377 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:20.535364888 +0000 UTC m=+4.041351318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs") pod "network-metrics-daemon-nknbl" (UID: "b4fdd84d-94fb-4906-b6f1-eb49521f2377") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:19.635779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.635740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h427\" (UniqueName: \"kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427\") pod \"network-check-target-t66zg\" (UID: \"5e549457-84be-4f37-93be-3134c87472dd\") " pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:19.635969 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.635832 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:19.635969 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.635930 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:19.636092 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.636004 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret podName:8f0076ef-a5ed-46b5-b528-b73e33cebcf1 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:20.635974248 +0000 UTC m=+4.141960677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret") pod "global-pull-secret-syncer-whfqq" (UID: "8f0076ef-a5ed-46b5-b528-b73e33cebcf1") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:19.636092 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.635930 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:19.636092 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.636059 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:19.636092 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.636076 2556 projected.go:196] Error preparing data for projected volume kube-api-access-2h427 for pod openshift-network-diagnostics/network-check-target-t66zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:19.636245 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:19.636141 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427 podName:5e549457-84be-4f37-93be-3134c87472dd nodeName:}" failed. No retries permitted until 2026-07-22 02:16:20.636122862 +0000 UTC m=+4.142109295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h427" (UniqueName: "kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427") pod "network-check-target-t66zg" (UID: "5e549457-84be-4f37-93be-3134c87472dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:19.961782 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.961674 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:11:18 +0000 UTC" deadline="2028-04-18 09:38:57.562632964 +0000 UTC" Jul 22 02:16:19.961782 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:19.961732 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15271h22m37.600904955s" Jul 22 02:16:20.176625 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:20.176594 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d753f0_2e81_4640_ae5f_ec2649d0a1f5.slice/crio-9e0f429e30821b675e51bdc31ed5d633630d9b7e409bc3ef369a8b989b1ce131 WatchSource:0}: Error finding container 9e0f429e30821b675e51bdc31ed5d633630d9b7e409bc3ef369a8b989b1ce131: Status 404 returned error can't find the container with id 9e0f429e30821b675e51bdc31ed5d633630d9b7e409bc3ef369a8b989b1ce131 Jul 22 02:16:20.182926 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:20.182902 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8213007_e56c_4d28_b527_7b4bdadc93bf.slice/crio-827d352df9dbab9bff537a171030dfdadfbe56e56ba2b1874f7f08c367e2f163 WatchSource:0}: Error finding container 827d352df9dbab9bff537a171030dfdadfbe56e56ba2b1874f7f08c367e2f163: Status 404 returned error can't find the container with id 827d352df9dbab9bff537a171030dfdadfbe56e56ba2b1874f7f08c367e2f163 Jul 22 02:16:20.183547 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:20.183524 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb79e0ed_ec41_4a48_9d73_5673b6eb43d4.slice/crio-657f24958b05c0d8c4a14f2ecdc3dca40c6fd68e8ecaaa36b73570b410bd32f7 WatchSource:0}: Error finding container 657f24958b05c0d8c4a14f2ecdc3dca40c6fd68e8ecaaa36b73570b410bd32f7: Status 404 returned error can't find the container with id 657f24958b05c0d8c4a14f2ecdc3dca40c6fd68e8ecaaa36b73570b410bd32f7 Jul 22 02:16:20.184123 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:20.184099 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932b05c4_02a6_428a_b8ad_d0a7fb2e73d4.slice/crio-6b81585551bea0c3bedf585600c2d3abea2edef4a0d91045f299c78a01be638c WatchSource:0}: Error finding container 6b81585551bea0c3bedf585600c2d3abea2edef4a0d91045f299c78a01be638c: Status 404 returned error can't find the container with id 6b81585551bea0c3bedf585600c2d3abea2edef4a0d91045f299c78a01be638c Jul 22 02:16:20.186406 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:20.186310 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90829ff4_eea6_4fab_bbbc_c03855b2f347.slice/crio-a5b22ca22865ffd1bf5e4f9e8f2742e4ea8415b8581adbddc34a94cb5a477385 WatchSource:0}: Error finding container a5b22ca22865ffd1bf5e4f9e8f2742e4ea8415b8581adbddc34a94cb5a477385: Status 404 returned error can't find the container with id a5b22ca22865ffd1bf5e4f9e8f2742e4ea8415b8581adbddc34a94cb5a477385 Jul 22 02:16:20.208874 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:20.208841 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952f0b8d_d367_4aad_a348_9c808ac7e554.slice/crio-b394cff0c49a398658804ed525c43d64f3091d2071998bc25c9055a5d4f1b5c0 WatchSource:0}: Error finding container b394cff0c49a398658804ed525c43d64f3091d2071998bc25c9055a5d4f1b5c0: Status 404 returned error can't find the container with id b394cff0c49a398658804ed525c43d64f3091d2071998bc25c9055a5d4f1b5c0 Jul 22 02:16:20.210621 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:20.210596 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9601e3_b459_493e_b6ba_0c195220abb7.slice/crio-8102821d9f73674706435b41cf9faa59292a3912c74fa6cc3661ff679c78c069 WatchSource:0}: Error finding container 8102821d9f73674706435b41cf9faa59292a3912c74fa6cc3661ff679c78c069: Status 404 returned error can't find the container with id 8102821d9f73674706435b41cf9faa59292a3912c74fa6cc3661ff679c78c069 Jul 22 02:16:20.211133 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:20.211084 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c1edab_fed5_4b64_b763_4afd12faa9f6.slice/crio-28811ef726a3a02ef044fe8a825518bb6f5d346d1190b33d37f769791d8e9c60 WatchSource:0}: Error finding container 28811ef726a3a02ef044fe8a825518bb6f5d346d1190b33d37f769791d8e9c60: Status 404 returned error can't find the container with id 28811ef726a3a02ef044fe8a825518bb6f5d346d1190b33d37f769791d8e9c60 Jul 22 02:16:20.543226 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:20.542933 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:20.543226 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:20.543097 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:20.543435 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:20.543276 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs podName:b4fdd84d-94fb-4906-b6f1-eb49521f2377 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:22.543254561 +0000 UTC m=+6.049241014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs") pod "network-metrics-daemon-nknbl" (UID: "b4fdd84d-94fb-4906-b6f1-eb49521f2377") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:20.644182 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:20.643833 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:20.644182 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:20.643922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h427\" (UniqueName: \"kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427\") pod \"network-check-target-t66zg\" (UID: \"5e549457-84be-4f37-93be-3134c87472dd\") " pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:20.644182 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:20.644088 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:20.644182 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:20.644112 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:20.644182 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:20.644114 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:20.644182 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:20.644126 2556 projected.go:196] Error preparing data for projected volume kube-api-access-2h427 for pod openshift-network-diagnostics/network-check-target-t66zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:20.644182 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:20.644195 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret podName:8f0076ef-a5ed-46b5-b528-b73e33cebcf1 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:22.644172931 +0000 UTC m=+6.150159367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret") pod "global-pull-secret-syncer-whfqq" (UID: "8f0076ef-a5ed-46b5-b528-b73e33cebcf1") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:20.644659 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:20.644217 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427 podName:5e549457-84be-4f37-93be-3134c87472dd nodeName:}" failed. No retries permitted until 2026-07-22 02:16:22.644208083 +0000 UTC m=+6.150194529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h427" (UniqueName: "kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427") pod "network-check-target-t66zg" (UID: "5e549457-84be-4f37-93be-3134c87472dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:20.963022 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:20.962830 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:11:18 +0000 UTC" deadline="2027-12-25 17:37:07.806216306 +0000 UTC" Jul 22 02:16:20.963022 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:20.962872 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12519h20m46.843349316s" Jul 22 02:16:21.023005 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.022846 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:21.023893 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:21.023203 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:21.023893 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.023626 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:21.023893 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:21.023718 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:21.023893 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.023785 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:21.023893 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:21.023863 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:21.036916 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.036801 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" event={"ID":"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4","Type":"ContainerStarted","Data":"6b81585551bea0c3bedf585600c2d3abea2edef4a0d91045f299c78a01be638c"} Jul 22 02:16:21.041020 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.040930 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" event={"ID":"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4","Type":"ContainerStarted","Data":"657f24958b05c0d8c4a14f2ecdc3dca40c6fd68e8ecaaa36b73570b410bd32f7"} Jul 22 02:16:21.055530 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.054718 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-238.ec2.internal" event={"ID":"43547df299046b716198ac6f0727dbc5","Type":"ContainerStarted","Data":"53b6187bc346bd012c37737ed7fa230480b5c10a462961666523eea648011d94"} Jul 22 02:16:21.072797 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.072759 2556 generic.go:356] "Generic (PLEG): container finished" podID="233e7ab40d6c94cf412611ca0a9e2f56" containerID="786df732748392b854ec9751307de68fa4e18dd4aea95a828dccd3fad8d4d7b5" exitCode=0 Jul 22 02:16:21.073498 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.073416 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" event={"ID":"233e7ab40d6c94cf412611ca0a9e2f56","Type":"ContainerDied","Data":"786df732748392b854ec9751307de68fa4e18dd4aea95a828dccd3fad8d4d7b5"} Jul 22 02:16:21.091711 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.091653 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-238.ec2.internal" podStartSLOduration=3.091632675 podStartE2EDuration="3.091632675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:21.075505592 +0000 UTC m=+4.581492046" watchObservedRunningTime="2026-07-22 02:16:21.091632675 +0000 UTC m=+4.597619127" Jul 22 02:16:21.098355 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.098319 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mk7bq" event={"ID":"952f0b8d-d367-4aad-a348-9c808ac7e554","Type":"ContainerStarted","Data":"b394cff0c49a398658804ed525c43d64f3091d2071998bc25c9055a5d4f1b5c0"} Jul 22 02:16:21.117463 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.117351 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" event={"ID":"d06eb219-0708-42d0-a92d-1e63cd73b8dd","Type":"ContainerStarted","Data":"4aad0b3fbfb6297fe774a64937cb249be6b42626a4c4a966ab0134675f54a6c3"} Jul 22 02:16:21.127210 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.127117 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8hjrj" event={"ID":"90829ff4-eea6-4fab-bbbc-c03855b2f347","Type":"ContainerStarted","Data":"a5b22ca22865ffd1bf5e4f9e8f2742e4ea8415b8581adbddc34a94cb5a477385"} Jul 22 02:16:21.151476 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.151432 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-79gb4" event={"ID":"57d753f0-2e81-4640-ae5f-ec2649d0a1f5","Type":"ContainerStarted","Data":"9e0f429e30821b675e51bdc31ed5d633630d9b7e409bc3ef369a8b989b1ce131"} Jul 22 02:16:21.170057 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.170012 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vfd6" event={"ID":"80c1edab-fed5-4b64-b763-4afd12faa9f6","Type":"ContainerStarted","Data":"28811ef726a3a02ef044fe8a825518bb6f5d346d1190b33d37f769791d8e9c60"} Jul 22 02:16:21.187011 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.186875 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xxxj8" event={"ID":"bb9601e3-b459-493e-b6ba-0c195220abb7","Type":"ContainerStarted","Data":"8102821d9f73674706435b41cf9faa59292a3912c74fa6cc3661ff679c78c069"} Jul 22 02:16:21.224075 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:21.223959 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tjt2t" event={"ID":"a8213007-e56c-4d28-b527-7b4bdadc93bf","Type":"ContainerStarted","Data":"827d352df9dbab9bff537a171030dfdadfbe56e56ba2b1874f7f08c367e2f163"} Jul 22 02:16:22.234606 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:22.234521 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" event={"ID":"233e7ab40d6c94cf412611ca0a9e2f56","Type":"ContainerStarted","Data":"6b40adc1b16354de660db8408a5bc068cac3702dc1f30a884772215bfb1dffbe"} Jul 22 02:16:22.566462 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:22.565922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:22.566462 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:22.566145 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:22.566462 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:22.566207 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs podName:b4fdd84d-94fb-4906-b6f1-eb49521f2377 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:26.566189562 +0000 UTC m=+10.072175994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs") pod "network-metrics-daemon-nknbl" (UID: "b4fdd84d-94fb-4906-b6f1-eb49521f2377") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:22.666886 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:22.666813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h427\" (UniqueName: \"kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427\") pod \"network-check-target-t66zg\" (UID: \"5e549457-84be-4f37-93be-3134c87472dd\") " pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:22.667099 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:22.666900 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:22.667099 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:22.667059 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:22.667211 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:22.667120 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret podName:8f0076ef-a5ed-46b5-b528-b73e33cebcf1 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:26.667102583 +0000 UTC m=+10.173089016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret") pod "global-pull-secret-syncer-whfqq" (UID: "8f0076ef-a5ed-46b5-b528-b73e33cebcf1") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:22.667545 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:22.667525 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:22.667635 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:22.667551 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:22.667635 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:22.667578 2556 projected.go:196] Error preparing data for projected volume kube-api-access-2h427 for pod openshift-network-diagnostics/network-check-target-t66zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:22.667635 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:22.667623 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427 podName:5e549457-84be-4f37-93be-3134c87472dd nodeName:}" failed. No retries permitted until 2026-07-22 02:16:26.667608249 +0000 UTC m=+10.173594682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h427" (UniqueName: "kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427") pod "network-check-target-t66zg" (UID: "5e549457-84be-4f37-93be-3134c87472dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:23.021060 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:23.020963 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:23.021229 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:23.021130 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:23.021562 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:23.021519 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:23.021679 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:23.021611 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:23.021679 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:23.021673 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:23.021776 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:23.021747 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:25.019499 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:25.019464 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:25.020000 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:25.019613 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:25.020000 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:25.019632 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:25.020000 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:25.019722 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:25.020000 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:25.019760 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:25.020000 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:25.019815 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:26.599559 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:26.599517 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:26.600071 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:26.599639 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:26.600071 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:26.599714 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs podName:b4fdd84d-94fb-4906-b6f1-eb49521f2377 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:34.599693503 +0000 UTC m=+18.105679950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs") pod "network-metrics-daemon-nknbl" (UID: "b4fdd84d-94fb-4906-b6f1-eb49521f2377") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:26.700786 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:26.700744 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h427\" (UniqueName: \"kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427\") pod \"network-check-target-t66zg\" (UID: \"5e549457-84be-4f37-93be-3134c87472dd\") " pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:26.700964 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:26.700901 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:26.700964 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:26.700952 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:26.701094 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:26.700995 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:26.701094 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:26.701012 2556 projected.go:196] Error preparing data for projected volume kube-api-access-2h427 for pod openshift-network-diagnostics/network-check-target-t66zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:26.701094 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:26.701013 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:26.701094 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:26.701078 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret podName:8f0076ef-a5ed-46b5-b528-b73e33cebcf1 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:34.701059532 +0000 UTC m=+18.207045973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret") pod "global-pull-secret-syncer-whfqq" (UID: "8f0076ef-a5ed-46b5-b528-b73e33cebcf1") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:26.701296 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:26.701100 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427 podName:5e549457-84be-4f37-93be-3134c87472dd nodeName:}" failed. No retries permitted until 2026-07-22 02:16:34.701090506 +0000 UTC m=+18.207076950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h427" (UniqueName: "kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427") pod "network-check-target-t66zg" (UID: "5e549457-84be-4f37-93be-3134c87472dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:27.020148 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:27.020065 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:27.020315 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:27.020178 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:27.020315 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:27.020191 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:27.020315 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:27.020245 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:27.020507 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:27.020336 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:27.020507 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:27.020416 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:29.024875 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:29.024840 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:29.025342 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:29.024823 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:29.025342 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:29.024823 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:29.025342 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:29.025122 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:29.025342 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:29.024972 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:29.025342 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:29.025156 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:31.018734 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:31.018698 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:31.018734 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:31.018730 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:31.019253 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:31.018699 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:31.019253 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:31.018858 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:31.019253 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:31.018924 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:31.019253 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:31.019020 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:33.022052 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:33.022023 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:33.022052 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:33.022043 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:33.022052 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:33.022058 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:33.022629 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:33.022135 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:33.022629 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:33.022229 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:33.022629 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:33.022276 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:34.663883 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:34.663848 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:34.664389 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:34.664041 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:34.664389 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:34.664123 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs podName:b4fdd84d-94fb-4906-b6f1-eb49521f2377 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:50.664100202 +0000 UTC m=+34.170086633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs") pod "network-metrics-daemon-nknbl" (UID: "b4fdd84d-94fb-4906-b6f1-eb49521f2377") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:34.766814 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:34.766780 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h427\" (UniqueName: \"kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427\") pod \"network-check-target-t66zg\" (UID: \"5e549457-84be-4f37-93be-3134c87472dd\") " pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:34.766927 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:34.766869 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:34.767032 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:34.767015 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:34.767096 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:34.767084 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret podName:8f0076ef-a5ed-46b5-b528-b73e33cebcf1 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:50.767065814 +0000 UTC m=+34.273052247 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret") pod "global-pull-secret-syncer-whfqq" (UID: "8f0076ef-a5ed-46b5-b528-b73e33cebcf1") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:34.767558 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:34.767537 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:34.767625 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:34.767565 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:34.767625 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:34.767579 2556 projected.go:196] Error preparing data for projected volume kube-api-access-2h427 for pod openshift-network-diagnostics/network-check-target-t66zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:34.767735 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:34.767627 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427 podName:5e549457-84be-4f37-93be-3134c87472dd nodeName:}" failed. No retries permitted until 2026-07-22 02:16:50.767611363 +0000 UTC m=+34.273597793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h427" (UniqueName: "kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427") pod "network-check-target-t66zg" (UID: "5e549457-84be-4f37-93be-3134c87472dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:35.019384 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.018973 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:35.019384 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.019003 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:35.019384 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:35.019159 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:35.019384 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:35.019198 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:35.019384 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.019246 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:35.019384 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:35.019331 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:35.265505 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.265289 2556 generic.go:356] "Generic (PLEG): container finished" podID="80c1edab-fed5-4b64-b763-4afd12faa9f6" containerID="5cd4469e842fe4c70775edeaed879b2166e8f5a0c8e493434f07c148e04e3866" exitCode=0 Jul 22 02:16:35.265662 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.265400 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vfd6" event={"ID":"80c1edab-fed5-4b64-b763-4afd12faa9f6","Type":"ContainerDied","Data":"5cd4469e842fe4c70775edeaed879b2166e8f5a0c8e493434f07c148e04e3866"} Jul 22 02:16:35.268014 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.267936 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xxxj8" event={"ID":"bb9601e3-b459-493e-b6ba-0c195220abb7","Type":"ContainerStarted","Data":"b74bd5aabc5f2d3bdedf300898a3bd4d28514058afd75765990adbbe32ef6789"} Jul 22 02:16:35.269871 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.269842 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" event={"ID":"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4","Type":"ContainerStarted","Data":"04d829a9fd4a12283ce6ec3be5d5a396963680de95aa4d4b15f3cdb3527e8e91"} Jul 22 02:16:35.274913 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.274882 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mk7bq" event={"ID":"952f0b8d-d367-4aad-a348-9c808ac7e554","Type":"ContainerStarted","Data":"245761997aae05a93bac17f34e731fc67fbe9b2b7046443962b149d694f78054"} Jul 22 02:16:35.276597 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.276569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" event={"ID":"d06eb219-0708-42d0-a92d-1e63cd73b8dd","Type":"ContainerStarted","Data":"cc23be9ab64527d70a5227714a9848a40fc1f7b6f356b18d560f9044a629a87a"} Jul 22 02:16:35.278255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.278229 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8hjrj" event={"ID":"90829ff4-eea6-4fab-bbbc-c03855b2f347","Type":"ContainerStarted","Data":"c771c3f6eb0cba2a5cd406444bcdf1503f0224f953707791f5de0bc595bdd75b"} Jul 22 02:16:35.279879 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.279856 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-79gb4" event={"ID":"57d753f0-2e81-4640-ae5f-ec2649d0a1f5","Type":"ContainerStarted","Data":"f7add6cacf481bf426a15412eb7c53a448eebc8ba3029913d45e66ea956f7a29"} Jul 22 02:16:35.289365 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.289311 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-238.ec2.internal" podStartSLOduration=17.289293293 podStartE2EDuration="17.289293293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:22.250117709 +0000 UTC m=+5.756104164" watchObservedRunningTime="2026-07-22 02:16:35.289293293 +0000 UTC m=+18.795279744" Jul 22 02:16:35.303817 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.303744 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xxxj8" podStartSLOduration=3.9499533749999998 podStartE2EDuration="18.303721193s" totalImagesPullingTime="14.353767818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:35.30301898 +0000 UTC m=+18.809005436" watchObservedRunningTime="2026-07-22 02:16:35.303721193 +0000 UTC m=+18.809707646" Jul 22 02:16:35.320717 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.320657 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mk7bq" podStartSLOduration=3.525036577 podStartE2EDuration="18.320635968s" totalImagesPullingTime="14.795599391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:35.320506018 +0000 UTC m=+18.826492470" watchObservedRunningTime="2026-07-22 02:16:35.320635968 +0000 UTC m=+18.826622420" Jul 22 02:16:35.337438 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.337391 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9fk6s" podStartSLOduration=3.921787365 podStartE2EDuration="18.337376141s" totalImagesPullingTime="14.415588776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:35.336728799 +0000 UTC m=+18.842715245" watchObservedRunningTime="2026-07-22 02:16:35.337376141 +0000 UTC m=+18.843362604" Jul 22 02:16:35.353195 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.353104 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-79gb4" podStartSLOduration=3.920142173 podStartE2EDuration="18.35308732s" totalImagesPullingTime="14.432945147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:35.352718553 +0000 UTC m=+18.858705005" watchObservedRunningTime="2026-07-22 02:16:35.35308732 +0000 UTC m=+18.859073773" Jul 22 02:16:35.372368 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.372271 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8hjrj" podStartSLOduration=3.9690062299999997 podStartE2EDuration="18.372250092s" totalImagesPullingTime="14.403243862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:35.37158338 +0000 UTC m=+18.877569833" watchObservedRunningTime="2026-07-22 02:16:35.372250092 +0000 UTC m=+18.878236543" Jul 22 02:16:35.596586 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.596549 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:35.597144 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:35.597125 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:36.164611 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:36.164575 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 02:16:36.283954 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:36.283816 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" event={"ID":"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4","Type":"ContainerStarted","Data":"79856cd56390bbb627097fbb2d44b6f20e39a3170314ac6703824f9d8b64c5a6"} Jul 22 02:16:36.285642 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:36.285597 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tjt2t" event={"ID":"a8213007-e56c-4d28-b527-7b4bdadc93bf","Type":"ContainerStarted","Data":"e3c4edf6e590624b3d2a568ac8e9da30dbb873794d6b9a03fd3784997e28fb8a"} Jul 22 02:16:36.286655 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:36.286623 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:36.287207 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:36.287189 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xxxj8" Jul 22 02:16:36.302183 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:36.302115 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tjt2t" podStartSLOduration=4.898927822 podStartE2EDuration="19.302093267s" totalImagesPullingTime="14.403165445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:36.301539576 +0000 UTC m=+19.807526033" watchObservedRunningTime="2026-07-22 02:16:36.302093267 +0000 UTC m=+19.808079720" Jul 22 02:16:36.987651 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:36.987539 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T02:16:36.164598662Z","UUID":"a9da6ec9-08b4-4fd8-a2ab-310fc14c85ed","Handler":null,"Name":"","Endpoint":""} Jul 22 02:16:36.989403 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:36.989374 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 02:16:36.989532 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:36.989424 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 02:16:37.019869 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:37.019829 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:37.020064 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:37.019953 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:37.020242 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:37.020179 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:37.020353 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:37.020331 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:37.020441 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:37.020420 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:37.020506 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:37.020305 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:39.019019 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:39.018966 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:39.019019 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:39.019020 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:39.019768 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:39.018966 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:39.019768 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:39.019127 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:39.019768 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:39.019212 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:39.019768 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:39.019298 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:41.019667 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:41.019457 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:41.020283 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:41.019458 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:41.020283 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:41.019751 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:41.020283 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:41.019573 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:41.020283 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:41.019889 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:41.020283 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:41.020051 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:43.019060 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.019025 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:43.019468 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.019025 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:43.019468 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:43.019143 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:43.019468 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.019034 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:43.019468 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:43.019207 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:43.019468 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:43.019306 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:43.303861 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.303696 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:16:43.304171 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.304150 2556 generic.go:356] "Generic (PLEG): container finished" podID="932b05c4-02a6-428a-b8ad-d0a7fb2e73d4" containerID="ccf3329ab974886797bac3a8dfd967db8fb03ba52cb659ab2da786ff4d68b6a1" exitCode=1 Jul 22 02:16:43.304260 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.304219 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" event={"ID":"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4","Type":"ContainerStarted","Data":"84446e0aad21df3b1233e17224ccbb6e7dda349fa54780e345757a3aa1728b11"} Jul 22 02:16:43.304315 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.304287 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" event={"ID":"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4","Type":"ContainerStarted","Data":"06ff0f4e45e06aee3e50b811474f5f0fb518c520b2adc4f6d0f79102186f9cf4"} Jul 22 02:16:43.304354 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.304324 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" event={"ID":"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4","Type":"ContainerDied","Data":"ccf3329ab974886797bac3a8dfd967db8fb03ba52cb659ab2da786ff4d68b6a1"} Jul 22 02:16:43.304386 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.304358 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" event={"ID":"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4","Type":"ContainerStarted","Data":"3c47f608e25ef321c1e0045f6d7815a378f272ee91ce3f2b00d526f953a19b1d"} Jul 22 02:16:43.306302 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.306280 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" event={"ID":"fb79e0ed-ec41-4a48-9d73-5673b6eb43d4","Type":"ContainerStarted","Data":"cbc7bf787f003288baa0ed042e023d262ad36c408ffd6e4a39f42ac863516baa"} Jul 22 02:16:43.310975 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.310949 2556 generic.go:356] "Generic (PLEG): container finished" podID="80c1edab-fed5-4b64-b763-4afd12faa9f6" containerID="76b499386e4cdb466f73ce7232e4f20d4c5d8624040fce9b83aea6d78df1125d" exitCode=0 Jul 22 02:16:43.311185 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.311001 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vfd6" event={"ID":"80c1edab-fed5-4b64-b763-4afd12faa9f6","Type":"ContainerDied","Data":"76b499386e4cdb466f73ce7232e4f20d4c5d8624040fce9b83aea6d78df1125d"} Jul 22 02:16:43.324904 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:43.324854 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5pq56" podStartSLOduration=3.866914708 podStartE2EDuration="26.324836391s" totalImagesPullingTime="22.457921683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:43.323167626 +0000 UTC m=+26.829154079" watchObservedRunningTime="2026-07-22 02:16:43.324836391 +0000 UTC m=+26.830822899" Jul 22 02:16:44.315864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:44.315834 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:16:44.316409 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:44.316255 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" event={"ID":"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4","Type":"ContainerStarted","Data":"270b5a9359c0e380af9260e78656e59bdf7fcad1f82ccd194b576778df55c3d1"} Jul 22 02:16:44.316409 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:44.316323 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" event={"ID":"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4","Type":"ContainerStarted","Data":"d37149d93ef68007600eb5cae3bc6f6194f5d5d27cb92f067e1e5f72145e5140"} Jul 22 02:16:45.019248 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:45.019223 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:45.019441 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:45.019223 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:45.019441 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:45.019320 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:45.019441 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:45.019421 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:45.019547 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:45.019461 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:45.019547 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:45.019536 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:45.320593 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:45.320513 2556 generic.go:356] "Generic (PLEG): container finished" podID="80c1edab-fed5-4b64-b763-4afd12faa9f6" containerID="d3eb47b61f50ed1c9fcf191987e675012e345fa8ebbb2d40dfbd109cc6be4981" exitCode=0 Jul 22 02:16:45.320593 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:45.320563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vfd6" event={"ID":"80c1edab-fed5-4b64-b763-4afd12faa9f6","Type":"ContainerDied","Data":"d3eb47b61f50ed1c9fcf191987e675012e345fa8ebbb2d40dfbd109cc6be4981"} Jul 22 02:16:46.326757 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:46.326722 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:16:46.327316 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:46.327151 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" event={"ID":"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4","Type":"ContainerStarted","Data":"5051a2aab0badc0c246a8ff86907c66ac6a22d4d1fb454869c73df7e190bd65a"} Jul 22 02:16:47.019453 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:47.019376 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:47.019595 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:47.019475 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:47.019595 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:47.019472 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:47.019595 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:47.019564 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:47.019595 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:47.019580 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:47.019722 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:47.019694 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:47.333361 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:47.333280 2556 generic.go:356] "Generic (PLEG): container finished" podID="80c1edab-fed5-4b64-b763-4afd12faa9f6" containerID="003cb49ada6828c1363552a0aa74dd342e351e3a02079eb90b50ba82f52700e5" exitCode=0 Jul 22 02:16:47.333361 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:47.333334 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vfd6" event={"ID":"80c1edab-fed5-4b64-b763-4afd12faa9f6","Type":"ContainerDied","Data":"003cb49ada6828c1363552a0aa74dd342e351e3a02079eb90b50ba82f52700e5"} Jul 22 02:16:48.340506 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:48.340243 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:16:48.341045 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:48.340950 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" event={"ID":"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4","Type":"ContainerStarted","Data":"48ad0a4a574fc0dfd3dcf6b639fb73426144fee56312ccb7679cb8e63acdc020"} Jul 22 02:16:48.341280 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:48.341255 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:48.341519 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:48.341498 2556 scope.go:117] "RemoveContainer" containerID="ccf3329ab974886797bac3a8dfd967db8fb03ba52cb659ab2da786ff4d68b6a1" Jul 22 02:16:48.360552 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:48.360516 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:49.019241 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:49.019207 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:49.019241 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:49.019231 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:49.019514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:49.019207 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:49.019514 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:49.019343 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:49.019514 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:49.019499 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:49.019676 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:49.019591 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:49.347952 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:49.347870 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:16:49.348452 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:49.348276 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" event={"ID":"932b05c4-02a6-428a-b8ad-d0a7fb2e73d4","Type":"ContainerStarted","Data":"f6353ce9dc06cbb68667420c8c7c64a653bbe29903302d0f8157d3e4d6c4821d"} Jul 22 02:16:49.348685 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:49.348618 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:49.348791 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:49.348703 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:49.366730 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:49.366701 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:16:49.435743 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:49.435690 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" podStartSLOduration=9.892292823 podStartE2EDuration="32.435673058s" totalImagesPullingTime="22.543380235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:49.401276001 +0000 UTC m=+32.907262467" watchObservedRunningTime="2026-07-22 02:16:49.435673058 +0000 UTC m=+32.941659510" Jul 22 02:16:50.031033 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:50.030947 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-whfqq"] Jul 22 02:16:50.031176 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:50.031126 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:50.031245 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:50.031221 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:50.034477 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:50.034450 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t66zg"] Jul 22 02:16:50.034626 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:50.034573 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:50.034677 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:50.034655 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:50.035120 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:50.035101 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nknbl"] Jul 22 02:16:50.035207 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:50.035195 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:50.035318 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:50.035296 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:50.685451 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:50.685409 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:50.685920 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:50.685554 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:50.685920 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:50.685615 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs podName:b4fdd84d-94fb-4906-b6f1-eb49521f2377 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:22.685596706 +0000 UTC m=+66.191583140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs") pod "network-metrics-daemon-nknbl" (UID: "b4fdd84d-94fb-4906-b6f1-eb49521f2377") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 02:16:50.786260 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:50.786221 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:50.786415 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:50.786280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h427\" (UniqueName: \"kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427\") pod \"network-check-target-t66zg\" (UID: \"5e549457-84be-4f37-93be-3134c87472dd\") " pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:50.786415 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:50.786388 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:50.786537 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:50.786469 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret podName:8f0076ef-a5ed-46b5-b528-b73e33cebcf1 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:22.786449626 +0000 UTC m=+66.292436056 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret") pod "global-pull-secret-syncer-whfqq" (UID: "8f0076ef-a5ed-46b5-b528-b73e33cebcf1") : object "kube-system"/"original-pull-secret" not registered Jul 22 02:16:50.786537 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:50.786400 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 02:16:50.786537 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:50.786504 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 02:16:50.786537 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:50.786518 2556 projected.go:196] Error preparing data for projected volume kube-api-access-2h427 for pod openshift-network-diagnostics/network-check-target-t66zg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:50.786679 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:50.786564 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427 podName:5e549457-84be-4f37-93be-3134c87472dd nodeName:}" failed. No retries permitted until 2026-07-22 02:17:22.786551622 +0000 UTC m=+66.292538066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2h427" (UniqueName: "kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427") pod "network-check-target-t66zg" (UID: "5e549457-84be-4f37-93be-3134c87472dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 02:16:52.019176 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:52.019142 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:52.019176 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:52.019160 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:52.019587 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:52.019164 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:52.019587 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:52.019257 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:52.019587 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:52.019323 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:52.019587 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:52.019387 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:52.358411 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:52.358367 2556 generic.go:356] "Generic (PLEG): container finished" podID="80c1edab-fed5-4b64-b763-4afd12faa9f6" containerID="cc493f9fcf8a33d84730dbe0e7102e9c61f23884c576d20973d3b998d8b2eb26" exitCode=0 Jul 22 02:16:52.358608 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:52.358427 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vfd6" event={"ID":"80c1edab-fed5-4b64-b763-4afd12faa9f6","Type":"ContainerDied","Data":"cc493f9fcf8a33d84730dbe0e7102e9c61f23884c576d20973d3b998d8b2eb26"} Jul 22 02:16:53.363716 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:53.363679 2556 generic.go:356] "Generic (PLEG): container finished" podID="80c1edab-fed5-4b64-b763-4afd12faa9f6" containerID="5e5c6e87b2144065a7a706471020a9884557bfdd96b2033faf76d0a524cb569d" exitCode=0 Jul 22 02:16:53.364237 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:53.363752 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vfd6" event={"ID":"80c1edab-fed5-4b64-b763-4afd12faa9f6","Type":"ContainerDied","Data":"5e5c6e87b2144065a7a706471020a9884557bfdd96b2033faf76d0a524cb569d"} Jul 22 02:16:54.018994 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:54.018938 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:54.019142 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:54.018953 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:54.019142 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:54.019072 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nknbl" podUID="b4fdd84d-94fb-4906-b6f1-eb49521f2377" Jul 22 02:16:54.019205 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:54.018963 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:54.019205 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:54.019157 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t66zg" podUID="5e549457-84be-4f37-93be-3134c87472dd" Jul 22 02:16:54.019284 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:54.019233 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whfqq" podUID="8f0076ef-a5ed-46b5-b528-b73e33cebcf1" Jul 22 02:16:54.370315 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:54.370229 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7vfd6" event={"ID":"80c1edab-fed5-4b64-b763-4afd12faa9f6","Type":"ContainerStarted","Data":"bd64cb3362f0787f5c9f27bef8e1c5f10667b04f67fc1fd7b8f46ebbd7433ae6"} Jul 22 02:16:54.396630 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:54.396583 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7vfd6" podStartSLOduration=8.81170832 podStartE2EDuration="37.396565907s" totalImagesPullingTime="28.584857587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:54.396203365 +0000 UTC m=+37.902189821" watchObservedRunningTime="2026-07-22 02:16:54.396565907 +0000 UTC m=+37.902552359" Jul 22 02:16:55.791199 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.791128 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-238.ec2.internal" event="NodeReady" Jul 22 02:16:55.791573 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.791251 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 02:16:55.824031 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.824002 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c756c9896-sm9gn"] Jul 22 02:16:55.845813 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.845779 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6kh2"] Jul 22 02:16:55.845998 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.845916 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:55.848327 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.848300 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 02:16:55.848327 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.848310 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vnb92\"" Jul 22 02:16:55.848531 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.848337 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 02:16:55.848531 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.848303 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 02:16:55.861853 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.861825 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 02:16:55.862009 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.861923 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj"] Jul 22 02:16:55.862099 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.862082 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6kh2" Jul 22 02:16:55.864256 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.864234 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:16:55.864373 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.864331 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xcq4g\"" Jul 22 02:16:55.864479 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.864464 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 22 02:16:55.883875 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.883845 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-smzl5"] Jul 22 02:16:55.884049 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.883965 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:55.894916 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.893008 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 22 02:16:55.894916 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.893376 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-frtqp\"" Jul 22 02:16:55.894916 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.893412 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 02:16:55.894916 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.893884 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 02:16:55.894916 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.894804 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 22 02:16:55.902009 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.901970 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c4c584546-b2wlb"] Jul 22 02:16:55.902118 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.902094 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:55.905111 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.905092 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 22 02:16:55.911971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.911954 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng"] Jul 22 02:16:55.912064 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.912054 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:55.917344 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.917236 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 22 02:16:55.917462 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.917443 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:16:55.917574 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.917465 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 02:16:55.917574 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.917476 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 22 02:16:55.917749 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.917734 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 22 02:16:55.917799 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.917769 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 02:16:55.917911 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.917893 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xzc2l\"" Jul 22 02:16:55.918026 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.917975 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 22 02:16:55.918026 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.918007 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-psd7l\"" Jul 22 02:16:55.918146 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.918044 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 22 02:16:55.918146 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.918004 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 22 02:16:55.924147 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.924110 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4"] Jul 22 02:16:55.924308 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.924228 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" Jul 22 02:16:55.925701 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.925679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-bound-sa-token\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:55.925780 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.925718 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-image-registry-private-configuration\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:55.925780 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.925745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-certificates\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:55.925780 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.925773 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-installation-pull-secrets\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:55.925887 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.925824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:55.925887 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.925852 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-trusted-ca\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:55.925950 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.925911 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eabd1f35-b25a-415d-ac46-0802c5a281bb-ca-trust-extracted\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:55.926006 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.925955 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxkb4\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-kube-api-access-jxkb4\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:55.934854 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.934758 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 22 02:16:55.935204 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.935181 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 22 02:16:55.935319 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.935255 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 22 02:16:55.938218 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.938201 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6kh2"] Jul 22 02:16:55.938285 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.938228 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c756c9896-sm9gn"] Jul 22 02:16:55.938285 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.938244 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6"] Jul 22 02:16:55.938348 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.938305 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" Jul 22 02:16:55.941534 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.941513 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:16:55.941647 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.941536 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:16:55.941647 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.941544 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-67j66\"" Jul 22 02:16:55.941647 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.941600 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nfskm\"" Jul 22 02:16:55.941647 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.941601 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 22 02:16:55.942016 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.942000 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 22 02:16:55.942078 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.942024 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 22 02:16:55.942078 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.942045 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 22 02:16:55.948338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.948321 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-smzl5"] Jul 22 02:16:55.948425 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.948349 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk"] Jul 22 02:16:55.948470 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.948421 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:16:55.952178 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.952160 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-glvxg\"" Jul 22 02:16:55.952401 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.952386 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 22 02:16:55.952481 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.952422 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 22 02:16:55.952481 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.952433 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 22 02:16:55.962498 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.962475 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-qpsrr"] Jul 22 02:16:55.962632 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.962610 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:16:55.965443 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.965420 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 22 02:16:55.965561 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.965546 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p9lgk\"" Jul 22 02:16:55.965679 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.965666 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 22 02:16:55.972526 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.972502 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-t2cwg"] Jul 22 02:16:55.972653 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.972638 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qpsrr" Jul 22 02:16:55.975131 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.975113 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 02:16:55.975227 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.975121 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8sjw9\"" Jul 22 02:16:55.975227 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.975216 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 02:16:55.986645 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.986618 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng"] Jul 22 02:16:55.986772 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.986655 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj"] Jul 22 02:16:55.986772 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.986678 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4"] Jul 22 02:16:55.986772 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.986697 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7fjrj"] Jul 22 02:16:55.986772 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.986731 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:55.988898 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.988881 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 22 02:16:55.989048 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.989033 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hbtzk\"" Jul 22 02:16:55.989274 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.989257 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 22 02:16:55.989379 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.989257 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 02:16:55.989379 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.989287 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 02:16:55.994887 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.994858 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 22 02:16:55.996910 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.996886 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c4c584546-b2wlb"] Jul 22 02:16:55.997030 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.996963 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jxb8n"] Jul 22 02:16:55.997088 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.997065 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7fjrj" Jul 22 02:16:55.999568 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.999547 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 02:16:55.999673 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.999606 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 02:16:55.999673 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.999617 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9s7nv\"" Jul 22 02:16:55.999749 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:55.999683 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 02:16:56.022897 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.022865 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk"] Jul 22 02:16:56.022897 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.022901 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-qpsrr"] Jul 22 02:16:56.023144 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.022976 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.023144 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.023017 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6"] Jul 22 02:16:56.023144 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.023048 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-t2cwg"] Jul 22 02:16:56.023144 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.023109 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jxb8n"] Jul 22 02:16:56.023144 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.023141 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7fjrj"] Jul 22 02:16:56.023356 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.023269 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:16:56.023356 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.023285 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:16:56.023428 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.023278 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:16:56.025280 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.025262 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 02:16:56.026112 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026091 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ngk6m\"" Jul 22 02:16:56.026112 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026103 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 02:16:56.026268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026152 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-btqc6\"" Jul 22 02:16:56.026268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026152 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 02:16:56.026268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026211 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 02:16:56.026268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026252 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.026455 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026285 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsxmp\" (UniqueName: \"kubernetes.io/projected/9d79edf4-e8ea-48ff-913f-df6ffab993a3-kube-api-access-fsxmp\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:56.026455 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026336 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8wr9\"" Jul 22 02:16:56.026455 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026352 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm4b7\" (UniqueName: \"kubernetes.io/projected/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-kube-api-access-nm4b7\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.026455 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026398 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee248576-7569-4778-acc1-32e7f80758b4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7wlng\" (UID: \"ee248576-7569-4778-acc1-32e7f80758b4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" Jul 22 02:16:56.026455 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026421 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhprt\" (UniqueName: \"kubernetes.io/projected/ee248576-7569-4778-acc1-32e7f80758b4-kube-api-access-dhprt\") pod \"service-ca-operator-5bcbc94c78-7wlng\" (UID: \"ee248576-7569-4778-acc1-32e7f80758b4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" Jul 22 02:16:56.026654 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026458 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f346f302-e3d1-47db-bff3-d33210c01f39-serving-cert\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.026654 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-default-certificate\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.026654 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-installation-pull-secrets\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.026654 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026544 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f346f302-e3d1-47db-bff3-d33210c01f39-config\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.026654 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026575 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4ql5\" (UniqueName: \"kubernetes.io/projected/f346f302-e3d1-47db-bff3-d33210c01f39-kube-api-access-g4ql5\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.026654 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026643 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9d79edf4-e8ea-48ff-913f-df6ffab993a3-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:56.026864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.026864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026678 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-trusted-ca\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.026864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026715 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eabd1f35-b25a-415d-ac46-0802c5a281bb-ca-trust-extracted\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.026864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026732 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwvll\" (UniqueName: \"kubernetes.io/projected/a13a4c7d-b104-42df-8a67-ed5e9d8f55b6-kube-api-access-zwvll\") pod \"kube-storage-version-migrator-operator-7658d9b749-mlcq4\" (UID: \"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" Jul 22 02:16:56.026864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026751 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f346f302-e3d1-47db-bff3-d33210c01f39-trusted-ca\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.026864 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.026769 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 02:16:56.026864 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.026786 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c756c9896-sm9gn: secret "image-registry-tls" not found Jul 22 02:16:56.026864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026785 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxkb4\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-kube-api-access-jxkb4\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.026864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026811 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxvql\" (UniqueName: \"kubernetes.io/projected/41a87a1c-0fc3-4169-bc4b-3a31d814e4e2-kube-api-access-cxvql\") pod \"volume-data-source-validator-78cf4c6f6-s6kh2\" (UID: \"41a87a1c-0fc3-4169-bc4b-3a31d814e4e2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6kh2" Jul 22 02:16:56.026864 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.026836 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls podName:eabd1f35-b25a-415d-ac46-0802c5a281bb nodeName:}" failed. No retries permitted until 2026-07-22 02:16:56.526819297 +0000 UTC m=+40.032805743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls") pod "image-registry-7c756c9896-sm9gn" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb") : secret "image-registry-tls" not found Jul 22 02:16:56.027613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026900 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-bound-sa-token\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.027613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.026956 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:56.027613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.027007 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee248576-7569-4778-acc1-32e7f80758b4-config\") pod \"service-ca-operator-5bcbc94c78-7wlng\" (UID: \"ee248576-7569-4778-acc1-32e7f80758b4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" Jul 22 02:16:56.027613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.027041 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-image-registry-private-configuration\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.027613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.027072 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-certificates\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.027613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.027102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.027613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.027128 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a13a4c7d-b104-42df-8a67-ed5e9d8f55b6-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-mlcq4\" (UID: \"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" Jul 22 02:16:56.027613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.027152 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a13a4c7d-b104-42df-8a67-ed5e9d8f55b6-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-mlcq4\" (UID: \"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" Jul 22 02:16:56.027613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.027176 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-stats-auth\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.027613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.027463 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eabd1f35-b25a-415d-ac46-0802c5a281bb-ca-trust-extracted\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.028122 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.027787 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-certificates\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.028175 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.028142 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-trusted-ca\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.031195 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.031174 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-installation-pull-secrets\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.031270 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.031204 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-image-registry-private-configuration\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.037302 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.037276 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-bound-sa-token\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.038255 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.038235 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxkb4\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-kube-api-access-jxkb4\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.127828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.127792 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvn5z\" (UniqueName: \"kubernetes.io/projected/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-kube-api-access-hvn5z\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.127828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.127832 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwvll\" (UniqueName: \"kubernetes.io/projected/a13a4c7d-b104-42df-8a67-ed5e9d8f55b6-kube-api-access-zwvll\") pod \"kube-storage-version-migrator-operator-7658d9b749-mlcq4\" (UID: \"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" Jul 22 02:16:56.128127 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.127850 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f346f302-e3d1-47db-bff3-d33210c01f39-trusted-ca\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.128127 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.127912 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39b4a0c9-5629-46ee-9c38-839e2785e93b-service-ca-bundle\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.128127 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.127959 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhdn7\" (UniqueName: \"kubernetes.io/projected/3b23627b-2b94-4d5d-9acb-e452f69d0e6b-kube-api-access-nhdn7\") pod \"ingress-canary-7fjrj\" (UID: \"3b23627b-2b94-4d5d-9acb-e452f69d0e6b\") " pod="openshift-ingress-canary/ingress-canary-7fjrj" Jul 22 02:16:56.128127 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128020 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxvql\" (UniqueName: \"kubernetes.io/projected/41a87a1c-0fc3-4169-bc4b-3a31d814e4e2-kube-api-access-cxvql\") pod \"volume-data-source-validator-78cf4c6f6-s6kh2\" (UID: \"41a87a1c-0fc3-4169-bc4b-3a31d814e4e2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6kh2" Jul 22 02:16:56.128127 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128093 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:56.128127 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128121 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee248576-7569-4778-acc1-32e7f80758b4-config\") pod \"service-ca-operator-5bcbc94c78-7wlng\" (UID: \"ee248576-7569-4778-acc1-32e7f80758b4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" Jul 22 02:16:56.128417 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39b4a0c9-5629-46ee-9c38-839e2785e93b-serving-cert\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.128417 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.128417 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.128248 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 02:16:56.128417 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.128301 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:56.628281166 +0000 UTC m=+40.134267620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : configmap references non-existent config key: service-ca.crt Jul 22 02:16:56.128417 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128321 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a13a4c7d-b104-42df-8a67-ed5e9d8f55b6-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-mlcq4\" (UID: \"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" Jul 22 02:16:56.128417 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.128417 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-tmp-dir\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.128417 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.128407 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls podName:9d79edf4-e8ea-48ff-913f-df6ffab993a3 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:56.628366107 +0000 UTC m=+40.134352544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hdkxj" (UID: "9d79edf4-e8ea-48ff-913f-df6ffab993a3") : secret "cluster-monitoring-operator-tls" not found Jul 22 02:16:56.128720 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-jfxm6\" (UID: \"93822beb-5f56-4757-9583-3208b4ffca96\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:16:56.128720 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128482 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/515007d6-343c-4176-9e24-e2531a39b46a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:16:56.128720 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128508 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:16:56.128720 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128531 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39b4a0c9-5629-46ee-9c38-839e2785e93b-snapshots\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.128720 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128575 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a13a4c7d-b104-42df-8a67-ed5e9d8f55b6-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-mlcq4\" (UID: \"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" Jul 22 02:16:56.128720 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128608 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-stats-auth\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.128720 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128643 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.128720 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128670 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b23627b-2b94-4d5d-9acb-e452f69d0e6b-cert\") pod \"ingress-canary-7fjrj\" (UID: \"3b23627b-2b94-4d5d-9acb-e452f69d0e6b\") " pod="openshift-ingress-canary/ingress-canary-7fjrj" Jul 22 02:16:56.128720 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsxmp\" (UniqueName: \"kubernetes.io/projected/9d79edf4-e8ea-48ff-913f-df6ffab993a3-kube-api-access-fsxmp\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:56.128720 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128707 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee248576-7569-4778-acc1-32e7f80758b4-config\") pod \"service-ca-operator-5bcbc94c78-7wlng\" (UID: \"ee248576-7569-4778-acc1-32e7f80758b4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128741 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm4b7\" (UniqueName: \"kubernetes.io/projected/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-kube-api-access-nm4b7\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128769 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39b4a0c9-5629-46ee-9c38-839e2785e93b-tmp\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128790 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6hsx\" (UniqueName: \"kubernetes.io/projected/93822beb-5f56-4757-9583-3208b4ffca96-kube-api-access-c6hsx\") pod \"cluster-samples-operator-79b7c55f87-jfxm6\" (UID: \"93822beb-5f56-4757-9583-3208b4ffca96\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee248576-7569-4778-acc1-32e7f80758b4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7wlng\" (UID: \"ee248576-7569-4778-acc1-32e7f80758b4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128846 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhprt\" (UniqueName: \"kubernetes.io/projected/ee248576-7569-4778-acc1-32e7f80758b4-kube-api-access-dhprt\") pod \"service-ca-operator-5bcbc94c78-7wlng\" (UID: \"ee248576-7569-4778-acc1-32e7f80758b4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128880 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwj8m\" (UniqueName: \"kubernetes.io/projected/39b4a0c9-5629-46ee-9c38-839e2785e93b-kube-api-access-dwj8m\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128910 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f346f302-e3d1-47db-bff3-d33210c01f39-serving-cert\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128936 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-default-certificate\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.128971 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f346f302-e3d1-47db-bff3-d33210c01f39-config\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.129008 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f346f302-e3d1-47db-bff3-d33210c01f39-trusted-ca\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.129013 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4ql5\" (UniqueName: \"kubernetes.io/projected/f346f302-e3d1-47db-bff3-d33210c01f39-kube-api-access-g4ql5\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.129083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-config-volume\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.129127 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9d79edf4-e8ea-48ff-913f-df6ffab993a3-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.129145 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a13a4c7d-b104-42df-8a67-ed5e9d8f55b6-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-mlcq4\" (UID: \"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" Jul 22 02:16:56.129203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.129164 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39b4a0c9-5629-46ee-9c38-839e2785e93b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.129944 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.129453 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpm8z\" (UniqueName: \"kubernetes.io/projected/ab20213c-d54b-41b6-8980-59074788d60f-kube-api-access-wpm8z\") pod \"network-check-source-7bc5b6bf85-qpsrr\" (UID: \"ab20213c-d54b-41b6-8980-59074788d60f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qpsrr" Jul 22 02:16:56.129944 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.129825 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f346f302-e3d1-47db-bff3-d33210c01f39-config\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.130334 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.130308 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9d79edf4-e8ea-48ff-913f-df6ffab993a3-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:56.130440 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.130424 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 02:16:56.130495 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.130483 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:56.630466462 +0000 UTC m=+40.136452912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : secret "router-metrics-certs-default" not found Jul 22 02:16:56.131066 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.131043 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a13a4c7d-b104-42df-8a67-ed5e9d8f55b6-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-mlcq4\" (UID: \"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" Jul 22 02:16:56.131392 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.131368 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-stats-auth\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.131528 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.131508 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-default-certificate\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.131783 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.131769 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee248576-7569-4778-acc1-32e7f80758b4-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7wlng\" (UID: \"ee248576-7569-4778-acc1-32e7f80758b4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" Jul 22 02:16:56.131852 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.131832 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f346f302-e3d1-47db-bff3-d33210c01f39-serving-cert\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.138506 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.138479 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm4b7\" (UniqueName: \"kubernetes.io/projected/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-kube-api-access-nm4b7\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.138620 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.138560 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsxmp\" (UniqueName: \"kubernetes.io/projected/9d79edf4-e8ea-48ff-913f-df6ffab993a3-kube-api-access-fsxmp\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:56.139204 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.138894 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxvql\" (UniqueName: \"kubernetes.io/projected/41a87a1c-0fc3-4169-bc4b-3a31d814e4e2-kube-api-access-cxvql\") pod \"volume-data-source-validator-78cf4c6f6-s6kh2\" (UID: \"41a87a1c-0fc3-4169-bc4b-3a31d814e4e2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6kh2" Jul 22 02:16:56.139204 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.139149 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwvll\" (UniqueName: \"kubernetes.io/projected/a13a4c7d-b104-42df-8a67-ed5e9d8f55b6-kube-api-access-zwvll\") pod \"kube-storage-version-migrator-operator-7658d9b749-mlcq4\" (UID: \"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" Jul 22 02:16:56.139204 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.139178 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhprt\" (UniqueName: \"kubernetes.io/projected/ee248576-7569-4778-acc1-32e7f80758b4-kube-api-access-dhprt\") pod \"service-ca-operator-5bcbc94c78-7wlng\" (UID: \"ee248576-7569-4778-acc1-32e7f80758b4\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" Jul 22 02:16:56.139412 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.139280 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4ql5\" (UniqueName: \"kubernetes.io/projected/f346f302-e3d1-47db-bff3-d33210c01f39-kube-api-access-g4ql5\") pod \"console-operator-565b7b569d-smzl5\" (UID: \"f346f302-e3d1-47db-bff3-d33210c01f39\") " pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.171618 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.171582 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6kh2" Jul 22 02:16:56.210832 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.210806 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:16:56.230299 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230268 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpm8z\" (UniqueName: \"kubernetes.io/projected/ab20213c-d54b-41b6-8980-59074788d60f-kube-api-access-wpm8z\") pod \"network-check-source-7bc5b6bf85-qpsrr\" (UID: \"ab20213c-d54b-41b6-8980-59074788d60f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qpsrr" Jul 22 02:16:56.230460 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvn5z\" (UniqueName: \"kubernetes.io/projected/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-kube-api-access-hvn5z\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.230460 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39b4a0c9-5629-46ee-9c38-839e2785e93b-service-ca-bundle\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.230460 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230367 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhdn7\" (UniqueName: \"kubernetes.io/projected/3b23627b-2b94-4d5d-9acb-e452f69d0e6b-kube-api-access-nhdn7\") pod \"ingress-canary-7fjrj\" (UID: \"3b23627b-2b94-4d5d-9acb-e452f69d0e6b\") " pod="openshift-ingress-canary/ingress-canary-7fjrj" Jul 22 02:16:56.230627 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230566 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39b4a0c9-5629-46ee-9c38-839e2785e93b-serving-cert\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.230627 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230609 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.230725 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230649 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-tmp-dir\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.230725 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230671 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-jfxm6\" (UID: \"93822beb-5f56-4757-9583-3208b4ffca96\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:16:56.230725 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/515007d6-343c-4176-9e24-e2531a39b46a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:16:56.230869 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:16:56.230869 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230751 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39b4a0c9-5629-46ee-9c38-839e2785e93b-snapshots\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.230869 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230799 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b23627b-2b94-4d5d-9acb-e452f69d0e6b-cert\") pod \"ingress-canary-7fjrj\" (UID: \"3b23627b-2b94-4d5d-9acb-e452f69d0e6b\") " pod="openshift-ingress-canary/ingress-canary-7fjrj" Jul 22 02:16:56.230869 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.230813 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 02:16:56.230869 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230842 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39b4a0c9-5629-46ee-9c38-839e2785e93b-tmp\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.230869 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.230868 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6hsx\" (UniqueName: \"kubernetes.io/projected/93822beb-5f56-4757-9583-3208b4ffca96-kube-api-access-c6hsx\") pod \"cluster-samples-operator-79b7c55f87-jfxm6\" (UID: \"93822beb-5f56-4757-9583-3208b4ffca96\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:16:56.231177 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.230928 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls podName:93822beb-5f56-4757-9583-3208b4ffca96 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:56.730886518 +0000 UTC m=+40.236872967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-jfxm6" (UID: "93822beb-5f56-4757-9583-3208b4ffca96") : secret "samples-operator-tls" not found Jul 22 02:16:56.231177 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.231010 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-tmp-dir\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.231177 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.231019 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39b4a0c9-5629-46ee-9c38-839e2785e93b-service-ca-bundle\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.231177 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.231011 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwj8m\" (UniqueName: \"kubernetes.io/projected/39b4a0c9-5629-46ee-9c38-839e2785e93b-kube-api-access-dwj8m\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.231177 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.231096 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-config-volume\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.231177 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.231134 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39b4a0c9-5629-46ee-9c38-839e2785e93b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.231476 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.231361 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39b4a0c9-5629-46ee-9c38-839e2785e93b-tmp\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.231532 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.231515 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/515007d6-343c-4176-9e24-e2531a39b46a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:16:56.231618 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.231600 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 02:16:56.231674 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.231662 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert podName:515007d6-343c-4176-9e24-e2531a39b46a nodeName:}" failed. No retries permitted until 2026-07-22 02:16:56.73164648 +0000 UTC m=+40.237632910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-ff2jk" (UID: "515007d6-343c-4176-9e24-e2531a39b46a") : secret "networking-console-plugin-cert" not found Jul 22 02:16:56.231674 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.231663 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39b4a0c9-5629-46ee-9c38-839e2785e93b-snapshots\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.231798 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.231723 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 02:16:56.231798 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.231737 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" Jul 22 02:16:56.231798 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.231764 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls podName:cea823f6-3bb0-41cc-b9a0-49267e8d0fb2 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:56.731751186 +0000 UTC m=+40.237737615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls") pod "dns-default-jxb8n" (UID: "cea823f6-3bb0-41cc-b9a0-49267e8d0fb2") : secret "dns-default-metrics-tls" not found Jul 22 02:16:56.231991 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.231938 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-config-volume\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.232163 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.232130 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39b4a0c9-5629-46ee-9c38-839e2785e93b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.233909 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.233888 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39b4a0c9-5629-46ee-9c38-839e2785e93b-serving-cert\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.234178 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.234161 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b23627b-2b94-4d5d-9acb-e452f69d0e6b-cert\") pod \"ingress-canary-7fjrj\" (UID: \"3b23627b-2b94-4d5d-9acb-e452f69d0e6b\") " pod="openshift-ingress-canary/ingress-canary-7fjrj" Jul 22 02:16:56.240138 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.240104 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvn5z\" (UniqueName: \"kubernetes.io/projected/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-kube-api-access-hvn5z\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.240418 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.240396 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwj8m\" (UniqueName: \"kubernetes.io/projected/39b4a0c9-5629-46ee-9c38-839e2785e93b-kube-api-access-dwj8m\") pod \"insights-operator-555d9d7885-t2cwg\" (UID: \"39b4a0c9-5629-46ee-9c38-839e2785e93b\") " pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.240576 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.240556 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhdn7\" (UniqueName: \"kubernetes.io/projected/3b23627b-2b94-4d5d-9acb-e452f69d0e6b-kube-api-access-nhdn7\") pod \"ingress-canary-7fjrj\" (UID: \"3b23627b-2b94-4d5d-9acb-e452f69d0e6b\") " pod="openshift-ingress-canary/ingress-canary-7fjrj" Jul 22 02:16:56.241425 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.241403 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpm8z\" (UniqueName: \"kubernetes.io/projected/ab20213c-d54b-41b6-8980-59074788d60f-kube-api-access-wpm8z\") pod \"network-check-source-7bc5b6bf85-qpsrr\" (UID: \"ab20213c-d54b-41b6-8980-59074788d60f\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qpsrr" Jul 22 02:16:56.241861 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.241829 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6hsx\" (UniqueName: \"kubernetes.io/projected/93822beb-5f56-4757-9583-3208b4ffca96-kube-api-access-c6hsx\") pod \"cluster-samples-operator-79b7c55f87-jfxm6\" (UID: \"93822beb-5f56-4757-9583-3208b4ffca96\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:16:56.246485 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.246463 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" Jul 22 02:16:56.281066 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.280634 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qpsrr" Jul 22 02:16:56.299245 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.299166 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-t2cwg" Jul 22 02:16:56.305553 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.305381 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7fjrj" Jul 22 02:16:56.413949 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.412465 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-smzl5"] Jul 22 02:16:56.420593 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:56.419576 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf346f302_e3d1_47db_bff3_d33210c01f39.slice/crio-7d6d63eef2399ff4763f290daadfa203bdb7d25c4812b39d3d997d74ca43bec2 WatchSource:0}: Error finding container 7d6d63eef2399ff4763f290daadfa203bdb7d25c4812b39d3d997d74ca43bec2: Status 404 returned error can't find the container with id 7d6d63eef2399ff4763f290daadfa203bdb7d25c4812b39d3d997d74ca43bec2 Jul 22 02:16:56.422688 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.422411 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6kh2"] Jul 22 02:16:56.487877 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.487744 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng"] Jul 22 02:16:56.495874 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:56.495840 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee248576_7569_4778_acc1_32e7f80758b4.slice/crio-62868e22cc374d72e5ec77f46c985067048e9dbd55a205b26a7ef6c049d6fb3e WatchSource:0}: Error finding container 62868e22cc374d72e5ec77f46c985067048e9dbd55a205b26a7ef6c049d6fb3e: Status 404 returned error can't find the container with id 62868e22cc374d72e5ec77f46c985067048e9dbd55a205b26a7ef6c049d6fb3e Jul 22 02:16:56.524080 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.524048 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4"] Jul 22 02:16:56.531481 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:56.531447 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13a4c7d_b104_42df_8a67_ed5e9d8f55b6.slice/crio-c8f7b30b4cf9fe4c3cb831bea3685c4b36bd368bc9a2054dbafa0c6519197b50 WatchSource:0}: Error finding container c8f7b30b4cf9fe4c3cb831bea3685c4b36bd368bc9a2054dbafa0c6519197b50: Status 404 returned error can't find the container with id c8f7b30b4cf9fe4c3cb831bea3685c4b36bd368bc9a2054dbafa0c6519197b50 Jul 22 02:16:56.536193 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.536169 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:56.536349 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.536330 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 02:16:56.536422 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.536350 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c756c9896-sm9gn: secret "image-registry-tls" not found Jul 22 02:16:56.536422 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.536402 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls podName:eabd1f35-b25a-415d-ac46-0802c5a281bb nodeName:}" failed. No retries permitted until 2026-07-22 02:16:57.536387078 +0000 UTC m=+41.042373508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls") pod "image-registry-7c756c9896-sm9gn" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb") : secret "image-registry-tls" not found Jul 22 02:16:56.541931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.541900 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-qpsrr"] Jul 22 02:16:56.545273 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:56.545249 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab20213c_d54b_41b6_8980_59074788d60f.slice/crio-3a819a9ff4b3912bc9da68d024292fd3d2f57f20124819f6a3fe637f7ae27588 WatchSource:0}: Error finding container 3a819a9ff4b3912bc9da68d024292fd3d2f57f20124819f6a3fe637f7ae27588: Status 404 returned error can't find the container with id 3a819a9ff4b3912bc9da68d024292fd3d2f57f20124819f6a3fe637f7ae27588 Jul 22 02:16:56.561606 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.561547 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-t2cwg"] Jul 22 02:16:56.564845 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:56.564816 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b4a0c9_5629_46ee_9c38_839e2785e93b.slice/crio-65fe222e32a1b192052a8c93a5a431ea6d449f97d3f63fac1b09626a0558c4ff WatchSource:0}: Error finding container 65fe222e32a1b192052a8c93a5a431ea6d449f97d3f63fac1b09626a0558c4ff: Status 404 returned error can't find the container with id 65fe222e32a1b192052a8c93a5a431ea6d449f97d3f63fac1b09626a0558c4ff Jul 22 02:16:56.574268 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.574245 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7fjrj"] Jul 22 02:16:56.576993 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:16:56.576960 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b23627b_2b94_4d5d_9acb_e452f69d0e6b.slice/crio-13c2c2b7ee317c727cf0a5e7222775abb109c8cdb6794ba21dd9029cdb6fcb23 WatchSource:0}: Error finding container 13c2c2b7ee317c727cf0a5e7222775abb109c8cdb6794ba21dd9029cdb6fcb23: Status 404 returned error can't find the container with id 13c2c2b7ee317c727cf0a5e7222775abb109c8cdb6794ba21dd9029cdb6fcb23 Jul 22 02:16:56.636821 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.636790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:56.637008 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.636832 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.637008 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.636943 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 02:16:56.637008 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.636965 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:57.636946436 +0000 UTC m=+41.142932869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : configmap references non-existent config key: service-ca.crt Jul 22 02:16:56.637198 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.637010 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls podName:9d79edf4-e8ea-48ff-913f-df6ffab993a3 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:57.63699318 +0000 UTC m=+41.142979610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hdkxj" (UID: "9d79edf4-e8ea-48ff-913f-df6ffab993a3") : secret "cluster-monitoring-operator-tls" not found Jul 22 02:16:56.637198 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.637064 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:56.637287 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.637200 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 02:16:56.637287 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.637240 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:57.637229552 +0000 UTC m=+41.143215982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : secret "router-metrics-certs-default" not found Jul 22 02:16:56.738072 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.738032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:56.738072 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.738074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-jfxm6\" (UID: \"93822beb-5f56-4757-9583-3208b4ffca96\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:16:56.738295 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:56.738102 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:16:56.738295 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.738183 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 02:16:56.738295 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.738237 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 02:16:56.738295 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.738249 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls podName:cea823f6-3bb0-41cc-b9a0-49267e8d0fb2 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:57.738233401 +0000 UTC m=+41.244219831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls") pod "dns-default-jxb8n" (UID: "cea823f6-3bb0-41cc-b9a0-49267e8d0fb2") : secret "dns-default-metrics-tls" not found Jul 22 02:16:56.738295 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.738191 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 02:16:56.738295 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.738292 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert podName:515007d6-343c-4176-9e24-e2531a39b46a nodeName:}" failed. No retries permitted until 2026-07-22 02:16:57.738275187 +0000 UTC m=+41.244261628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-ff2jk" (UID: "515007d6-343c-4176-9e24-e2531a39b46a") : secret "networking-console-plugin-cert" not found Jul 22 02:16:56.738490 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:56.738324 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls podName:93822beb-5f56-4757-9583-3208b4ffca96 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:57.738313195 +0000 UTC m=+41.244299629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-jfxm6" (UID: "93822beb-5f56-4757-9583-3208b4ffca96") : secret "samples-operator-tls" not found Jul 22 02:16:57.382699 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.382661 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" event={"ID":"f346f302-e3d1-47db-bff3-d33210c01f39","Type":"ContainerStarted","Data":"7d6d63eef2399ff4763f290daadfa203bdb7d25c4812b39d3d997d74ca43bec2"} Jul 22 02:16:57.384728 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.384662 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6kh2" event={"ID":"41a87a1c-0fc3-4169-bc4b-3a31d814e4e2","Type":"ContainerStarted","Data":"d207a6b29b1eaf91a66bc3d58d87a5d538bed54a15bf328d6b41a6c0ea8d741a"} Jul 22 02:16:57.386588 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.386530 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7fjrj" event={"ID":"3b23627b-2b94-4d5d-9acb-e452f69d0e6b","Type":"ContainerStarted","Data":"13c2c2b7ee317c727cf0a5e7222775abb109c8cdb6794ba21dd9029cdb6fcb23"} Jul 22 02:16:57.388368 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.388305 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qpsrr" event={"ID":"ab20213c-d54b-41b6-8980-59074788d60f","Type":"ContainerStarted","Data":"3a819a9ff4b3912bc9da68d024292fd3d2f57f20124819f6a3fe637f7ae27588"} Jul 22 02:16:57.390636 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.390611 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-t2cwg" event={"ID":"39b4a0c9-5629-46ee-9c38-839e2785e93b","Type":"ContainerStarted","Data":"65fe222e32a1b192052a8c93a5a431ea6d449f97d3f63fac1b09626a0558c4ff"} Jul 22 02:16:57.393279 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.393207 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" event={"ID":"ee248576-7569-4778-acc1-32e7f80758b4","Type":"ContainerStarted","Data":"62868e22cc374d72e5ec77f46c985067048e9dbd55a205b26a7ef6c049d6fb3e"} Jul 22 02:16:57.394732 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.394677 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" event={"ID":"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6","Type":"ContainerStarted","Data":"c8f7b30b4cf9fe4c3cb831bea3685c4b36bd368bc9a2054dbafa0c6519197b50"} Jul 22 02:16:57.547041 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.546208 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:57.547041 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.546517 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 02:16:57.547041 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.546536 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c756c9896-sm9gn: secret "image-registry-tls" not found Jul 22 02:16:57.547041 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.546596 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls podName:eabd1f35-b25a-415d-ac46-0802c5a281bb nodeName:}" failed. No retries permitted until 2026-07-22 02:16:59.546576175 +0000 UTC m=+43.052562619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls") pod "image-registry-7c756c9896-sm9gn" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb") : secret "image-registry-tls" not found Jul 22 02:16:57.647760 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.647674 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:57.647925 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.647825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:57.647925 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.647867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:57.648147 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.648126 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:59.648059176 +0000 UTC m=+43.154045612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : configmap references non-existent config key: service-ca.crt Jul 22 02:16:57.648644 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.648622 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 02:16:57.648738 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.648682 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:59.648665662 +0000 UTC m=+43.154652094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : secret "router-metrics-certs-default" not found Jul 22 02:16:57.648795 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.648741 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 02:16:57.648795 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.648782 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls podName:9d79edf4-e8ea-48ff-913f-df6ffab993a3 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:59.648763261 +0000 UTC m=+43.154749695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hdkxj" (UID: "9d79edf4-e8ea-48ff-913f-df6ffab993a3") : secret "cluster-monitoring-operator-tls" not found Jul 22 02:16:57.750256 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.749275 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:57.750256 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.749325 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-jfxm6\" (UID: \"93822beb-5f56-4757-9583-3208b4ffca96\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:16:57.750256 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:57.749356 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:16:57.750256 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.749587 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 02:16:57.750256 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.749650 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert podName:515007d6-343c-4176-9e24-e2531a39b46a nodeName:}" failed. No retries permitted until 2026-07-22 02:16:59.749630038 +0000 UTC m=+43.255616473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-ff2jk" (UID: "515007d6-343c-4176-9e24-e2531a39b46a") : secret "networking-console-plugin-cert" not found Jul 22 02:16:57.750256 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.750080 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 02:16:57.750256 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.750128 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls podName:cea823f6-3bb0-41cc-b9a0-49267e8d0fb2 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:59.75011337 +0000 UTC m=+43.256099804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls") pod "dns-default-jxb8n" (UID: "cea823f6-3bb0-41cc-b9a0-49267e8d0fb2") : secret "dns-default-metrics-tls" not found Jul 22 02:16:57.750256 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.750185 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 02:16:57.750256 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:57.750216 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls podName:93822beb-5f56-4757-9583-3208b4ffca96 nodeName:}" failed. No retries permitted until 2026-07-22 02:16:59.750206182 +0000 UTC m=+43.256192613 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-jfxm6" (UID: "93822beb-5f56-4757-9583-3208b4ffca96") : secret "samples-operator-tls" not found Jul 22 02:16:59.488532 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:59.488496 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xxxj8_bb9601e3-b459-493e-b6ba-0c195220abb7/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:59.569186 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:59.568949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:16:59.569346 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.569096 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 02:16:59.569346 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.569272 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c756c9896-sm9gn: secret "image-registry-tls" not found Jul 22 02:16:59.569346 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.569336 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls podName:eabd1f35-b25a-415d-ac46-0802c5a281bb nodeName:}" failed. No retries permitted until 2026-07-22 02:17:03.569318106 +0000 UTC m=+47.075304548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls") pod "image-registry-7c756c9896-sm9gn" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb") : secret "image-registry-tls" not found Jul 22 02:16:59.581431 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:59.581389 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xxxj8_bb9601e3-b459-493e-b6ba-0c195220abb7/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:59.670110 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:59.670073 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:59.670292 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.670225 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 02:16:59.670343 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.670293 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:03.670276963 +0000 UTC m=+47.176263393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : secret "router-metrics-certs-default" not found Jul 22 02:16:59.670394 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:59.670368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:16:59.670443 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:59.670401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:16:59.670527 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.670507 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 02:16:59.670527 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.670525 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:03.670514078 +0000 UTC m=+47.176500530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : configmap references non-existent config key: service-ca.crt Jul 22 02:16:59.670623 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.670567 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls podName:9d79edf4-e8ea-48ff-913f-df6ffab993a3 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:03.670551072 +0000 UTC m=+47.176537516 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hdkxj" (UID: "9d79edf4-e8ea-48ff-913f-df6ffab993a3") : secret "cluster-monitoring-operator-tls" not found Jul 22 02:16:59.681941 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:59.681906 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xxxj8_bb9601e3-b459-493e-b6ba-0c195220abb7/konnectivity-agent/0.log" limit=1024 Jul 22 02:16:59.771428 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:59.771338 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:16:59.771428 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:59.771384 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-jfxm6\" (UID: \"93822beb-5f56-4757-9583-3208b4ffca96\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:16:59.771428 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:59.771407 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:16:59.771684 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.771507 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 02:16:59.771684 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.771508 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 02:16:59.771684 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.771576 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert podName:515007d6-343c-4176-9e24-e2531a39b46a nodeName:}" failed. No retries permitted until 2026-07-22 02:17:03.771555905 +0000 UTC m=+47.277542372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-ff2jk" (UID: "515007d6-343c-4176-9e24-e2531a39b46a") : secret "networking-console-plugin-cert" not found Jul 22 02:16:59.771684 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.771618 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls podName:93822beb-5f56-4757-9583-3208b4ffca96 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:03.771600235 +0000 UTC m=+47.277586687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-jfxm6" (UID: "93822beb-5f56-4757-9583-3208b4ffca96") : secret "samples-operator-tls" not found Jul 22 02:16:59.771684 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.771508 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 02:16:59.771684 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:16:59.771662 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls podName:cea823f6-3bb0-41cc-b9a0-49267e8d0fb2 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:03.77165117 +0000 UTC m=+47.277637601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls") pod "dns-default-jxb8n" (UID: "cea823f6-3bb0-41cc-b9a0-49267e8d0fb2") : secret "dns-default-metrics-tls" not found Jul 22 02:16:59.781908 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:16:59.781873 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xxxj8_bb9601e3-b459-493e-b6ba-0c195220abb7/konnectivity-agent/0.log" limit=1024 Jul 22 02:17:03.609229 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:03.609194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:17:03.609661 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.609392 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 02:17:03.609661 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.609412 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c756c9896-sm9gn: secret "image-registry-tls" not found Jul 22 02:17:03.609661 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.609469 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls podName:eabd1f35-b25a-415d-ac46-0802c5a281bb nodeName:}" failed. No retries permitted until 2026-07-22 02:17:11.609451479 +0000 UTC m=+55.115437909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls") pod "image-registry-7c756c9896-sm9gn" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb") : secret "image-registry-tls" not found Jul 22 02:17:03.710796 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:03.710751 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:17:03.710953 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:03.710810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:03.710953 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:03.710879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:03.710953 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.710911 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 02:17:03.711081 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.710994 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls podName:9d79edf4-e8ea-48ff-913f-df6ffab993a3 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:11.710958545 +0000 UTC m=+55.216944992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hdkxj" (UID: "9d79edf4-e8ea-48ff-913f-df6ffab993a3") : secret "cluster-monitoring-operator-tls" not found Jul 22 02:17:03.711081 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.711028 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:11.711005531 +0000 UTC m=+55.216991974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : configmap references non-existent config key: service-ca.crt Jul 22 02:17:03.711168 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.711032 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 02:17:03.711168 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.711165 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:11.711142308 +0000 UTC m=+55.217128742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : secret "router-metrics-certs-default" not found Jul 22 02:17:03.812302 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:03.812259 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:17:03.812496 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.812421 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 02:17:03.812496 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:03.812447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:17:03.812496 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:03.812478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-jfxm6\" (UID: \"93822beb-5f56-4757-9583-3208b4ffca96\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:17:03.812630 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.812584 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert podName:515007d6-343c-4176-9e24-e2531a39b46a nodeName:}" failed. No retries permitted until 2026-07-22 02:17:11.812561996 +0000 UTC m=+55.318548440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-ff2jk" (UID: "515007d6-343c-4176-9e24-e2531a39b46a") : secret "networking-console-plugin-cert" not found Jul 22 02:17:03.812630 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.812592 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 02:17:03.812630 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.812610 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 22 02:17:03.812731 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.812641 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls podName:cea823f6-3bb0-41cc-b9a0-49267e8d0fb2 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:11.812629195 +0000 UTC m=+55.318615625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls") pod "dns-default-jxb8n" (UID: "cea823f6-3bb0-41cc-b9a0-49267e8d0fb2") : secret "dns-default-metrics-tls" not found Jul 22 02:17:03.812731 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:03.812655 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls podName:93822beb-5f56-4757-9583-3208b4ffca96 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:11.812648659 +0000 UTC m=+55.318635089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-jfxm6" (UID: "93822beb-5f56-4757-9583-3208b4ffca96") : secret "samples-operator-tls" not found Jul 22 02:17:05.421775 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.421705 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" event={"ID":"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6","Type":"ContainerStarted","Data":"936fbeafa639e0f02532f6c4a1c50309c4e52bdb94e08d5519aa6b5fbbe9ad54"} Jul 22 02:17:05.423822 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.423800 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/0.log" Jul 22 02:17:05.423886 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.423845 2556 generic.go:356] "Generic (PLEG): container finished" podID="f346f302-e3d1-47db-bff3-d33210c01f39" containerID="9224ecce130108a4ecd6952552d317fc1c2a30bfc5ebabfa58b78b1845d5cbb5" exitCode=255 Jul 22 02:17:05.423957 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.423934 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" event={"ID":"f346f302-e3d1-47db-bff3-d33210c01f39","Type":"ContainerDied","Data":"9224ecce130108a4ecd6952552d317fc1c2a30bfc5ebabfa58b78b1845d5cbb5"} Jul 22 02:17:05.424209 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.424192 2556 scope.go:117] "RemoveContainer" containerID="9224ecce130108a4ecd6952552d317fc1c2a30bfc5ebabfa58b78b1845d5cbb5" Jul 22 02:17:05.426129 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.426102 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6kh2" event={"ID":"41a87a1c-0fc3-4169-bc4b-3a31d814e4e2","Type":"ContainerStarted","Data":"f7c547911eade1fa3352f75db55e7e6c352a9c4565e2267ac9dd6f0ef5a233e5"} Jul 22 02:17:05.427973 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.427949 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7fjrj" event={"ID":"3b23627b-2b94-4d5d-9acb-e452f69d0e6b","Type":"ContainerStarted","Data":"ad30c4612f36835a2e9cfd4a4a7742510fbb4961b29c408fcf31010a7c2e6517"} Jul 22 02:17:05.430074 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.430044 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qpsrr" event={"ID":"ab20213c-d54b-41b6-8980-59074788d60f","Type":"ContainerStarted","Data":"e859a2ba652795c419549182b7b0d7661cdb1307788a2173576d321df6ec83d9"} Jul 22 02:17:05.433060 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.433010 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-t2cwg" event={"ID":"39b4a0c9-5629-46ee-9c38-839e2785e93b","Type":"ContainerStarted","Data":"b172b87049ba1a51a2c96f893d2e8710f0325a0909d7f65b1c08dcd552df8352"} Jul 22 02:17:05.434712 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.434681 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" event={"ID":"ee248576-7569-4778-acc1-32e7f80758b4","Type":"ContainerStarted","Data":"649e6337a75fe2e6406365f957ed27476535d71e6689486a3e77d6a269ed3893"} Jul 22 02:17:05.447673 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.447604 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" podStartSLOduration=37.645091291 podStartE2EDuration="45.447584679s" totalImagesPullingTime="7.802493388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:05.445853918 +0000 UTC m=+48.951840371" watchObservedRunningTime="2026-07-22 02:17:05.447584679 +0000 UTC m=+48.953571124" Jul 22 02:17:05.496894 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.496311 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-t2cwg" podStartSLOduration=37.727286063 podStartE2EDuration="45.496269895s" totalImagesPullingTime="7.768983832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:05.495971947 +0000 UTC m=+49.001958412" watchObservedRunningTime="2026-07-22 02:17:05.496269895 +0000 UTC m=+49.002256348" Jul 22 02:17:05.498167 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.497279 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" podStartSLOduration=37.659846835 podStartE2EDuration="45.497260687s" totalImagesPullingTime="7.837413852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:05.470350224 +0000 UTC m=+48.976336677" watchObservedRunningTime="2026-07-22 02:17:05.497260687 +0000 UTC m=+49.003247121" Jul 22 02:17:05.541011 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.540933 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-qpsrr" podStartSLOduration=36.752354239 podStartE2EDuration="44.540915848s" totalImagesPullingTime="7.788561609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:05.540533784 +0000 UTC m=+49.046520240" watchObservedRunningTime="2026-07-22 02:17:05.540915848 +0000 UTC m=+49.046902303" Jul 22 02:17:05.565840 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.565773 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-s6kh2" podStartSLOduration=37.695992749 podStartE2EDuration="45.5657515s" totalImagesPullingTime="7.869758751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:05.564154474 +0000 UTC m=+49.070140927" watchObservedRunningTime="2026-07-22 02:17:05.5657515 +0000 UTC m=+49.071737954" Jul 22 02:17:05.589334 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.589275 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7fjrj" podStartSLOduration=2.823257968 podStartE2EDuration="10.589260059s" totalImagesPullingTime="7.766002091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:05.58804926 +0000 UTC m=+49.094035713" watchObservedRunningTime="2026-07-22 02:17:05.589260059 +0000 UTC m=+49.095246513" Jul 22 02:17:05.762813 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.762772 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c78t5"] Jul 22 02:17:05.782152 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.782124 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.785313 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.785275 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c78t5"] Jul 22 02:17:05.786226 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.785996 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 02:17:05.786226 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.786013 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 02:17:05.786226 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.786216 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vv7c5\"" Jul 22 02:17:05.835634 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.835600 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0a243c1-edde-4738-8d57-b517b4dad2a6-crio-socket\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.835634 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.835638 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0a243c1-edde-4738-8d57-b517b4dad2a6-data-volume\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.835851 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.835837 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q989b\" (UniqueName: \"kubernetes.io/projected/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-api-access-q989b\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.835911 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.835871 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.835969 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.835909 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.936798 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.936694 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q989b\" (UniqueName: \"kubernetes.io/projected/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-api-access-q989b\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.936798 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.936742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.937030 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.936814 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.937030 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.936876 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0a243c1-edde-4738-8d57-b517b4dad2a6-crio-socket\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.937030 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.936902 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0a243c1-edde-4738-8d57-b517b4dad2a6-data-volume\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.937194 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.937170 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0a243c1-edde-4738-8d57-b517b4dad2a6-crio-socket\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.937228 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:05.936829 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 02:17:05.937290 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:05.937279 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm podName:a0a243c1-edde-4738-8d57-b517b4dad2a6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:06.437257784 +0000 UTC m=+49.943244215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c78t5" (UID: "a0a243c1-edde-4738-8d57-b517b4dad2a6") : configmap "kube-rbac-proxy" not found Jul 22 02:17:05.937408 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.937389 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0a243c1-edde-4738-8d57-b517b4dad2a6-data-volume\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:05.937442 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:05.936939 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 02:17:05.937494 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:05.937482 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls podName:a0a243c1-edde-4738-8d57-b517b4dad2a6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:06.437463288 +0000 UTC m=+49.943449733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c78t5" (UID: "a0a243c1-edde-4738-8d57-b517b4dad2a6") : secret "insights-runtime-extractor-tls" not found Jul 22 02:17:05.948167 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:05.948144 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q989b\" (UniqueName: \"kubernetes.io/projected/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-api-access-q989b\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:06.211859 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:06.211812 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:17:06.212057 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:06.211879 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:17:06.439962 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:06.439933 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:17:06.440372 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:06.440356 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/0.log" Jul 22 02:17:06.440476 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:06.440389 2556 generic.go:356] "Generic (PLEG): container finished" podID="f346f302-e3d1-47db-bff3-d33210c01f39" containerID="c5edd884a375baa4b7f3ac09837e62255b7efc2cf71e26b1824b0923b2177ac7" exitCode=255 Jul 22 02:17:06.440530 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:06.440506 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" event={"ID":"f346f302-e3d1-47db-bff3-d33210c01f39","Type":"ContainerDied","Data":"c5edd884a375baa4b7f3ac09837e62255b7efc2cf71e26b1824b0923b2177ac7"} Jul 22 02:17:06.440582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:06.440566 2556 scope.go:117] "RemoveContainer" containerID="9224ecce130108a4ecd6952552d317fc1c2a30bfc5ebabfa58b78b1845d5cbb5" Jul 22 02:17:06.440743 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:06.440727 2556 scope.go:117] "RemoveContainer" containerID="c5edd884a375baa4b7f3ac09837e62255b7efc2cf71e26b1824b0923b2177ac7" Jul 22 02:17:06.440974 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:06.440949 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-smzl5_openshift-console-operator(f346f302-e3d1-47db-bff3-d33210c01f39)\"" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" podUID="f346f302-e3d1-47db-bff3-d33210c01f39" Jul 22 02:17:06.441543 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:06.441518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:06.441642 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:06.441566 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:06.441642 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:06.441585 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 02:17:06.441767 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:06.441649 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm podName:a0a243c1-edde-4738-8d57-b517b4dad2a6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:07.441632061 +0000 UTC m=+50.947618506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c78t5" (UID: "a0a243c1-edde-4738-8d57-b517b4dad2a6") : configmap "kube-rbac-proxy" not found Jul 22 02:17:06.441767 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:06.441683 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 02:17:06.441767 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:06.441718 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls podName:a0a243c1-edde-4738-8d57-b517b4dad2a6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:07.441707609 +0000 UTC m=+50.947694040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c78t5" (UID: "a0a243c1-edde-4738-8d57-b517b4dad2a6") : secret "insights-runtime-extractor-tls" not found Jul 22 02:17:07.031362 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.031335 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8hjrj_90829ff4-eea6-4fab-bbbc-c03855b2f347/dns-node-resolver/0.log" Jul 22 02:17:07.445193 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.445123 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:17:07.445540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.445438 2556 scope.go:117] "RemoveContainer" containerID="c5edd884a375baa4b7f3ac09837e62255b7efc2cf71e26b1824b0923b2177ac7" Jul 22 02:17:07.445600 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:07.445581 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-smzl5_openshift-console-operator(f346f302-e3d1-47db-bff3-d33210c01f39)\"" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" podUID="f346f302-e3d1-47db-bff3-d33210c01f39" Jul 22 02:17:07.451783 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.451751 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:07.451896 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:07.451881 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 02:17:07.451942 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.451914 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:07.451942 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:07.451935 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls podName:a0a243c1-edde-4738-8d57-b517b4dad2a6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:09.451919928 +0000 UTC m=+52.957906358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c78t5" (UID: "a0a243c1-edde-4738-8d57-b517b4dad2a6") : secret "insights-runtime-extractor-tls" not found Jul 22 02:17:07.452031 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:07.452006 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 02:17:07.452064 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:07.452047 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm podName:a0a243c1-edde-4738-8d57-b517b4dad2a6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:09.45203648 +0000 UTC m=+52.958022912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c78t5" (UID: "a0a243c1-edde-4738-8d57-b517b4dad2a6") : configmap "kube-rbac-proxy" not found Jul 22 02:17:07.497218 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.497189 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz"] Jul 22 02:17:07.499259 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.499243 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz" Jul 22 02:17:07.502104 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.502079 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 22 02:17:07.502104 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.502079 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 22 02:17:07.502269 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.502240 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rs2sn\"" Jul 22 02:17:07.517088 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.517060 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz"] Jul 22 02:17:07.553306 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.553269 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sndr\" (UniqueName: \"kubernetes.io/projected/af7c868a-dc6f-44fc-9e28-4a7ee46acb4f-kube-api-access-9sndr\") pod \"migrator-7cc9c7ffd7-m9hdz\" (UID: \"af7c868a-dc6f-44fc-9e28-4a7ee46acb4f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz" Jul 22 02:17:07.654160 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.654122 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sndr\" (UniqueName: \"kubernetes.io/projected/af7c868a-dc6f-44fc-9e28-4a7ee46acb4f-kube-api-access-9sndr\") pod \"migrator-7cc9c7ffd7-m9hdz\" (UID: \"af7c868a-dc6f-44fc-9e28-4a7ee46acb4f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz" Jul 22 02:17:07.664802 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.664772 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sndr\" (UniqueName: \"kubernetes.io/projected/af7c868a-dc6f-44fc-9e28-4a7ee46acb4f-kube-api-access-9sndr\") pod \"migrator-7cc9c7ffd7-m9hdz\" (UID: \"af7c868a-dc6f-44fc-9e28-4a7ee46acb4f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz" Jul 22 02:17:07.809086 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.809051 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz" Jul 22 02:17:07.828764 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.828609 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-79gb4_57d753f0-2e81-4640-ae5f-ec2649d0a1f5/node-ca/0.log" Jul 22 02:17:07.938485 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:07.938451 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz"] Jul 22 02:17:07.943074 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:07.943037 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf7c868a_dc6f_44fc_9e28_4a7ee46acb4f.slice/crio-e988532efac44ef314b04a199c37f17ba0ac6a2cb9f71b7323c7bf0caa829b4b WatchSource:0}: Error finding container e988532efac44ef314b04a199c37f17ba0ac6a2cb9f71b7323c7bf0caa829b4b: Status 404 returned error can't find the container with id e988532efac44ef314b04a199c37f17ba0ac6a2cb9f71b7323c7bf0caa829b4b Jul 22 02:17:08.449603 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.449418 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz" event={"ID":"af7c868a-dc6f-44fc-9e28-4a7ee46acb4f","Type":"ContainerStarted","Data":"e988532efac44ef314b04a199c37f17ba0ac6a2cb9f71b7323c7bf0caa829b4b"} Jul 22 02:17:08.629494 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.629462 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7fjrj_3b23627b-2b94-4d5d-9acb-e452f69d0e6b/serve-healthcheck-canary/0.log" Jul 22 02:17:08.866264 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.866237 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-h9pcl"] Jul 22 02:17:08.868555 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.868535 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-h9pcl" Jul 22 02:17:08.871523 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.871500 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 22 02:17:08.872345 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.872319 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 22 02:17:08.872345 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.872332 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 22 02:17:08.872499 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.872324 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-f5ct9\"" Jul 22 02:17:08.872499 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.872439 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 22 02:17:08.882041 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.882018 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-h9pcl"] Jul 22 02:17:08.966325 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.966242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/734fbc2e-1358-44e0-9923-73e1437ea160-signing-key\") pod \"service-ca-58598695f7-h9pcl\" (UID: \"734fbc2e-1358-44e0-9923-73e1437ea160\") " pod="openshift-service-ca/service-ca-58598695f7-h9pcl" Jul 22 02:17:08.966325 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.966307 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/734fbc2e-1358-44e0-9923-73e1437ea160-signing-cabundle\") pod \"service-ca-58598695f7-h9pcl\" (UID: \"734fbc2e-1358-44e0-9923-73e1437ea160\") " pod="openshift-service-ca/service-ca-58598695f7-h9pcl" Jul 22 02:17:08.966571 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:08.966426 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csrjr\" (UniqueName: \"kubernetes.io/projected/734fbc2e-1358-44e0-9923-73e1437ea160-kube-api-access-csrjr\") pod \"service-ca-58598695f7-h9pcl\" (UID: \"734fbc2e-1358-44e0-9923-73e1437ea160\") " pod="openshift-service-ca/service-ca-58598695f7-h9pcl" Jul 22 02:17:09.067426 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:09.067394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csrjr\" (UniqueName: \"kubernetes.io/projected/734fbc2e-1358-44e0-9923-73e1437ea160-kube-api-access-csrjr\") pod \"service-ca-58598695f7-h9pcl\" (UID: \"734fbc2e-1358-44e0-9923-73e1437ea160\") " pod="openshift-service-ca/service-ca-58598695f7-h9pcl" Jul 22 02:17:09.067605 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:09.067513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/734fbc2e-1358-44e0-9923-73e1437ea160-signing-key\") pod \"service-ca-58598695f7-h9pcl\" (UID: \"734fbc2e-1358-44e0-9923-73e1437ea160\") " pod="openshift-service-ca/service-ca-58598695f7-h9pcl" Jul 22 02:17:09.067605 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:09.067543 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/734fbc2e-1358-44e0-9923-73e1437ea160-signing-cabundle\") pod \"service-ca-58598695f7-h9pcl\" (UID: \"734fbc2e-1358-44e0-9923-73e1437ea160\") " pod="openshift-service-ca/service-ca-58598695f7-h9pcl" Jul 22 02:17:09.068385 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:09.068366 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/734fbc2e-1358-44e0-9923-73e1437ea160-signing-cabundle\") pod \"service-ca-58598695f7-h9pcl\" (UID: \"734fbc2e-1358-44e0-9923-73e1437ea160\") " pod="openshift-service-ca/service-ca-58598695f7-h9pcl" Jul 22 02:17:09.071409 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:09.071383 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/734fbc2e-1358-44e0-9923-73e1437ea160-signing-key\") pod \"service-ca-58598695f7-h9pcl\" (UID: \"734fbc2e-1358-44e0-9923-73e1437ea160\") " pod="openshift-service-ca/service-ca-58598695f7-h9pcl" Jul 22 02:17:09.077682 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:09.077659 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csrjr\" (UniqueName: \"kubernetes.io/projected/734fbc2e-1358-44e0-9923-73e1437ea160-kube-api-access-csrjr\") pod \"service-ca-58598695f7-h9pcl\" (UID: \"734fbc2e-1358-44e0-9923-73e1437ea160\") " pod="openshift-service-ca/service-ca-58598695f7-h9pcl" Jul 22 02:17:09.181377 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:09.181337 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-h9pcl" Jul 22 02:17:09.471506 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:09.471478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:09.471877 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:09.471521 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:09.471877 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:09.471594 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 02:17:09.471877 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:09.471646 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm podName:a0a243c1-edde-4738-8d57-b517b4dad2a6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:13.471632851 +0000 UTC m=+56.977619286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c78t5" (UID: "a0a243c1-edde-4738-8d57-b517b4dad2a6") : configmap "kube-rbac-proxy" not found Jul 22 02:17:09.471877 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:09.471690 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 02:17:09.471877 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:09.471752 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls podName:a0a243c1-edde-4738-8d57-b517b4dad2a6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:13.471734952 +0000 UTC m=+56.977721384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c78t5" (UID: "a0a243c1-edde-4738-8d57-b517b4dad2a6") : secret "insights-runtime-extractor-tls" not found Jul 22 02:17:09.507753 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:09.507725 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-h9pcl"] Jul 22 02:17:09.511415 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:09.511387 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734fbc2e_1358_44e0_9923_73e1437ea160.slice/crio-092426d262808b13eb6cde9ebea89ca665ca72f2c6b0fefec9495512ad63ed18 WatchSource:0}: Error finding container 092426d262808b13eb6cde9ebea89ca665ca72f2c6b0fefec9495512ad63ed18: Status 404 returned error can't find the container with id 092426d262808b13eb6cde9ebea89ca665ca72f2c6b0fefec9495512ad63ed18 Jul 22 02:17:10.459577 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:10.459340 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz" event={"ID":"af7c868a-dc6f-44fc-9e28-4a7ee46acb4f","Type":"ContainerStarted","Data":"1f4f75f70f101a6965313c9318716d5b007a6ee43d91188853dd04403570eb94"} Jul 22 02:17:10.459769 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:10.459613 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz" event={"ID":"af7c868a-dc6f-44fc-9e28-4a7ee46acb4f","Type":"ContainerStarted","Data":"84d2ce329bbbdb0a032bfa247f124af6e67857abc80e247f6a7f1aef748a4cbd"} Jul 22 02:17:10.460995 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:10.460952 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-h9pcl" event={"ID":"734fbc2e-1358-44e0-9923-73e1437ea160","Type":"ContainerStarted","Data":"f8fb6bb2c32497f878b001029ca5fd8ff8d1c6bb0e3163921152323d948ce16d"} Jul 22 02:17:10.461114 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:10.461008 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-h9pcl" event={"ID":"734fbc2e-1358-44e0-9923-73e1437ea160","Type":"ContainerStarted","Data":"092426d262808b13eb6cde9ebea89ca665ca72f2c6b0fefec9495512ad63ed18"} Jul 22 02:17:10.477193 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:10.477150 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m9hdz" podStartSLOduration=2.024028497 podStartE2EDuration="3.477135541s" totalImagesPullingTime="1.453107044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:10.476538047 +0000 UTC m=+53.982524499" watchObservedRunningTime="2026-07-22 02:17:10.477135541 +0000 UTC m=+53.983121992" Jul 22 02:17:10.492928 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:10.492864 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-h9pcl" podStartSLOduration=2.492842112 podStartE2EDuration="2.492842112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:10.491555203 +0000 UTC m=+53.997541658" watchObservedRunningTime="2026-07-22 02:17:10.492842112 +0000 UTC m=+53.998828567" Jul 22 02:17:11.693338 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:11.693304 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:17:11.693919 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.693450 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 02:17:11.693919 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.693471 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c756c9896-sm9gn: secret "image-registry-tls" not found Jul 22 02:17:11.693919 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.693528 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls podName:eabd1f35-b25a-415d-ac46-0802c5a281bb nodeName:}" failed. No retries permitted until 2026-07-22 02:17:27.693509377 +0000 UTC m=+71.199495827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls") pod "image-registry-7c756c9896-sm9gn" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb") : secret "image-registry-tls" not found Jul 22 02:17:11.794703 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:11.794661 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:17:11.794886 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:11.794723 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:11.794886 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:11.794794 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:11.794886 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.794795 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 02:17:11.795041 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.794878 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 22 02:17:11.795041 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.794893 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls podName:9d79edf4-e8ea-48ff-913f-df6ffab993a3 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:27.794873178 +0000 UTC m=+71.300859612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hdkxj" (UID: "9d79edf4-e8ea-48ff-913f-df6ffab993a3") : secret "cluster-monitoring-operator-tls" not found Jul 22 02:17:11.795041 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.794910 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:27.794901117 +0000 UTC m=+71.300887553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : configmap references non-existent config key: service-ca.crt Jul 22 02:17:11.795041 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.794955 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs podName:d028023b-927c-4ed9-bb9a-8d2ba98cfb45 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:27.794947297 +0000 UTC m=+71.300933733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs") pod "router-default-c4c584546-b2wlb" (UID: "d028023b-927c-4ed9-bb9a-8d2ba98cfb45") : secret "router-metrics-certs-default" not found Jul 22 02:17:11.895552 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:11.895519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:17:11.895552 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:11.895553 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-jfxm6\" (UID: \"93822beb-5f56-4757-9583-3208b4ffca96\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:17:11.895739 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:11.895578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:17:11.895739 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.895692 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 02:17:11.895802 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.895762 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls podName:cea823f6-3bb0-41cc-b9a0-49267e8d0fb2 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:27.895742567 +0000 UTC m=+71.401729011 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls") pod "dns-default-jxb8n" (UID: "cea823f6-3bb0-41cc-b9a0-49267e8d0fb2") : secret "dns-default-metrics-tls" not found Jul 22 02:17:11.895857 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.895802 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 22 02:17:11.895932 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:11.895921 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert podName:515007d6-343c-4176-9e24-e2531a39b46a nodeName:}" failed. No retries permitted until 2026-07-22 02:17:27.895910095 +0000 UTC m=+71.401896530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-ff2jk" (UID: "515007d6-343c-4176-9e24-e2531a39b46a") : secret "networking-console-plugin-cert" not found Jul 22 02:17:11.899293 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:11.899263 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93822beb-5f56-4757-9583-3208b4ffca96-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-jfxm6\" (UID: \"93822beb-5f56-4757-9583-3208b4ffca96\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:17:12.155913 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:12.155870 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" Jul 22 02:17:12.291745 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:12.291695 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6"] Jul 22 02:17:12.467508 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:12.467475 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" event={"ID":"93822beb-5f56-4757-9583-3208b4ffca96","Type":"ContainerStarted","Data":"0e77a236df8bedd8908d9a4bd345c8e30db5ba8c17db05c58108778a81bc6996"} Jul 22 02:17:13.512164 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:13.512128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:13.512742 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:13.512174 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:13.512742 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:13.512268 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 02:17:13.512742 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:13.512306 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 02:17:13.512742 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:13.512388 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls podName:a0a243c1-edde-4738-8d57-b517b4dad2a6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:21.512344683 +0000 UTC m=+65.018331126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c78t5" (UID: "a0a243c1-edde-4738-8d57-b517b4dad2a6") : secret "insights-runtime-extractor-tls" not found Jul 22 02:17:13.512742 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:17:13.512408 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm podName:a0a243c1-edde-4738-8d57-b517b4dad2a6 nodeName:}" failed. No retries permitted until 2026-07-22 02:17:21.51239823 +0000 UTC m=+65.018384660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c78t5" (UID: "a0a243c1-edde-4738-8d57-b517b4dad2a6") : configmap "kube-rbac-proxy" not found Jul 22 02:17:15.480520 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:15.480479 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" event={"ID":"93822beb-5f56-4757-9583-3208b4ffca96","Type":"ContainerStarted","Data":"21da7c53f3e832452b80c2ef8e6c7b907eaf182b90ed5ba255d8260379fa961c"} Jul 22 02:17:15.481021 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:15.480547 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" event={"ID":"93822beb-5f56-4757-9583-3208b4ffca96","Type":"ContainerStarted","Data":"518d3b56f405b365325ce2367b9f8d80f91394d5b986b3f4cf419bc6b7424deb"} Jul 22 02:17:15.499690 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:15.499629 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-jfxm6" podStartSLOduration=53.040519536 podStartE2EDuration="55.499607044s" totalImagesPullingTime="2.459087508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:15.498471973 +0000 UTC m=+59.004458426" watchObservedRunningTime="2026-07-22 02:17:15.499607044 +0000 UTC m=+59.005593496" Jul 22 02:17:16.211451 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:16.211416 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:17:16.211621 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:16.211477 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:17:16.211833 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:16.211822 2556 scope.go:117] "RemoveContainer" containerID="c5edd884a375baa4b7f3ac09837e62255b7efc2cf71e26b1824b0923b2177ac7" Jul 22 02:17:16.485566 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:16.485482 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:17:16.485915 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:16.485615 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" event={"ID":"f346f302-e3d1-47db-bff3-d33210c01f39","Type":"ContainerStarted","Data":"441dd61e4dd43985ef6ad4dced2cc05fd9cca072fb49a5bbfebbb50424cb6999"} Jul 22 02:17:16.486068 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:16.486041 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:17:16.503442 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:16.503390 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" podStartSLOduration=48.592746626 podStartE2EDuration="56.503372767s" totalImagesPullingTime="7.910626141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:16.502858162 +0000 UTC m=+60.008844624" watchObservedRunningTime="2026-07-22 02:17:16.503372767 +0000 UTC m=+60.009359218" Jul 22 02:17:17.211691 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:17.211658 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-smzl5" Jul 22 02:17:21.364811 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:21.364778 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gx5c8" Jul 22 02:17:21.588088 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:21.588044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:21.588292 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:21.588096 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:21.588577 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:21.588553 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0a243c1-edde-4738-8d57-b517b4dad2a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:21.590415 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:21.590392 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0a243c1-edde-4738-8d57-b517b4dad2a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c78t5\" (UID: \"a0a243c1-edde-4738-8d57-b517b4dad2a6\") " pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:21.698352 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:21.698317 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vv7c5\"" Jul 22 02:17:21.705574 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:21.705544 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c78t5" Jul 22 02:17:21.834450 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:21.834416 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c78t5"] Jul 22 02:17:21.839142 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:21.839113 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a243c1_edde_4738_8d57_b517b4dad2a6.slice/crio-5c26ada37ef9f2e68a057d48dbdbf5278c33292b33635612d6f5902af646a397 WatchSource:0}: Error finding container 5c26ada37ef9f2e68a057d48dbdbf5278c33292b33635612d6f5902af646a397: Status 404 returned error can't find the container with id 5c26ada37ef9f2e68a057d48dbdbf5278c33292b33635612d6f5902af646a397 Jul 22 02:17:22.508078 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.507974 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c78t5" event={"ID":"a0a243c1-edde-4738-8d57-b517b4dad2a6","Type":"ContainerStarted","Data":"5c26ada37ef9f2e68a057d48dbdbf5278c33292b33635612d6f5902af646a397"} Jul 22 02:17:22.697947 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.697906 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:17:22.700666 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.700637 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 02:17:22.711411 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.711378 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4fdd84d-94fb-4906-b6f1-eb49521f2377-metrics-certs\") pod \"network-metrics-daemon-nknbl\" (UID: \"b4fdd84d-94fb-4906-b6f1-eb49521f2377\") " pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:17:22.756145 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.756110 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r8wr9\"" Jul 22 02:17:22.764544 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.764467 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nknbl" Jul 22 02:17:22.799246 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.799181 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h427\" (UniqueName: \"kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427\") pod \"network-check-target-t66zg\" (UID: \"5e549457-84be-4f37-93be-3134c87472dd\") " pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:17:22.799526 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.799263 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:17:22.802164 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.801917 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 02:17:22.802525 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.802487 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h427\" (UniqueName: \"kubernetes.io/projected/5e549457-84be-4f37-93be-3134c87472dd-kube-api-access-2h427\") pod \"network-check-target-t66zg\" (UID: \"5e549457-84be-4f37-93be-3134c87472dd\") " pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:17:22.812674 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.812616 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0076ef-a5ed-46b5-b528-b73e33cebcf1-original-pull-secret\") pod \"global-pull-secret-syncer-whfqq\" (UID: \"8f0076ef-a5ed-46b5-b528-b73e33cebcf1\") " pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:17:22.927959 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:22.927913 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nknbl"] Jul 22 02:17:22.931602 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:22.931569 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fdd84d_94fb_4906_b6f1_eb49521f2377.slice/crio-cc59d6c4f3f2446410541e04479770836b4675892a1dc9c9ff7335d1fe6c2285 WatchSource:0}: Error finding container cc59d6c4f3f2446410541e04479770836b4675892a1dc9c9ff7335d1fe6c2285: Status 404 returned error can't find the container with id cc59d6c4f3f2446410541e04479770836b4675892a1dc9c9ff7335d1fe6c2285 Jul 22 02:17:23.061505 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:23.061425 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ngk6m\"" Jul 22 02:17:23.064423 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:23.064400 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whfqq" Jul 22 02:17:23.069530 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:23.069501 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:17:23.240597 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:23.240564 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-whfqq"] Jul 22 02:17:23.245404 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:23.245367 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0076ef_a5ed_46b5_b528_b73e33cebcf1.slice/crio-8c8ad5f490b904d66b4856e6b2994cd96b2dae0c694baffaf84e4168107cd493 WatchSource:0}: Error finding container 8c8ad5f490b904d66b4856e6b2994cd96b2dae0c694baffaf84e4168107cd493: Status 404 returned error can't find the container with id 8c8ad5f490b904d66b4856e6b2994cd96b2dae0c694baffaf84e4168107cd493 Jul 22 02:17:23.267225 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:23.267190 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t66zg"] Jul 22 02:17:23.271635 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:23.271607 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e549457_84be_4f37_93be_3134c87472dd.slice/crio-5e0aac54f961512d2b6263ab71e63428bc18ca11fc6daae5457af457d889c8f2 WatchSource:0}: Error finding container 5e0aac54f961512d2b6263ab71e63428bc18ca11fc6daae5457af457d889c8f2: Status 404 returned error can't find the container with id 5e0aac54f961512d2b6263ab71e63428bc18ca11fc6daae5457af457d889c8f2 Jul 22 02:17:23.514276 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:23.514231 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-whfqq" event={"ID":"8f0076ef-a5ed-46b5-b528-b73e33cebcf1","Type":"ContainerStarted","Data":"8c8ad5f490b904d66b4856e6b2994cd96b2dae0c694baffaf84e4168107cd493"} Jul 22 02:17:23.516522 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:23.516370 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t66zg" event={"ID":"5e549457-84be-4f37-93be-3134c87472dd","Type":"ContainerStarted","Data":"bb1bb14b224ecd04c808f2aebe86e016ac1fa4ba93b4a6792b4f0207e23f4586"} Jul 22 02:17:23.516522 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:23.516431 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t66zg" event={"ID":"5e549457-84be-4f37-93be-3134c87472dd","Type":"ContainerStarted","Data":"5e0aac54f961512d2b6263ab71e63428bc18ca11fc6daae5457af457d889c8f2"} Jul 22 02:17:23.516522 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:23.516490 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:17:23.518256 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:23.518225 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nknbl" event={"ID":"b4fdd84d-94fb-4906-b6f1-eb49521f2377","Type":"ContainerStarted","Data":"cc59d6c4f3f2446410541e04479770836b4675892a1dc9c9ff7335d1fe6c2285"} Jul 22 02:17:23.532664 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:23.532606 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t66zg" podStartSLOduration=66.532591089 podStartE2EDuration="1m6.532591089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:23.531627888 +0000 UTC m=+67.037614341" watchObservedRunningTime="2026-07-22 02:17:23.532591089 +0000 UTC m=+67.038577519" Jul 22 02:17:27.754937 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.754894 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:17:27.757632 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.757603 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls\") pod \"image-registry-7c756c9896-sm9gn\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:17:27.856424 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.856342 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:17:27.856424 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.856407 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:27.856946 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.856914 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:27.857180 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.857161 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-service-ca-bundle\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:27.859299 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.859276 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d79edf4-e8ea-48ff-913f-df6ffab993a3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hdkxj\" (UID: \"9d79edf4-e8ea-48ff-913f-df6ffab993a3\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:17:27.859651 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.859630 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d028023b-927c-4ed9-bb9a-8d2ba98cfb45-metrics-certs\") pod \"router-default-c4c584546-b2wlb\" (UID: \"d028023b-927c-4ed9-bb9a-8d2ba98cfb45\") " pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:27.958176 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.958139 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:17:27.958176 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.958183 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:17:27.960428 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.960390 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cea823f6-3bb0-41cc-b9a0-49267e8d0fb2-metrics-tls\") pod \"dns-default-jxb8n\" (UID: \"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2\") " pod="openshift-dns/dns-default-jxb8n" Jul 22 02:17:27.960617 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.960547 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/515007d6-343c-4176-9e24-e2531a39b46a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ff2jk\" (UID: \"515007d6-343c-4176-9e24-e2531a39b46a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:17:27.960910 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.960894 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vnb92\"" Jul 22 02:17:27.969103 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.969077 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:17:27.995134 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:27.995104 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-frtqp\"" Jul 22 02:17:28.003150 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:28.003118 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" Jul 22 02:17:28.022883 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:28.022849 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xzc2l\"" Jul 22 02:17:28.031147 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:28.031089 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:28.073664 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:28.073631 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p9lgk\"" Jul 22 02:17:28.081810 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:28.081774 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" Jul 22 02:17:28.149543 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:28.149509 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-btqc6\"" Jul 22 02:17:28.157545 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:28.157515 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jxb8n" Jul 22 02:17:28.856628 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:28.856506 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk"] Jul 22 02:17:28.869788 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:28.868436 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515007d6_343c_4176_9e24_e2531a39b46a.slice/crio-be0b249f895906cdbb7e10a0eec98c1bf090c2dd336187baa84c7e6066685efc WatchSource:0}: Error finding container be0b249f895906cdbb7e10a0eec98c1bf090c2dd336187baa84c7e6066685efc: Status 404 returned error can't find the container with id be0b249f895906cdbb7e10a0eec98c1bf090c2dd336187baa84c7e6066685efc Jul 22 02:17:28.888283 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:28.888243 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c756c9896-sm9gn"] Jul 22 02:17:28.892769 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:28.892712 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeabd1f35_b25a_415d_ac46_0802c5a281bb.slice/crio-de61145ca6ef4cc059b76dedab4fcaa9de5cd536ce4fa0d032741fddc661c492 WatchSource:0}: Error finding container de61145ca6ef4cc059b76dedab4fcaa9de5cd536ce4fa0d032741fddc661c492: Status 404 returned error can't find the container with id de61145ca6ef4cc059b76dedab4fcaa9de5cd536ce4fa0d032741fddc661c492 Jul 22 02:17:29.094329 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.094226 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jxb8n"] Jul 22 02:17:29.098017 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.097951 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj"] Jul 22 02:17:29.099197 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:29.099172 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea823f6_3bb0_41cc_b9a0_49267e8d0fb2.slice/crio-e367713f2e37e45d95dc54755f4b7cae6050c4800eb9b237a7efee225751b00d WatchSource:0}: Error finding container e367713f2e37e45d95dc54755f4b7cae6050c4800eb9b237a7efee225751b00d: Status 404 returned error can't find the container with id e367713f2e37e45d95dc54755f4b7cae6050c4800eb9b237a7efee225751b00d Jul 22 02:17:29.099270 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.099242 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c4c584546-b2wlb"] Jul 22 02:17:29.101336 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:29.101295 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd028023b_927c_4ed9_bb9a_8d2ba98cfb45.slice/crio-363460e1f26456d64f7f56f085200f4f238b3a4cecac5515d26e52604453d22c WatchSource:0}: Error finding container 363460e1f26456d64f7f56f085200f4f238b3a4cecac5515d26e52604453d22c: Status 404 returned error can't find the container with id 363460e1f26456d64f7f56f085200f4f238b3a4cecac5515d26e52604453d22c Jul 22 02:17:29.102140 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:29.102115 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d79edf4_e8ea_48ff_913f_df6ffab993a3.slice/crio-ca7abb557a157ab06acb703023a978217de52dfd8fb19665161d5ac8f092c5cf WatchSource:0}: Error finding container ca7abb557a157ab06acb703023a978217de52dfd8fb19665161d5ac8f092c5cf: Status 404 returned error can't find the container with id ca7abb557a157ab06acb703023a978217de52dfd8fb19665161d5ac8f092c5cf Jul 22 02:17:29.548491 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.548446 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c4c584546-b2wlb" event={"ID":"d028023b-927c-4ed9-bb9a-8d2ba98cfb45","Type":"ContainerStarted","Data":"63d7a5b2c73e7ca7ad2c8959307574e8261c5a8ec5cff513e21d5381fcbd20da"} Jul 22 02:17:29.548674 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.548518 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c4c584546-b2wlb" event={"ID":"d028023b-927c-4ed9-bb9a-8d2ba98cfb45","Type":"ContainerStarted","Data":"363460e1f26456d64f7f56f085200f4f238b3a4cecac5515d26e52604453d22c"} Jul 22 02:17:29.552022 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.551965 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jxb8n" event={"ID":"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2","Type":"ContainerStarted","Data":"e367713f2e37e45d95dc54755f4b7cae6050c4800eb9b237a7efee225751b00d"} Jul 22 02:17:29.555619 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.554935 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" event={"ID":"eabd1f35-b25a-415d-ac46-0802c5a281bb","Type":"ContainerStarted","Data":"a3c223cb60e3b0b8c195a2b4995f7eed921edd99bdcc1aee9fc41b9ccd8e939b"} Jul 22 02:17:29.555619 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.555006 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" event={"ID":"eabd1f35-b25a-415d-ac46-0802c5a281bb","Type":"ContainerStarted","Data":"de61145ca6ef4cc059b76dedab4fcaa9de5cd536ce4fa0d032741fddc661c492"} Jul 22 02:17:29.555619 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.555568 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:17:29.559395 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.559322 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" event={"ID":"515007d6-343c-4176-9e24-e2531a39b46a","Type":"ContainerStarted","Data":"be0b249f895906cdbb7e10a0eec98c1bf090c2dd336187baa84c7e6066685efc"} Jul 22 02:17:29.561563 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.561536 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-whfqq" event={"ID":"8f0076ef-a5ed-46b5-b528-b73e33cebcf1","Type":"ContainerStarted","Data":"f6742257902e6b7f57bdc5a0a947cc23cb50e5f55c3344f8a0e2613eeb43ac23"} Jul 22 02:17:29.564733 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.564703 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nknbl" event={"ID":"b4fdd84d-94fb-4906-b6f1-eb49521f2377","Type":"ContainerStarted","Data":"28d231759eb2ee76d4bac1a07a8f03ec4d95a0b80f68ada2fbf61ac84c020ac8"} Jul 22 02:17:29.564844 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.564759 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nknbl" event={"ID":"b4fdd84d-94fb-4906-b6f1-eb49521f2377","Type":"ContainerStarted","Data":"5f672534a80318412c2fbd5712aa2b02791dd86db4e224134251abf98d579516"} Jul 22 02:17:29.567460 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.567406 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c78t5" event={"ID":"a0a243c1-edde-4738-8d57-b517b4dad2a6","Type":"ContainerStarted","Data":"f68b10cea188fe485b9f66f2894f3b5c1a5593f3bb958418e132690138174583"} Jul 22 02:17:29.569598 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.569573 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" event={"ID":"9d79edf4-e8ea-48ff-913f-df6ffab993a3","Type":"ContainerStarted","Data":"ca7abb557a157ab06acb703023a978217de52dfd8fb19665161d5ac8f092c5cf"} Jul 22 02:17:29.570302 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.569893 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c4c584546-b2wlb" podStartSLOduration=69.569876105 podStartE2EDuration="1m9.569876105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:29.568594798 +0000 UTC m=+73.074581250" watchObservedRunningTime="2026-07-22 02:17:29.569876105 +0000 UTC m=+73.075862556" Jul 22 02:17:29.589800 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.589726 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" podStartSLOduration=72.589693196 podStartE2EDuration="1m12.589693196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:29.588106958 +0000 UTC m=+73.094093411" watchObservedRunningTime="2026-07-22 02:17:29.589693196 +0000 UTC m=+73.095679655" Jul 22 02:17:29.604535 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.604019 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-whfqq" podStartSLOduration=67.273067733 podStartE2EDuration="1m12.60399556s" totalImagesPullingTime="5.330927827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:29.601923786 +0000 UTC m=+73.107910239" watchObservedRunningTime="2026-07-22 02:17:29.60399556 +0000 UTC m=+73.109982016" Jul 22 02:17:29.620459 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:29.620350 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nknbl" podStartSLOduration=66.978621912 podStartE2EDuration="1m12.620326583s" totalImagesPullingTime="5.641704671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:29.618219743 +0000 UTC m=+73.124206196" watchObservedRunningTime="2026-07-22 02:17:29.620326583 +0000 UTC m=+73.126313036" Jul 22 02:17:30.032758 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.032013 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:30.036077 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.035847 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:30.067783 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.067719 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9"] Jul 22 02:17:30.099743 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.099706 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t"] Jul 22 02:17:30.102884 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.102851 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9" Jul 22 02:17:30.106365 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.106333 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 22 02:17:30.109593 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.107077 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 22 02:17:30.109902 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.107324 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 22 02:17:30.110739 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.107450 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-482x5\"" Jul 22 02:17:30.110739 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.107696 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 22 02:17:30.128376 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.125139 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj"] Jul 22 02:17:30.128631 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.128599 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.132028 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.131649 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 22 02:17:30.132028 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.131701 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 22 02:17:30.132028 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.131868 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 22 02:17:30.133293 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.132421 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 22 02:17:30.153727 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.153693 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9"] Jul 22 02:17:30.153908 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.153737 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj"] Jul 22 02:17:30.153908 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.153757 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t"] Jul 22 02:17:30.153908 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.153815 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:30.157230 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.157018 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 22 02:17:30.170924 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.170891 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-78spx"] Jul 22 02:17:30.182421 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.182356 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d493c362-5493-43f9-81e0-102a2b270cb4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9\" (UID: \"d493c362-5493-43f9-81e0-102a2b270cb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9" Jul 22 02:17:30.182968 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.182883 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cmb7\" (UniqueName: \"kubernetes.io/projected/d493c362-5493-43f9-81e0-102a2b270cb4-kube-api-access-9cmb7\") pod \"managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9\" (UID: \"d493c362-5493-43f9-81e0-102a2b270cb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9" Jul 22 02:17:30.190425 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.190390 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-78spx"] Jul 22 02:17:30.190550 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.190499 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-78spx" Jul 22 02:17:30.198272 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.198245 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 02:17:30.198924 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.198901 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 02:17:30.199744 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.199675 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-68ccb\"" Jul 22 02:17:30.284253 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.283952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.284253 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.284029 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-ca\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.284253 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.284071 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d493c362-5493-43f9-81e0-102a2b270cb4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9\" (UID: \"d493c362-5493-43f9-81e0-102a2b270cb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9" Jul 22 02:17:30.284253 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.284109 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cmb7\" (UniqueName: \"kubernetes.io/projected/d493c362-5493-43f9-81e0-102a2b270cb4-kube-api-access-9cmb7\") pod \"managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9\" (UID: \"d493c362-5493-43f9-81e0-102a2b270cb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9" Jul 22 02:17:30.284576 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.284452 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzsz6\" (UniqueName: \"kubernetes.io/projected/977e4873-b86e-4940-8732-7e4b2143c786-kube-api-access-rzsz6\") pod \"klusterlet-addon-workmgr-bb4fb5656-ttpgj\" (UID: \"977e4873-b86e-4940-8732-7e4b2143c786\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:30.284576 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.284500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.284576 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.284531 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzmcs\" (UniqueName: \"kubernetes.io/projected/1258f8b9-f2a8-49a2-9f42-efb45d3096ee-kube-api-access-vzmcs\") pod \"downloads-5bc67dcd46-78spx\" (UID: \"1258f8b9-f2a8-49a2-9f42-efb45d3096ee\") " pod="openshift-console/downloads-5bc67dcd46-78spx" Jul 22 02:17:30.284576 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.284558 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/977e4873-b86e-4940-8732-7e4b2143c786-klusterlet-config\") pod \"klusterlet-addon-workmgr-bb4fb5656-ttpgj\" (UID: \"977e4873-b86e-4940-8732-7e4b2143c786\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:30.284768 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.284617 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2jfh\" (UniqueName: \"kubernetes.io/projected/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-kube-api-access-l2jfh\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.284768 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.284644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977e4873-b86e-4940-8732-7e4b2143c786-tmp\") pod \"klusterlet-addon-workmgr-bb4fb5656-ttpgj\" (UID: \"977e4873-b86e-4940-8732-7e4b2143c786\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:30.284768 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.284695 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.284768 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.284742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-hub\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.287852 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.287800 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d493c362-5493-43f9-81e0-102a2b270cb4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9\" (UID: \"d493c362-5493-43f9-81e0-102a2b270cb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9" Jul 22 02:17:30.293479 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.293431 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cmb7\" (UniqueName: \"kubernetes.io/projected/d493c362-5493-43f9-81e0-102a2b270cb4-kube-api-access-9cmb7\") pod \"managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9\" (UID: \"d493c362-5493-43f9-81e0-102a2b270cb4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9" Jul 22 02:17:30.385433 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.385395 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzsz6\" (UniqueName: \"kubernetes.io/projected/977e4873-b86e-4940-8732-7e4b2143c786-kube-api-access-rzsz6\") pod \"klusterlet-addon-workmgr-bb4fb5656-ttpgj\" (UID: \"977e4873-b86e-4940-8732-7e4b2143c786\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:30.385627 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.385448 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.385627 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.385481 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmcs\" (UniqueName: \"kubernetes.io/projected/1258f8b9-f2a8-49a2-9f42-efb45d3096ee-kube-api-access-vzmcs\") pod \"downloads-5bc67dcd46-78spx\" (UID: \"1258f8b9-f2a8-49a2-9f42-efb45d3096ee\") " pod="openshift-console/downloads-5bc67dcd46-78spx" Jul 22 02:17:30.385627 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.385509 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/977e4873-b86e-4940-8732-7e4b2143c786-klusterlet-config\") pod \"klusterlet-addon-workmgr-bb4fb5656-ttpgj\" (UID: \"977e4873-b86e-4940-8732-7e4b2143c786\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:30.385627 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.385562 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2jfh\" (UniqueName: \"kubernetes.io/projected/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-kube-api-access-l2jfh\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.385627 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.385588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977e4873-b86e-4940-8732-7e4b2143c786-tmp\") pod \"klusterlet-addon-workmgr-bb4fb5656-ttpgj\" (UID: \"977e4873-b86e-4940-8732-7e4b2143c786\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:30.385627 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.385613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.385947 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.385640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-hub\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.385947 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.385671 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.385947 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.385705 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-ca\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.387362 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.387310 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.388378 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.388333 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977e4873-b86e-4940-8732-7e4b2143c786-tmp\") pod \"klusterlet-addon-workmgr-bb4fb5656-ttpgj\" (UID: \"977e4873-b86e-4940-8732-7e4b2143c786\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:30.391316 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.391266 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.391449 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.391409 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-ca\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.392052 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.391998 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/977e4873-b86e-4940-8732-7e4b2143c786-klusterlet-config\") pod \"klusterlet-addon-workmgr-bb4fb5656-ttpgj\" (UID: \"977e4873-b86e-4940-8732-7e4b2143c786\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:30.393131 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.393079 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.393241 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.393152 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-hub\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.396666 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.396616 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2jfh\" (UniqueName: \"kubernetes.io/projected/20ff3dab-58e3-4a5c-b247-ffa7bd22dca7-kube-api-access-l2jfh\") pod \"cluster-proxy-proxy-agent-c74795fd4-2tt4t\" (UID: \"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.397262 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.397217 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzmcs\" (UniqueName: \"kubernetes.io/projected/1258f8b9-f2a8-49a2-9f42-efb45d3096ee-kube-api-access-vzmcs\") pod \"downloads-5bc67dcd46-78spx\" (UID: \"1258f8b9-f2a8-49a2-9f42-efb45d3096ee\") " pod="openshift-console/downloads-5bc67dcd46-78spx" Jul 22 02:17:30.398832 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.398786 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzsz6\" (UniqueName: \"kubernetes.io/projected/977e4873-b86e-4940-8732-7e4b2143c786-kube-api-access-rzsz6\") pod \"klusterlet-addon-workmgr-bb4fb5656-ttpgj\" (UID: \"977e4873-b86e-4940-8732-7e4b2143c786\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:30.434573 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.434433 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9" Jul 22 02:17:30.445050 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.445006 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" Jul 22 02:17:30.477862 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.477827 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:30.503720 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.503614 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-78spx" Jul 22 02:17:30.579995 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.579905 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:30.591931 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.584838 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c4c584546-b2wlb" Jul 22 02:17:30.676570 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.676484 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9"] Jul 22 02:17:30.738385 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.738309 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t"] Jul 22 02:17:30.785565 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.785530 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj"] Jul 22 02:17:30.808781 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:30.808649 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-78spx"] Jul 22 02:17:30.850084 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:30.850036 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd493c362_5493_43f9_81e0_102a2b270cb4.slice/crio-3f2cdf204d9f19c754e669e91a3ce52720484b67e11dfb334da71f996dcd8dc9 WatchSource:0}: Error finding container 3f2cdf204d9f19c754e669e91a3ce52720484b67e11dfb334da71f996dcd8dc9: Status 404 returned error can't find the container with id 3f2cdf204d9f19c754e669e91a3ce52720484b67e11dfb334da71f996dcd8dc9 Jul 22 02:17:30.851693 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:30.851653 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20ff3dab_58e3_4a5c_b247_ffa7bd22dca7.slice/crio-7e07eac005a74d65aa721e863234ea42d468ecfbb5604c30b7f102af91feed70 WatchSource:0}: Error finding container 7e07eac005a74d65aa721e863234ea42d468ecfbb5604c30b7f102af91feed70: Status 404 returned error can't find the container with id 7e07eac005a74d65aa721e863234ea42d468ecfbb5604c30b7f102af91feed70 Jul 22 02:17:30.853519 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:30.853445 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977e4873_b86e_4940_8732_7e4b2143c786.slice/crio-ad46f5395cd281dbd687094ef8841b8b1e9d488dcdb7cbd1a5b53b53ac36fb4f WatchSource:0}: Error finding container ad46f5395cd281dbd687094ef8841b8b1e9d488dcdb7cbd1a5b53b53ac36fb4f: Status 404 returned error can't find the container with id ad46f5395cd281dbd687094ef8841b8b1e9d488dcdb7cbd1a5b53b53ac36fb4f Jul 22 02:17:30.854126 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:30.854098 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1258f8b9_f2a8_49a2_9f42_efb45d3096ee.slice/crio-cb10a28e5dda0d59d18d29c467e538909ebb80f92173838e1c3a04995e955551 WatchSource:0}: Error finding container cb10a28e5dda0d59d18d29c467e538909ebb80f92173838e1c3a04995e955551: Status 404 returned error can't find the container with id cb10a28e5dda0d59d18d29c467e538909ebb80f92173838e1c3a04995e955551 Jul 22 02:17:31.586136 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:31.586093 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" event={"ID":"515007d6-343c-4176-9e24-e2531a39b46a","Type":"ContainerStarted","Data":"19bf76d504650751f5f46424bd8ae47552f843231200b0c0de08c5986cc3afe4"} Jul 22 02:17:31.588554 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:31.588523 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" event={"ID":"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7","Type":"ContainerStarted","Data":"7e07eac005a74d65aa721e863234ea42d468ecfbb5604c30b7f102af91feed70"} Jul 22 02:17:31.589988 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:31.589955 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-78spx" event={"ID":"1258f8b9-f2a8-49a2-9f42-efb45d3096ee","Type":"ContainerStarted","Data":"cb10a28e5dda0d59d18d29c467e538909ebb80f92173838e1c3a04995e955551"} Jul 22 02:17:31.591365 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:31.591339 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" event={"ID":"977e4873-b86e-4940-8732-7e4b2143c786","Type":"ContainerStarted","Data":"ad46f5395cd281dbd687094ef8841b8b1e9d488dcdb7cbd1a5b53b53ac36fb4f"} Jul 22 02:17:31.592497 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:31.592470 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9" event={"ID":"d493c362-5493-43f9-81e0-102a2b270cb4","Type":"ContainerStarted","Data":"3f2cdf204d9f19c754e669e91a3ce52720484b67e11dfb334da71f996dcd8dc9"} Jul 22 02:17:31.603236 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:31.603187 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ff2jk" podStartSLOduration=39.587071954 podStartE2EDuration="41.603170352s" totalImagesPullingTime="2.016098398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:31.602011334 +0000 UTC m=+75.107997784" watchObservedRunningTime="2026-07-22 02:17:31.603170352 +0000 UTC m=+75.109156798" Jul 22 02:17:36.625695 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:36.625588 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c78t5" event={"ID":"a0a243c1-edde-4738-8d57-b517b4dad2a6","Type":"ContainerStarted","Data":"e027804f1ae3be28fbbe9afcbd75e22f57a4475f059746d3749ef2c91a676de6"} Jul 22 02:17:36.630306 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:36.629503 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" event={"ID":"9d79edf4-e8ea-48ff-913f-df6ffab993a3","Type":"ContainerStarted","Data":"7743e758d7077927f56e616e5b768f17a8ecd9736bdd622512f394c8a0af6f50"} Jul 22 02:17:36.634524 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:36.634472 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jxb8n" event={"ID":"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2","Type":"ContainerStarted","Data":"b6fc14d030518c0b0c65364f45f00fb08ee137875ea1418eb171b4e268058565"} Jul 22 02:17:36.634676 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:36.634538 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jxb8n" event={"ID":"cea823f6-3bb0-41cc-b9a0-49267e8d0fb2","Type":"ContainerStarted","Data":"242dd1dff2554835aabdb79e14653cc8405c808c6a3055f67c145d9022ea2412"} Jul 22 02:17:36.635174 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:36.635150 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jxb8n" Jul 22 02:17:36.653040 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:36.652967 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hdkxj" podStartSLOduration=69.702047366 podStartE2EDuration="1m16.652946292s" totalImagesPullingTime="6.950898926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:36.649731036 +0000 UTC m=+80.155717489" watchObservedRunningTime="2026-07-22 02:17:36.652946292 +0000 UTC m=+80.158932747" Jul 22 02:17:43.677181 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.677130 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" event={"ID":"977e4873-b86e-4940-8732-7e4b2143c786","Type":"ContainerStarted","Data":"d0b6089d1498177d9f6389e83d78fb2a0654249bb7ccc977cfdc87238130a426"} Jul 22 02:17:43.677686 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.677312 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:43.679484 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.679461 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" Jul 22 02:17:43.679765 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.679742 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c78t5" event={"ID":"a0a243c1-edde-4738-8d57-b517b4dad2a6","Type":"ContainerStarted","Data":"e097f4e4793c9cdb900c54bb53255355cfdec687a54e2c207d2111773879cc12"} Jul 22 02:17:43.681472 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.681447 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9" event={"ID":"d493c362-5493-43f9-81e0-102a2b270cb4","Type":"ContainerStarted","Data":"bf01935b6d76143222b1017f844cbc665b912157fa7148150dd245a07b8c9164"} Jul 22 02:17:43.684082 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.684053 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" event={"ID":"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7","Type":"ContainerStarted","Data":"2688f4386cdbf63ce19191a9af7e3aa228db0b85282990097b6a0bd95810ec55"} Jul 22 02:17:43.684191 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.684094 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" event={"ID":"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7","Type":"ContainerStarted","Data":"2f3b1d71c2e29671ddef662bfd6b37755c141ea6cd29db34485a4b2f5b294b05"} Jul 22 02:17:43.684191 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.684108 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" event={"ID":"20ff3dab-58e3-4a5c-b247-ffa7bd22dca7","Type":"ContainerStarted","Data":"8904200d944831b867e2c5e54685749bfc6f993e5342c311971fbfe59e1b32be"} Jul 22 02:17:43.696853 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.696806 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bb4fb5656-ttpgj" podStartSLOduration=1.640497646 podStartE2EDuration="13.696789167s" totalImagesPullingTime="12.056291521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:43.695458726 +0000 UTC m=+87.201445181" watchObservedRunningTime="2026-07-22 02:17:43.696789167 +0000 UTC m=+87.202775614" Jul 22 02:17:43.697048 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.697022 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jxb8n" podStartSLOduration=41.736434419 podStartE2EDuration="48.697013652s" totalImagesPullingTime="6.960579233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:36.674675919 +0000 UTC m=+80.180662372" watchObservedRunningTime="2026-07-22 02:17:43.697013652 +0000 UTC m=+87.203000112" Jul 22 02:17:43.718811 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.718747 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c78t5" podStartSLOduration=17.876866024 podStartE2EDuration="38.718729448s" totalImagesPullingTime="20.841863424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:17:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:43.718638596 +0000 UTC m=+87.224625049" watchObservedRunningTime="2026-07-22 02:17:43.718729448 +0000 UTC m=+87.224715901" Jul 22 02:17:43.743056 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.742971 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c74795fd4-2tt4t" podStartSLOduration=1.685942405 podStartE2EDuration="13.742952069s" totalImagesPullingTime="12.057009664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:43.741642164 +0000 UTC m=+87.247628617" watchObservedRunningTime="2026-07-22 02:17:43.742952069 +0000 UTC m=+87.248938520" Jul 22 02:17:43.781639 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:43.781572 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6cfd7bcf6b-8wxg9" podStartSLOduration=1.767065175 podStartE2EDuration="13.781548338s" totalImagesPullingTime="12.014483163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:43.780729373 +0000 UTC m=+87.286715826" watchObservedRunningTime="2026-07-22 02:17:43.781548338 +0000 UTC m=+87.287534791" Jul 22 02:17:47.650615 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:47.650565 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jxb8n" Jul 22 02:17:47.975546 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:47.975505 2556 patch_prober.go:28] interesting pod/image-registry-7c756c9896-sm9gn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 22 02:17:47.975742 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:47.975568 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" podUID="eabd1f35-b25a-415d-ac46-0802c5a281bb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 02:17:51.167699 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.167667 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5scxs"] Jul 22 02:17:51.294400 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.294365 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.298397 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.298154 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 02:17:51.298397 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.298272 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 02:17:51.298397 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.298277 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5k47c\"" Jul 22 02:17:51.298397 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.298320 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 02:17:51.298397 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.298321 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 02:17:51.379814 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.379770 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-wtmp\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.379814 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.379818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1385c74d-5913-4cba-a051-95976db46c5f-metrics-client-ca\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.380189 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.379849 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1385c74d-5913-4cba-a051-95976db46c5f-sys\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.380189 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.379874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.380189 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.379906 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27d8m\" (UniqueName: \"kubernetes.io/projected/1385c74d-5913-4cba-a051-95976db46c5f-kube-api-access-27d8m\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.380189 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.379951 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1385c74d-5913-4cba-a051-95976db46c5f-root\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.380189 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.380001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-textfile\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.380189 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.380065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.380189 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.380096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-tls\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.481492 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.481454 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-textfile\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.481704 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.481505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.481704 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.481665 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-tls\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.481704 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.481699 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-wtmp\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.481884 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.481718 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1385c74d-5913-4cba-a051-95976db46c5f-metrics-client-ca\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.481942 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.481876 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1385c74d-5913-4cba-a051-95976db46c5f-sys\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.481942 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.481889 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-wtmp\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.481942 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.481880 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-textfile\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.481942 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.481925 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1385c74d-5913-4cba-a051-95976db46c5f-sys\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.481942 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.481930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.482266 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.482001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27d8m\" (UniqueName: \"kubernetes.io/projected/1385c74d-5913-4cba-a051-95976db46c5f-kube-api-access-27d8m\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.482266 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.482058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1385c74d-5913-4cba-a051-95976db46c5f-root\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.482266 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.482154 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1385c74d-5913-4cba-a051-95976db46c5f-root\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.482266 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.482236 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.482444 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.482268 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1385c74d-5913-4cba-a051-95976db46c5f-metrics-client-ca\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.484210 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.484188 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-tls\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.484557 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.484539 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1385c74d-5913-4cba-a051-95976db46c5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.490910 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.490882 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27d8m\" (UniqueName: \"kubernetes.io/projected/1385c74d-5913-4cba-a051-95976db46c5f-kube-api-access-27d8m\") pod \"node-exporter-5scxs\" (UID: \"1385c74d-5913-4cba-a051-95976db46c5f\") " pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.599211 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.599185 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:17:51.604948 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.604925 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5scxs" Jul 22 02:17:51.637076 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:17:51.637038 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1385c74d_5913_4cba_a051_95976db46c5f.slice/crio-befdd8af2e358202d0e179412b04771957d2f51228ba363f63c24fbea38e76cd WatchSource:0}: Error finding container befdd8af2e358202d0e179412b04771957d2f51228ba363f63c24fbea38e76cd: Status 404 returned error can't find the container with id befdd8af2e358202d0e179412b04771957d2f51228ba363f63c24fbea38e76cd Jul 22 02:17:51.726798 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.726761 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-78spx" event={"ID":"1258f8b9-f2a8-49a2-9f42-efb45d3096ee","Type":"ContainerStarted","Data":"7523a20ed7936a501f919f5efd2550b54fc8ae3b82ced014bd74d5ff2fd9ad44"} Jul 22 02:17:51.728387 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:51.728353 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5scxs" event={"ID":"1385c74d-5913-4cba-a051-95976db46c5f","Type":"ContainerStarted","Data":"befdd8af2e358202d0e179412b04771957d2f51228ba363f63c24fbea38e76cd"} Jul 22 02:17:52.639003 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:52.635801 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c756c9896-sm9gn"] Jul 22 02:17:52.735086 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:52.735051 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-78spx" Jul 22 02:17:52.747932 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:52.747899 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-78spx" Jul 22 02:17:52.754066 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:52.754013 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-78spx" podStartSLOduration=2.07226867 podStartE2EDuration="22.753963116s" totalImagesPullingTime="20.681694446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:52.7521103 +0000 UTC m=+96.258096754" watchObservedRunningTime="2026-07-22 02:17:52.753963116 +0000 UTC m=+96.259949569" Jul 22 02:17:53.743115 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:53.743073 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5scxs" event={"ID":"1385c74d-5913-4cba-a051-95976db46c5f","Type":"ContainerStarted","Data":"680f0bd2757279d92c680fe3dc4e310ab5c28a4000f1cf15fe5ce766ecedecc4"} Jul 22 02:17:54.526590 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:54.526552 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t66zg" Jul 22 02:17:54.748649 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:54.748613 2556 generic.go:356] "Generic (PLEG): container finished" podID="1385c74d-5913-4cba-a051-95976db46c5f" containerID="680f0bd2757279d92c680fe3dc4e310ab5c28a4000f1cf15fe5ce766ecedecc4" exitCode=0 Jul 22 02:17:54.749127 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:54.748702 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5scxs" event={"ID":"1385c74d-5913-4cba-a051-95976db46c5f","Type":"ContainerDied","Data":"680f0bd2757279d92c680fe3dc4e310ab5c28a4000f1cf15fe5ce766ecedecc4"} Jul 22 02:17:55.762198 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:55.762159 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5scxs" event={"ID":"1385c74d-5913-4cba-a051-95976db46c5f","Type":"ContainerStarted","Data":"ed766fed7e3c8ab9f9041ea725aefe569a7aa1ea16023967a93a2e2cb2abbe89"} Jul 22 02:17:55.762652 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:55.762249 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5scxs" event={"ID":"1385c74d-5913-4cba-a051-95976db46c5f","Type":"ContainerStarted","Data":"4eaa090cd330a94215def5850a4aa1bc733585207d62bb4f8fd708f2469054d9"} Jul 22 02:17:55.783304 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:17:55.783236 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5scxs" podStartSLOduration=2.78672205 podStartE2EDuration="4.783214263s" totalImagesPullingTime="1.874976592s" totalInitContainerRuntime="121.515621ms" isStatefulPod=true podCreationTimestamp="2026-07-22 02:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:17:55.780590624 +0000 UTC m=+99.286577105" watchObservedRunningTime="2026-07-22 02:17:55.783214263 +0000 UTC m=+99.289200716" Jul 22 02:18:15.846263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:15.846229 2556 generic.go:356] "Generic (PLEG): container finished" podID="39b4a0c9-5629-46ee-9c38-839e2785e93b" containerID="b172b87049ba1a51a2c96f893d2e8710f0325a0909d7f65b1c08dcd552df8352" exitCode=0 Jul 22 02:18:15.846767 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:15.846313 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-t2cwg" event={"ID":"39b4a0c9-5629-46ee-9c38-839e2785e93b","Type":"ContainerDied","Data":"b172b87049ba1a51a2c96f893d2e8710f0325a0909d7f65b1c08dcd552df8352"} Jul 22 02:18:15.846767 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:15.846647 2556 scope.go:117] "RemoveContainer" containerID="b172b87049ba1a51a2c96f893d2e8710f0325a0909d7f65b1c08dcd552df8352" Jul 22 02:18:15.847813 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:15.847788 2556 generic.go:356] "Generic (PLEG): container finished" podID="a13a4c7d-b104-42df-8a67-ed5e9d8f55b6" containerID="936fbeafa639e0f02532f6c4a1c50309c4e52bdb94e08d5519aa6b5fbbe9ad54" exitCode=0 Jul 22 02:18:15.847887 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:15.847859 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" event={"ID":"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6","Type":"ContainerDied","Data":"936fbeafa639e0f02532f6c4a1c50309c4e52bdb94e08d5519aa6b5fbbe9ad54"} Jul 22 02:18:15.848153 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:15.848139 2556 scope.go:117] "RemoveContainer" containerID="936fbeafa639e0f02532f6c4a1c50309c4e52bdb94e08d5519aa6b5fbbe9ad54" Jul 22 02:18:16.854278 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:16.854239 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-t2cwg" event={"ID":"39b4a0c9-5629-46ee-9c38-839e2785e93b","Type":"ContainerStarted","Data":"72f3579034128606bd1ce0056a781d2e3257d12ba7b626e92dad68f1139bf5dd"} Jul 22 02:18:16.856033 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:16.856002 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-mlcq4" event={"ID":"a13a4c7d-b104-42df-8a67-ed5e9d8f55b6","Type":"ContainerStarted","Data":"403c523bfec42f0700108a83444f1aff04c5b78426d2998a15e582481b4a5252"} Jul 22 02:18:17.669413 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:17.669369 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" podUID="eabd1f35-b25a-415d-ac46-0802c5a281bb" containerName="registry" containerID="cri-o://a3c223cb60e3b0b8c195a2b4995f7eed921edd99bdcc1aee9fc41b9ccd8e939b" gracePeriod=30 Jul 22 02:18:17.861570 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:17.861538 2556 generic.go:356] "Generic (PLEG): container finished" podID="eabd1f35-b25a-415d-ac46-0802c5a281bb" containerID="a3c223cb60e3b0b8c195a2b4995f7eed921edd99bdcc1aee9fc41b9ccd8e939b" exitCode=0 Jul 22 02:18:17.862015 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:17.861577 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" event={"ID":"eabd1f35-b25a-415d-ac46-0802c5a281bb","Type":"ContainerDied","Data":"a3c223cb60e3b0b8c195a2b4995f7eed921edd99bdcc1aee9fc41b9ccd8e939b"} Jul 22 02:18:17.946621 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:17.946543 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:18:18.119099 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.119057 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-installation-pull-secrets\") pod \"eabd1f35-b25a-415d-ac46-0802c5a281bb\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " Jul 22 02:18:18.119315 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.119125 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls\") pod \"eabd1f35-b25a-415d-ac46-0802c5a281bb\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " Jul 22 02:18:18.119315 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.119223 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-bound-sa-token\") pod \"eabd1f35-b25a-415d-ac46-0802c5a281bb\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " Jul 22 02:18:18.119315 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.119268 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eabd1f35-b25a-415d-ac46-0802c5a281bb-ca-trust-extracted\") pod \"eabd1f35-b25a-415d-ac46-0802c5a281bb\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " Jul 22 02:18:18.119315 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.119301 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxkb4\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-kube-api-access-jxkb4\") pod \"eabd1f35-b25a-415d-ac46-0802c5a281bb\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " Jul 22 02:18:18.119540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.119322 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-image-registry-private-configuration\") pod \"eabd1f35-b25a-415d-ac46-0802c5a281bb\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " Jul 22 02:18:18.119540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.119394 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-certificates\") pod \"eabd1f35-b25a-415d-ac46-0802c5a281bb\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " Jul 22 02:18:18.119540 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.119415 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-trusted-ca\") pod \"eabd1f35-b25a-415d-ac46-0802c5a281bb\" (UID: \"eabd1f35-b25a-415d-ac46-0802c5a281bb\") " Jul 22 02:18:18.119940 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.119910 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "eabd1f35-b25a-415d-ac46-0802c5a281bb" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:18:18.120066 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.119964 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "eabd1f35-b25a-415d-ac46-0802c5a281bb" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:18:18.121679 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.121655 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "eabd1f35-b25a-415d-ac46-0802c5a281bb" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:18:18.121794 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.121690 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "eabd1f35-b25a-415d-ac46-0802c5a281bb" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:18:18.121794 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.121782 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eabd1f35-b25a-415d-ac46-0802c5a281bb" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:18:18.121878 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.121801 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "eabd1f35-b25a-415d-ac46-0802c5a281bb" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:18:18.122234 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.122212 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-kube-api-access-jxkb4" (OuterVolumeSpecName: "kube-api-access-jxkb4") pod "eabd1f35-b25a-415d-ac46-0802c5a281bb" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb"). InnerVolumeSpecName "kube-api-access-jxkb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:18:18.127574 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.127550 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eabd1f35-b25a-415d-ac46-0802c5a281bb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "eabd1f35-b25a-415d-ac46-0802c5a281bb" (UID: "eabd1f35-b25a-415d-ac46-0802c5a281bb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:18:18.220864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.220821 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-certificates\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:18:18.220864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.220856 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eabd1f35-b25a-415d-ac46-0802c5a281bb-trusted-ca\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:18:18.220864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.220869 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-installation-pull-secrets\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:18:18.221159 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.220880 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-registry-tls\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:18:18.221159 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.220892 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-bound-sa-token\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:18:18.221159 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.220902 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eabd1f35-b25a-415d-ac46-0802c5a281bb-ca-trust-extracted\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:18:18.221159 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.220914 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxkb4\" (UniqueName: \"kubernetes.io/projected/eabd1f35-b25a-415d-ac46-0802c5a281bb-kube-api-access-jxkb4\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:18:18.221159 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.220928 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eabd1f35-b25a-415d-ac46-0802c5a281bb-image-registry-private-configuration\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:18:18.867741 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.867711 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" Jul 22 02:18:18.868193 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.867703 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c756c9896-sm9gn" event={"ID":"eabd1f35-b25a-415d-ac46-0802c5a281bb","Type":"ContainerDied","Data":"de61145ca6ef4cc059b76dedab4fcaa9de5cd536ce4fa0d032741fddc661c492"} Jul 22 02:18:18.868193 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.867868 2556 scope.go:117] "RemoveContainer" containerID="a3c223cb60e3b0b8c195a2b4995f7eed921edd99bdcc1aee9fc41b9ccd8e939b" Jul 22 02:18:18.889679 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.889647 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c756c9896-sm9gn"] Jul 22 02:18:18.893301 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:18.893268 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c756c9896-sm9gn"] Jul 22 02:18:19.024511 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:19.024468 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eabd1f35-b25a-415d-ac46-0802c5a281bb" path="/var/lib/kubelet/pods/eabd1f35-b25a-415d-ac46-0802c5a281bb/volumes" Jul 22 02:18:35.935051 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:35.934937 2556 generic.go:356] "Generic (PLEG): container finished" podID="ee248576-7569-4778-acc1-32e7f80758b4" containerID="649e6337a75fe2e6406365f957ed27476535d71e6689486a3e77d6a269ed3893" exitCode=0 Jul 22 02:18:35.935051 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:35.935017 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" event={"ID":"ee248576-7569-4778-acc1-32e7f80758b4","Type":"ContainerDied","Data":"649e6337a75fe2e6406365f957ed27476535d71e6689486a3e77d6a269ed3893"} Jul 22 02:18:35.935472 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:35.935392 2556 scope.go:117] "RemoveContainer" containerID="649e6337a75fe2e6406365f957ed27476535d71e6689486a3e77d6a269ed3893" Jul 22 02:18:36.940956 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:18:36.940922 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7wlng" event={"ID":"ee248576-7569-4778-acc1-32e7f80758b4","Type":"ContainerStarted","Data":"9ebda4984d8a41c4e663caf92d4beafa9dc5cd2d49f84109941aaa3cb242ce64"} Jul 22 02:21:16.920082 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:16.920053 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:21:16.925648 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:16.925624 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:21:16.929830 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:16.929806 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 02:21:16.931583 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:16.931559 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:21:16.938203 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:16.938180 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:21:39.038127 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.038089 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h"] Jul 22 02:21:39.039573 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.038403 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eabd1f35-b25a-415d-ac46-0802c5a281bb" containerName="registry" Jul 22 02:21:39.039573 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.038415 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eabd1f35-b25a-415d-ac46-0802c5a281bb" containerName="registry" Jul 22 02:21:39.039573 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.038463 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="eabd1f35-b25a-415d-ac46-0802c5a281bb" containerName="registry" Jul 22 02:21:39.040700 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.040685 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.043510 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.043482 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 02:21:39.043664 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.043534 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 02:21:39.043664 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.043545 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 02:21:39.043664 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.043495 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 02:21:39.043664 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.043631 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5fjrz\"" Jul 22 02:21:39.060601 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.060564 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h"] Jul 22 02:21:39.126312 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.126265 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe9d9784-0142-4104-834a-96c11a11c28f-tmp\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.126516 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.126322 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9d9784-0142-4104-834a-96c11a11c28f-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.126516 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.126381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxvrf\" (UniqueName: \"kubernetes.io/projected/fe9d9784-0142-4104-834a-96c11a11c28f-kube-api-access-kxvrf\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.126516 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.126429 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe9d9784-0142-4104-834a-96c11a11c28f-manifests\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.126659 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.126511 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe9d9784-0142-4104-834a-96c11a11c28f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.227577 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.227539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe9d9784-0142-4104-834a-96c11a11c28f-manifests\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.227779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.227587 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe9d9784-0142-4104-834a-96c11a11c28f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.227779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.227633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe9d9784-0142-4104-834a-96c11a11c28f-tmp\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.227779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.227669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9d9784-0142-4104-834a-96c11a11c28f-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.227779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.227702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxvrf\" (UniqueName: \"kubernetes.io/projected/fe9d9784-0142-4104-834a-96c11a11c28f-kube-api-access-kxvrf\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.228080 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.228041 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe9d9784-0142-4104-834a-96c11a11c28f-manifests\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.230112 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.230086 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe9d9784-0142-4104-834a-96c11a11c28f-tmp\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.230212 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.230187 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe9d9784-0142-4104-834a-96c11a11c28f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.230212 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.230188 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe9d9784-0142-4104-834a-96c11a11c28f-webhook-cert\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.236704 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.236673 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxvrf\" (UniqueName: \"kubernetes.io/projected/fe9d9784-0142-4104-834a-96c11a11c28f-kube-api-access-kxvrf\") pod \"opendatahub-operator-controller-manager-57f477d5fd-5vp2h\" (UID: \"fe9d9784-0142-4104-834a-96c11a11c28f\") " pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.351786 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.351703 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:39.514513 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.514489 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h"] Jul 22 02:21:39.516828 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:21:39.516799 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9d9784_0142_4104_834a_96c11a11c28f.slice/crio-03fcf1670ffc82425e5969534971a22ebbc88ac93b46dc6b81846ca8f078f400 WatchSource:0}: Error finding container 03fcf1670ffc82425e5969534971a22ebbc88ac93b46dc6b81846ca8f078f400: Status 404 returned error can't find the container with id 03fcf1670ffc82425e5969534971a22ebbc88ac93b46dc6b81846ca8f078f400 Jul 22 02:21:39.518729 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.518709 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:21:39.645139 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:39.645043 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" event={"ID":"fe9d9784-0142-4104-834a-96c11a11c28f","Type":"ContainerStarted","Data":"03fcf1670ffc82425e5969534971a22ebbc88ac93b46dc6b81846ca8f078f400"} Jul 22 02:21:43.665724 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:43.665688 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" event={"ID":"fe9d9784-0142-4104-834a-96c11a11c28f","Type":"ContainerStarted","Data":"665fed227395a7ea59c7fbed69948f2c3f2ebff1707a53b1b268989e5dddeee7"} Jul 22 02:21:44.671323 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:44.671285 2556 generic.go:356] "Generic (PLEG): container finished" podID="fe9d9784-0142-4104-834a-96c11a11c28f" containerID="665fed227395a7ea59c7fbed69948f2c3f2ebff1707a53b1b268989e5dddeee7" exitCode=0 Jul 22 02:21:44.671784 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:44.671369 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" event={"ID":"fe9d9784-0142-4104-834a-96c11a11c28f","Type":"ContainerDied","Data":"665fed227395a7ea59c7fbed69948f2c3f2ebff1707a53b1b268989e5dddeee7"} Jul 22 02:21:45.677569 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:45.677534 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" event={"ID":"fe9d9784-0142-4104-834a-96c11a11c28f","Type":"ContainerStarted","Data":"e8db558ef1e824af714faf1a1fde5613124b3325c17586b2b863d712fcd908d3"} Jul 22 02:21:45.677959 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:45.677672 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:45.703891 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:45.703837 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" podStartSLOduration=2.220614394 podStartE2EDuration="6.703821338s" totalImagesPullingTime="3.401516816s" totalInitContainerRuntime="1.081690128s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:21:45.701535725 +0000 UTC m=+329.207522177" watchObservedRunningTime="2026-07-22 02:21:45.703821338 +0000 UTC m=+329.209807790" Jul 22 02:21:56.683838 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:56.683808 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57f477d5fd-5vp2h" Jul 22 02:21:59.512210 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.512168 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7756896c6-zbglf"] Jul 22 02:21:59.521805 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.521776 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" Jul 22 02:21:59.524673 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.524650 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 22 02:21:59.524902 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.524885 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 22 02:21:59.540564 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.540535 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7756896c6-zbglf"] Jul 22 02:21:59.703448 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.703409 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0de272f9-cd4e-44a2-8702-8b84cdca4ecd-tmp\") pod \"kube-auth-proxy-7756896c6-zbglf\" (UID: \"0de272f9-cd4e-44a2-8702-8b84cdca4ecd\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" Jul 22 02:21:59.703627 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.703460 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967b8\" (UniqueName: \"kubernetes.io/projected/0de272f9-cd4e-44a2-8702-8b84cdca4ecd-kube-api-access-967b8\") pod \"kube-auth-proxy-7756896c6-zbglf\" (UID: \"0de272f9-cd4e-44a2-8702-8b84cdca4ecd\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" Jul 22 02:21:59.703627 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.703547 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0de272f9-cd4e-44a2-8702-8b84cdca4ecd-tls-certs\") pod \"kube-auth-proxy-7756896c6-zbglf\" (UID: \"0de272f9-cd4e-44a2-8702-8b84cdca4ecd\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" Jul 22 02:21:59.765191 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.765107 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hc7c4"] Jul 22 02:21:59.767463 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.767446 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" Jul 22 02:21:59.770178 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.770157 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 22 02:21:59.770307 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.770205 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-49tvf\"" Jul 22 02:21:59.791616 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.791580 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hc7c4"] Jul 22 02:21:59.803997 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.803943 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0de272f9-cd4e-44a2-8702-8b84cdca4ecd-tmp\") pod \"kube-auth-proxy-7756896c6-zbglf\" (UID: \"0de272f9-cd4e-44a2-8702-8b84cdca4ecd\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" Jul 22 02:21:59.804189 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.804007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967b8\" (UniqueName: \"kubernetes.io/projected/0de272f9-cd4e-44a2-8702-8b84cdca4ecd-kube-api-access-967b8\") pod \"kube-auth-proxy-7756896c6-zbglf\" (UID: \"0de272f9-cd4e-44a2-8702-8b84cdca4ecd\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" Jul 22 02:21:59.804189 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.804057 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0de272f9-cd4e-44a2-8702-8b84cdca4ecd-tls-certs\") pod \"kube-auth-proxy-7756896c6-zbglf\" (UID: \"0de272f9-cd4e-44a2-8702-8b84cdca4ecd\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" Jul 22 02:21:59.806328 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.806301 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0de272f9-cd4e-44a2-8702-8b84cdca4ecd-tmp\") pod \"kube-auth-proxy-7756896c6-zbglf\" (UID: \"0de272f9-cd4e-44a2-8702-8b84cdca4ecd\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" Jul 22 02:21:59.806559 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.806537 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0de272f9-cd4e-44a2-8702-8b84cdca4ecd-tls-certs\") pod \"kube-auth-proxy-7756896c6-zbglf\" (UID: \"0de272f9-cd4e-44a2-8702-8b84cdca4ecd\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" Jul 22 02:21:59.819459 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.819420 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-967b8\" (UniqueName: \"kubernetes.io/projected/0de272f9-cd4e-44a2-8702-8b84cdca4ecd-kube-api-access-967b8\") pod \"kube-auth-proxy-7756896c6-zbglf\" (UID: \"0de272f9-cd4e-44a2-8702-8b84cdca4ecd\") " pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" Jul 22 02:21:59.831205 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.831175 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" Jul 22 02:21:59.904599 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.904560 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p68j7\" (UniqueName: \"kubernetes.io/projected/d06e2e9e-733e-4ed0-974f-63a06c7913ad-kube-api-access-p68j7\") pod \"odh-model-controller-7998c67dc4-hc7c4\" (UID: \"d06e2e9e-733e-4ed0-974f-63a06c7913ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" Jul 22 02:21:59.904729 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.904631 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d06e2e9e-733e-4ed0-974f-63a06c7913ad-cert\") pod \"odh-model-controller-7998c67dc4-hc7c4\" (UID: \"d06e2e9e-733e-4ed0-974f-63a06c7913ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" Jul 22 02:21:59.972726 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:21:59.972695 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7756896c6-zbglf"] Jul 22 02:21:59.974455 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:21:59.974426 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de272f9_cd4e_44a2_8702_8b84cdca4ecd.slice/crio-8ad27b792a10d611cf0332eef3c484837fd2bd21bc6a79be3a173b30450f9fd8 WatchSource:0}: Error finding container 8ad27b792a10d611cf0332eef3c484837fd2bd21bc6a79be3a173b30450f9fd8: Status 404 returned error can't find the container with id 8ad27b792a10d611cf0332eef3c484837fd2bd21bc6a79be3a173b30450f9fd8 Jul 22 02:22:00.005029 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.004998 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d06e2e9e-733e-4ed0-974f-63a06c7913ad-cert\") pod \"odh-model-controller-7998c67dc4-hc7c4\" (UID: \"d06e2e9e-733e-4ed0-974f-63a06c7913ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" Jul 22 02:22:00.005195 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.005072 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p68j7\" (UniqueName: \"kubernetes.io/projected/d06e2e9e-733e-4ed0-974f-63a06c7913ad-kube-api-access-p68j7\") pod \"odh-model-controller-7998c67dc4-hc7c4\" (UID: \"d06e2e9e-733e-4ed0-974f-63a06c7913ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" Jul 22 02:22:00.005195 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:22:00.005136 2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 22 02:22:00.005281 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:22:00.005222 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06e2e9e-733e-4ed0-974f-63a06c7913ad-cert podName:d06e2e9e-733e-4ed0-974f-63a06c7913ad nodeName:}" failed. No retries permitted until 2026-07-22 02:22:00.505199938 +0000 UTC m=+344.011186375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d06e2e9e-733e-4ed0-974f-63a06c7913ad-cert") pod "odh-model-controller-7998c67dc4-hc7c4" (UID: "d06e2e9e-733e-4ed0-974f-63a06c7913ad") : secret "odh-model-controller-webhook-cert" not found Jul 22 02:22:00.023417 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.023344 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p68j7\" (UniqueName: \"kubernetes.io/projected/d06e2e9e-733e-4ed0-974f-63a06c7913ad-kube-api-access-p68j7\") pod \"odh-model-controller-7998c67dc4-hc7c4\" (UID: \"d06e2e9e-733e-4ed0-974f-63a06c7913ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" Jul 22 02:22:00.509461 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.509425 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d06e2e9e-733e-4ed0-974f-63a06c7913ad-cert\") pod \"odh-model-controller-7998c67dc4-hc7c4\" (UID: \"d06e2e9e-733e-4ed0-974f-63a06c7913ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" Jul 22 02:22:00.511957 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.511930 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d06e2e9e-733e-4ed0-974f-63a06c7913ad-cert\") pod \"odh-model-controller-7998c67dc4-hc7c4\" (UID: \"d06e2e9e-733e-4ed0-974f-63a06c7913ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" Jul 22 02:22:00.677464 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.677277 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" Jul 22 02:22:00.744626 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.744588 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" event={"ID":"0de272f9-cd4e-44a2-8702-8b84cdca4ecd","Type":"ContainerStarted","Data":"8ad27b792a10d611cf0332eef3c484837fd2bd21bc6a79be3a173b30450f9fd8"} Jul 22 02:22:00.752128 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.751339 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gkbz9"] Jul 22 02:22:00.754420 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.754394 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" Jul 22 02:22:00.757378 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.757064 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-cq4kh\"" Jul 22 02:22:00.757378 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.757302 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 22 02:22:00.771141 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.771035 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gkbz9"] Jul 22 02:22:00.812207 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.811687 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150974e6-f10a-4460-b3af-055e40bd37bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-gkbz9\" (UID: \"150974e6-f10a-4460-b3af-055e40bd37bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" Jul 22 02:22:00.812207 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.811795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppg4p\" (UniqueName: \"kubernetes.io/projected/150974e6-f10a-4460-b3af-055e40bd37bb-kube-api-access-ppg4p\") pod \"model-serving-api-54d89bd5fc-gkbz9\" (UID: \"150974e6-f10a-4460-b3af-055e40bd37bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" Jul 22 02:22:00.856718 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.856423 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hc7c4"] Jul 22 02:22:00.859574 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:22:00.859540 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06e2e9e_733e_4ed0_974f_63a06c7913ad.slice/crio-f12c5c3c02e6231731937c186a16558a7d129579703e8b11e752ecf5286cff1b WatchSource:0}: Error finding container f12c5c3c02e6231731937c186a16558a7d129579703e8b11e752ecf5286cff1b: Status 404 returned error can't find the container with id f12c5c3c02e6231731937c186a16558a7d129579703e8b11e752ecf5286cff1b Jul 22 02:22:00.912437 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.912404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150974e6-f10a-4460-b3af-055e40bd37bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-gkbz9\" (UID: \"150974e6-f10a-4460-b3af-055e40bd37bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" Jul 22 02:22:00.912642 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.912518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppg4p\" (UniqueName: \"kubernetes.io/projected/150974e6-f10a-4460-b3af-055e40bd37bb-kube-api-access-ppg4p\") pod \"model-serving-api-54d89bd5fc-gkbz9\" (UID: \"150974e6-f10a-4460-b3af-055e40bd37bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" Jul 22 02:22:00.912642 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:22:00.912577 2556 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 22 02:22:00.912765 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:22:00.912657 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/150974e6-f10a-4460-b3af-055e40bd37bb-tls-certs podName:150974e6-f10a-4460-b3af-055e40bd37bb nodeName:}" failed. No retries permitted until 2026-07-22 02:22:01.412635495 +0000 UTC m=+344.918621939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/150974e6-f10a-4460-b3af-055e40bd37bb-tls-certs") pod "model-serving-api-54d89bd5fc-gkbz9" (UID: "150974e6-f10a-4460-b3af-055e40bd37bb") : secret "model-serving-api-tls" not found Jul 22 02:22:00.921760 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:00.921729 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppg4p\" (UniqueName: \"kubernetes.io/projected/150974e6-f10a-4460-b3af-055e40bd37bb-kube-api-access-ppg4p\") pod \"model-serving-api-54d89bd5fc-gkbz9\" (UID: \"150974e6-f10a-4460-b3af-055e40bd37bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" Jul 22 02:22:01.226941 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.226904 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gvhln"] Jul 22 02:22:01.229684 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.229662 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.233273 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.233247 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 22 02:22:01.233414 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.233247 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 22 02:22:01.233638 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.233611 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 22 02:22:01.233805 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.233785 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 02:22:01.234008 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.233973 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wl94r\"" Jul 22 02:22:01.246381 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.246355 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gvhln"] Jul 22 02:22:01.316035 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.315993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-token\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.316240 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.316053 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8118dd7c-3b52-4a09-a5bb-5253064486be-local-certs\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.316240 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.316081 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.316240 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.316122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k28tc\" (UniqueName: \"kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-kube-api-access-k28tc\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.316240 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.316150 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-cacerts\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.316240 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.316221 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.316429 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.316287 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.416886 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.416847 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8118dd7c-3b52-4a09-a5bb-5253064486be-local-certs\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.416886 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.416889 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.417168 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.417048 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150974e6-f10a-4460-b3af-055e40bd37bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-gkbz9\" (UID: \"150974e6-f10a-4460-b3af-055e40bd37bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" Jul 22 02:22:01.417168 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.417099 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k28tc\" (UniqueName: \"kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-kube-api-access-k28tc\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.417168 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.417137 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-cacerts\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.417328 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.417191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.417328 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.417261 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.417328 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.417302 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-token\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.418286 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.418232 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.419815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.419708 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.419966 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.419942 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8118dd7c-3b52-4a09-a5bb-5253064486be-local-certs\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.420091 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.420067 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.420493 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.420467 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-cacerts\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.420593 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.420477 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/150974e6-f10a-4460-b3af-055e40bd37bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-gkbz9\" (UID: \"150974e6-f10a-4460-b3af-055e40bd37bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" Jul 22 02:22:01.425906 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.425874 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k28tc\" (UniqueName: \"kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-kube-api-access-k28tc\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.426291 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.426270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-token\") pod \"istiod-openshift-gateway-7574459656-gvhln\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.541632 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.541496 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:01.670440 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.670166 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" Jul 22 02:22:01.720957 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.720839 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gvhln"] Jul 22 02:22:01.729014 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:22:01.728567 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8118dd7c_3b52_4a09_a5bb_5253064486be.slice/crio-5d3138355fa66a70f519d1069db20c2d7c41c45e2f49ab30e614d380c00ec5eb WatchSource:0}: Error finding container 5d3138355fa66a70f519d1069db20c2d7c41c45e2f49ab30e614d380c00ec5eb: Status 404 returned error can't find the container with id 5d3138355fa66a70f519d1069db20c2d7c41c45e2f49ab30e614d380c00ec5eb Jul 22 02:22:01.754913 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.754836 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" event={"ID":"8118dd7c-3b52-4a09-a5bb-5253064486be","Type":"ContainerStarted","Data":"5d3138355fa66a70f519d1069db20c2d7c41c45e2f49ab30e614d380c00ec5eb"} Jul 22 02:22:01.757197 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.757167 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" event={"ID":"d06e2e9e-733e-4ed0-974f-63a06c7913ad","Type":"ContainerStarted","Data":"f12c5c3c02e6231731937c186a16558a7d129579703e8b11e752ecf5286cff1b"} Jul 22 02:22:01.842974 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:01.842944 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gkbz9"] Jul 22 02:22:01.846423 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:22:01.846385 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150974e6_f10a_4460_b3af_055e40bd37bb.slice/crio-df607b69612dc774a2f7cece4b050aeaf5d0e73bb7a1807eeeb8964016efc8ec WatchSource:0}: Error finding container df607b69612dc774a2f7cece4b050aeaf5d0e73bb7a1807eeeb8964016efc8ec: Status 404 returned error can't find the container with id df607b69612dc774a2f7cece4b050aeaf5d0e73bb7a1807eeeb8964016efc8ec Jul 22 02:22:02.763166 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:02.763106 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" event={"ID":"150974e6-f10a-4460-b3af-055e40bd37bb","Type":"ContainerStarted","Data":"df607b69612dc774a2f7cece4b050aeaf5d0e73bb7a1807eeeb8964016efc8ec"} Jul 22 02:22:05.764518 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:05.764471 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 22 02:22:05.764855 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:05.764565 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 22 02:22:05.781453 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:05.781423 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" event={"ID":"0de272f9-cd4e-44a2-8702-8b84cdca4ecd","Type":"ContainerStarted","Data":"1b45739313aa8a29b764e59c8aa5d0f0c8eca98e0fe0aa1e74f4d171f38f7085"} Jul 22 02:22:05.783547 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:05.783515 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" event={"ID":"d06e2e9e-733e-4ed0-974f-63a06c7913ad","Type":"ContainerStarted","Data":"3dc8cc83913c9b547e8d57cede2302d2ff56577ca57c5a771623edfcfa101b64"} Jul 22 02:22:05.783668 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:05.783611 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" Jul 22 02:22:05.801672 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:05.801488 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7756896c6-zbglf" podStartSLOduration=2.596867262 podStartE2EDuration="6.801469545s" totalImagesPullingTime="4.204602283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:22:05.79927539 +0000 UTC m=+349.305261843" watchObservedRunningTime="2026-07-22 02:22:05.801469545 +0000 UTC m=+349.307455999" Jul 22 02:22:05.818810 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:05.818754 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" podStartSLOduration=1.9864611220000001 podStartE2EDuration="6.818732103s" totalImagesPullingTime="4.832270981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:22:05.816678061 +0000 UTC m=+349.322664515" watchObservedRunningTime="2026-07-22 02:22:05.818732103 +0000 UTC m=+349.324718556" Jul 22 02:22:06.789934 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:06.789885 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" event={"ID":"150974e6-f10a-4460-b3af-055e40bd37bb","Type":"ContainerStarted","Data":"f14265f6935c3613c042cc7d28420cdd6828c4fbe6db8161df0dd119421b16e0"} Jul 22 02:22:06.790381 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:06.790018 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" Jul 22 02:22:06.791591 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:06.791564 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" event={"ID":"8118dd7c-3b52-4a09-a5bb-5253064486be","Type":"ContainerStarted","Data":"35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275"} Jul 22 02:22:06.791862 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:06.791842 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:06.793512 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:06.793494 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:06.829033 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:06.828954 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" podStartSLOduration=2.983220455 podStartE2EDuration="6.828937478s" totalImagesPullingTime="3.845717023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:22:06.827142368 +0000 UTC m=+350.333128820" watchObservedRunningTime="2026-07-22 02:22:06.828937478 +0000 UTC m=+350.334923929" Jul 22 02:22:06.885701 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:06.885649 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" podStartSLOduration=1.8548829260000002 podStartE2EDuration="5.885634737s" totalImagesPullingTime="4.030751811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:22:06.88376806 +0000 UTC m=+350.389754513" watchObservedRunningTime="2026-07-22 02:22:06.885634737 +0000 UTC m=+350.391621190" Jul 22 02:22:10.346923 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:10.346844 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r"] Jul 22 02:22:10.350171 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:10.350150 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" Jul 22 02:22:10.353362 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:10.353327 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 22 02:22:10.353541 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:10.353344 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jjpz7\"" Jul 22 02:22:10.367779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:10.367746 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r"] Jul 22 02:22:10.405555 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:10.405518 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f816e362-d4dc-4fb2-8163-a6f36e465187-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r8m5r\" (UID: \"f816e362-d4dc-4fb2-8163-a6f36e465187\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" Jul 22 02:22:10.405555 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:10.405555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swrbb\" (UniqueName: \"kubernetes.io/projected/f816e362-d4dc-4fb2-8163-a6f36e465187-kube-api-access-swrbb\") pod \"llmisvc-controller-manager-777c6bd7d5-r8m5r\" (UID: \"f816e362-d4dc-4fb2-8163-a6f36e465187\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" Jul 22 02:22:10.506202 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:10.506173 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f816e362-d4dc-4fb2-8163-a6f36e465187-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r8m5r\" (UID: \"f816e362-d4dc-4fb2-8163-a6f36e465187\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" Jul 22 02:22:10.506378 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:10.506210 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swrbb\" (UniqueName: \"kubernetes.io/projected/f816e362-d4dc-4fb2-8163-a6f36e465187-kube-api-access-swrbb\") pod \"llmisvc-controller-manager-777c6bd7d5-r8m5r\" (UID: \"f816e362-d4dc-4fb2-8163-a6f36e465187\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" Jul 22 02:22:10.506378 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:22:10.506360 2556 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 22 02:22:10.506510 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:22:10.506436 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f816e362-d4dc-4fb2-8163-a6f36e465187-cert podName:f816e362-d4dc-4fb2-8163-a6f36e465187 nodeName:}" failed. No retries permitted until 2026-07-22 02:22:11.006413786 +0000 UTC m=+354.512400233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f816e362-d4dc-4fb2-8163-a6f36e465187-cert") pod "llmisvc-controller-manager-777c6bd7d5-r8m5r" (UID: "f816e362-d4dc-4fb2-8163-a6f36e465187") : secret "llmisvc-webhook-server-cert" not found Jul 22 02:22:10.522263 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:10.522233 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swrbb\" (UniqueName: \"kubernetes.io/projected/f816e362-d4dc-4fb2-8163-a6f36e465187-kube-api-access-swrbb\") pod \"llmisvc-controller-manager-777c6bd7d5-r8m5r\" (UID: \"f816e362-d4dc-4fb2-8163-a6f36e465187\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" Jul 22 02:22:11.010364 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:11.010323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f816e362-d4dc-4fb2-8163-a6f36e465187-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r8m5r\" (UID: \"f816e362-d4dc-4fb2-8163-a6f36e465187\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" Jul 22 02:22:11.012747 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:11.012714 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f816e362-d4dc-4fb2-8163-a6f36e465187-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-r8m5r\" (UID: \"f816e362-d4dc-4fb2-8163-a6f36e465187\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" Jul 22 02:22:11.268700 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:11.268595 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" Jul 22 02:22:11.434037 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:11.434011 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r"] Jul 22 02:22:11.436738 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:22:11.436709 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf816e362_d4dc_4fb2_8163_a6f36e465187.slice/crio-1ecc3e6912e97eb590384469cee06bf663567752fa5faf1f5d34db148fa80bbf WatchSource:0}: Error finding container 1ecc3e6912e97eb590384469cee06bf663567752fa5faf1f5d34db148fa80bbf: Status 404 returned error can't find the container with id 1ecc3e6912e97eb590384469cee06bf663567752fa5faf1f5d34db148fa80bbf Jul 22 02:22:11.814642 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:11.814605 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" event={"ID":"f816e362-d4dc-4fb2-8163-a6f36e465187","Type":"ContainerStarted","Data":"1ecc3e6912e97eb590384469cee06bf663567752fa5faf1f5d34db148fa80bbf"} Jul 22 02:22:12.829692 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:12.829650 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gvhln"] Jul 22 02:22:12.830246 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:12.829919 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" podUID="8118dd7c-3b52-4a09-a5bb-5253064486be" containerName="discovery" containerID="cri-o://35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275" gracePeriod=30 Jul 22 02:22:13.156432 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.156404 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:13.235471 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.235435 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-dns-cert\") pod \"8118dd7c-3b52-4a09-a5bb-5253064486be\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " Jul 22 02:22:13.235645 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.235495 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k28tc\" (UniqueName: \"kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-kube-api-access-k28tc\") pod \"8118dd7c-3b52-4a09-a5bb-5253064486be\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " Jul 22 02:22:13.235645 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.235540 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-cacerts\") pod \"8118dd7c-3b52-4a09-a5bb-5253064486be\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " Jul 22 02:22:13.235645 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.235597 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-kubeconfig\") pod \"8118dd7c-3b52-4a09-a5bb-5253064486be\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " Jul 22 02:22:13.235645 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.235629 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-ca-configmap\") pod \"8118dd7c-3b52-4a09-a5bb-5253064486be\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " Jul 22 02:22:13.235855 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.235679 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-token\") pod \"8118dd7c-3b52-4a09-a5bb-5253064486be\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " Jul 22 02:22:13.235855 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.235727 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8118dd7c-3b52-4a09-a5bb-5253064486be-local-certs\") pod \"8118dd7c-3b52-4a09-a5bb-5253064486be\" (UID: \"8118dd7c-3b52-4a09-a5bb-5253064486be\") " Jul 22 02:22:13.236596 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.236391 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "8118dd7c-3b52-4a09-a5bb-5253064486be" (UID: "8118dd7c-3b52-4a09-a5bb-5253064486be"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 02:22:13.238410 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.238377 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8118dd7c-3b52-4a09-a5bb-5253064486be-local-certs" (OuterVolumeSpecName: "local-certs") pod "8118dd7c-3b52-4a09-a5bb-5253064486be" (UID: "8118dd7c-3b52-4a09-a5bb-5253064486be"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:22:13.238622 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.238593 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-token" (OuterVolumeSpecName: "istio-token") pod "8118dd7c-3b52-4a09-a5bb-5253064486be" (UID: "8118dd7c-3b52-4a09-a5bb-5253064486be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:22:13.238715 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.238663 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-cacerts" (OuterVolumeSpecName: "cacerts") pod "8118dd7c-3b52-4a09-a5bb-5253064486be" (UID: "8118dd7c-3b52-4a09-a5bb-5253064486be"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:22:13.238871 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.238842 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "8118dd7c-3b52-4a09-a5bb-5253064486be" (UID: "8118dd7c-3b52-4a09-a5bb-5253064486be"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:22:13.238871 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.238869 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "8118dd7c-3b52-4a09-a5bb-5253064486be" (UID: "8118dd7c-3b52-4a09-a5bb-5253064486be"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:22:13.239085 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.239046 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-kube-api-access-k28tc" (OuterVolumeSpecName: "kube-api-access-k28tc") pod "8118dd7c-3b52-4a09-a5bb-5253064486be" (UID: "8118dd7c-3b52-4a09-a5bb-5253064486be"). InnerVolumeSpecName "kube-api-access-k28tc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:22:13.336563 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.336525 2556 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8118dd7c-3b52-4a09-a5bb-5253064486be-local-certs\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:22:13.336563 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.336557 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-dns-cert\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:22:13.336563 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.336567 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k28tc\" (UniqueName: \"kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-kube-api-access-k28tc\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:22:13.336809 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.336578 2556 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-cacerts\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:22:13.336809 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.336587 2556 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-kubeconfig\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:22:13.336809 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.336598 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-csr-ca-configmap\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:22:13.336809 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.336606 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8118dd7c-3b52-4a09-a5bb-5253064486be-istio-token\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:22:13.828561 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.828527 2556 generic.go:356] "Generic (PLEG): container finished" podID="8118dd7c-3b52-4a09-a5bb-5253064486be" containerID="35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275" exitCode=0 Jul 22 02:22:13.828747 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.828579 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" Jul 22 02:22:13.828747 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.828600 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" event={"ID":"8118dd7c-3b52-4a09-a5bb-5253064486be","Type":"ContainerDied","Data":"35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275"} Jul 22 02:22:13.828747 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.828669 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-gvhln" event={"ID":"8118dd7c-3b52-4a09-a5bb-5253064486be","Type":"ContainerDied","Data":"5d3138355fa66a70f519d1069db20c2d7c41c45e2f49ab30e614d380c00ec5eb"} Jul 22 02:22:13.828747 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.828695 2556 scope.go:117] "RemoveContainer" containerID="35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275" Jul 22 02:22:13.866605 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.866573 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gvhln"] Jul 22 02:22:13.870036 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:13.870011 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-gvhln"] Jul 22 02:22:14.311514 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:14.311347 2556 scope.go:117] "RemoveContainer" containerID="35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275" Jul 22 02:22:14.311705 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:22:14.311682 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275\": container with ID starting with 35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275 not found: ID does not exist" containerID="35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275" Jul 22 02:22:14.311754 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:14.311715 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275"} err="failed to get container status \"35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275\": rpc error: code = NotFound desc = could not find container \"35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275\": container with ID starting with 35da1e6f44920f53f7937f2a6a1a74a943f8577ab3a3667a38b36be88d7c4275 not found: ID does not exist" Jul 22 02:22:14.835610 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:14.835577 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" event={"ID":"f816e362-d4dc-4fb2-8163-a6f36e465187","Type":"ContainerStarted","Data":"83c51cbafaa89e6375d2de1d86450f719fe794c48d9ea40049217fe69693a8fc"} Jul 22 02:22:14.835793 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:14.835709 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" Jul 22 02:22:14.851765 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:14.851715 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" podStartSLOduration=1.930487268 podStartE2EDuration="4.851698125s" totalImagesPullingTime="2.921210857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:22:14.85074146 +0000 UTC m=+358.356727910" watchObservedRunningTime="2026-07-22 02:22:14.851698125 +0000 UTC m=+358.357684609" Jul 22 02:22:15.024815 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:15.024779 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8118dd7c-3b52-4a09-a5bb-5253064486be" path="/var/lib/kubelet/pods/8118dd7c-3b52-4a09-a5bb-5253064486be/volumes" Jul 22 02:22:16.793687 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:16.793654 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hc7c4" Jul 22 02:22:17.800510 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:17.800481 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gkbz9" Jul 22 02:22:45.842527 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:22:45.842493 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-r8m5r" Jul 22 02:23:00.382814 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.382783 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9hms"] Jul 22 02:23:00.383231 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.383121 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8118dd7c-3b52-4a09-a5bb-5253064486be" containerName="discovery" Jul 22 02:23:00.383231 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.383133 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8118dd7c-3b52-4a09-a5bb-5253064486be" containerName="discovery" Jul 22 02:23:00.383231 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.383183 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8118dd7c-3b52-4a09-a5bb-5253064486be" containerName="discovery" Jul 22 02:23:00.389393 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.389376 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p9hms" Jul 22 02:23:00.392439 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.392355 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 22 02:23:00.392582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.392483 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6xhxn\"" Jul 22 02:23:00.392648 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.392361 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 22 02:23:00.398960 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.398931 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9hms"] Jul 22 02:23:00.440582 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.440555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp67p\" (UniqueName: \"kubernetes.io/projected/b6b2ed51-0403-4f35-8a78-c468169f018c-kube-api-access-gp67p\") pod \"kuadrant-operator-catalog-p9hms\" (UID: \"b6b2ed51-0403-4f35-8a78-c468169f018c\") " pod="kuadrant-system/kuadrant-operator-catalog-p9hms" Jul 22 02:23:00.541391 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.541352 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp67p\" (UniqueName: \"kubernetes.io/projected/b6b2ed51-0403-4f35-8a78-c468169f018c-kube-api-access-gp67p\") pod \"kuadrant-operator-catalog-p9hms\" (UID: \"b6b2ed51-0403-4f35-8a78-c468169f018c\") " pod="kuadrant-system/kuadrant-operator-catalog-p9hms" Jul 22 02:23:00.559190 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.556406 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp67p\" (UniqueName: \"kubernetes.io/projected/b6b2ed51-0403-4f35-8a78-c468169f018c-kube-api-access-gp67p\") pod \"kuadrant-operator-catalog-p9hms\" (UID: \"b6b2ed51-0403-4f35-8a78-c468169f018c\") " pod="kuadrant-system/kuadrant-operator-catalog-p9hms" Jul 22 02:23:00.701573 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.701545 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p9hms" Jul 22 02:23:00.749147 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.749108 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9hms"] Jul 22 02:23:00.834525 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.834496 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9hms"] Jul 22 02:23:00.837172 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:23:00.837148 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b2ed51_0403_4f35_8a78_c468169f018c.slice/crio-7bd2ac5f00efb861547f82da75cdabdefaea30c2a763db53c8cb219f26083aa4 WatchSource:0}: Error finding container 7bd2ac5f00efb861547f82da75cdabdefaea30c2a763db53c8cb219f26083aa4: Status 404 returned error can't find the container with id 7bd2ac5f00efb861547f82da75cdabdefaea30c2a763db53c8cb219f26083aa4 Jul 22 02:23:00.958915 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.958834 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mmzh"] Jul 22 02:23:00.963401 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.963383 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" Jul 22 02:23:00.970330 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:00.970282 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mmzh"] Jul 22 02:23:01.044804 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:01.044769 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67lqq\" (UniqueName: \"kubernetes.io/projected/f39ab534-7fe4-4502-8dd3-11be6a89149e-kube-api-access-67lqq\") pod \"kuadrant-operator-catalog-5mmzh\" (UID: \"f39ab534-7fe4-4502-8dd3-11be6a89149e\") " pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" Jul 22 02:23:01.045208 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:01.045174 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p9hms" event={"ID":"b6b2ed51-0403-4f35-8a78-c468169f018c","Type":"ContainerStarted","Data":"7bd2ac5f00efb861547f82da75cdabdefaea30c2a763db53c8cb219f26083aa4"} Jul 22 02:23:01.145937 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:01.145896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67lqq\" (UniqueName: \"kubernetes.io/projected/f39ab534-7fe4-4502-8dd3-11be6a89149e-kube-api-access-67lqq\") pod \"kuadrant-operator-catalog-5mmzh\" (UID: \"f39ab534-7fe4-4502-8dd3-11be6a89149e\") " pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" Jul 22 02:23:01.156109 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:01.156077 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67lqq\" (UniqueName: \"kubernetes.io/projected/f39ab534-7fe4-4502-8dd3-11be6a89149e-kube-api-access-67lqq\") pod \"kuadrant-operator-catalog-5mmzh\" (UID: \"f39ab534-7fe4-4502-8dd3-11be6a89149e\") " pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" Jul 22 02:23:01.273530 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:01.273445 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" Jul 22 02:23:01.418352 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:01.418328 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mmzh"] Jul 22 02:23:01.419877 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:23:01.419845 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39ab534_7fe4_4502_8dd3_11be6a89149e.slice/crio-4088988bf000b7601b176d0450a294ad3aad0cce23ec7f26952877b3020418ce WatchSource:0}: Error finding container 4088988bf000b7601b176d0450a294ad3aad0cce23ec7f26952877b3020418ce: Status 404 returned error can't find the container with id 4088988bf000b7601b176d0450a294ad3aad0cce23ec7f26952877b3020418ce Jul 22 02:23:02.055807 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:02.055770 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" event={"ID":"f39ab534-7fe4-4502-8dd3-11be6a89149e","Type":"ContainerStarted","Data":"4088988bf000b7601b176d0450a294ad3aad0cce23ec7f26952877b3020418ce"} Jul 22 02:23:04.067228 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:04.067192 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" event={"ID":"f39ab534-7fe4-4502-8dd3-11be6a89149e","Type":"ContainerStarted","Data":"a35cea4c366a36fb712a69045a7b1b3b333e2a189a905ccfb4f5852981863246"} Jul 22 02:23:04.068562 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:04.068528 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p9hms" event={"ID":"b6b2ed51-0403-4f35-8a78-c468169f018c","Type":"ContainerStarted","Data":"fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79"} Jul 22 02:23:04.068684 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:04.068557 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-p9hms" podUID="b6b2ed51-0403-4f35-8a78-c468169f018c" containerName="registry-server" containerID="cri-o://fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79" gracePeriod=2 Jul 22 02:23:04.083556 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:04.083511 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" podStartSLOduration=2.510721244 podStartE2EDuration="4.083494632s" totalImagesPullingTime="1.572773388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:23:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:23:04.082439111 +0000 UTC m=+407.588425564" watchObservedRunningTime="2026-07-22 02:23:04.083494632 +0000 UTC m=+407.589481084" Jul 22 02:23:04.097269 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:04.097206 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-p9hms" podStartSLOduration=1.9422447059999999 podStartE2EDuration="4.09718437s" totalImagesPullingTime="2.154939664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:23:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:23:04.097035393 +0000 UTC m=+407.603021846" watchObservedRunningTime="2026-07-22 02:23:04.09718437 +0000 UTC m=+407.603170822" Jul 22 02:23:04.312783 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:04.312755 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p9hms" Jul 22 02:23:04.376058 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:04.375943 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp67p\" (UniqueName: \"kubernetes.io/projected/b6b2ed51-0403-4f35-8a78-c468169f018c-kube-api-access-gp67p\") pod \"b6b2ed51-0403-4f35-8a78-c468169f018c\" (UID: \"b6b2ed51-0403-4f35-8a78-c468169f018c\") " Jul 22 02:23:04.378141 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:04.378117 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b2ed51-0403-4f35-8a78-c468169f018c-kube-api-access-gp67p" (OuterVolumeSpecName: "kube-api-access-gp67p") pod "b6b2ed51-0403-4f35-8a78-c468169f018c" (UID: "b6b2ed51-0403-4f35-8a78-c468169f018c"). InnerVolumeSpecName "kube-api-access-gp67p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:23:04.477031 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:04.476967 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp67p\" (UniqueName: \"kubernetes.io/projected/b6b2ed51-0403-4f35-8a78-c468169f018c-kube-api-access-gp67p\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:23:05.074030 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:05.073997 2556 generic.go:356] "Generic (PLEG): container finished" podID="b6b2ed51-0403-4f35-8a78-c468169f018c" containerID="fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79" exitCode=0 Jul 22 02:23:05.074438 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:05.074064 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p9hms" Jul 22 02:23:05.074438 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:05.074077 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p9hms" event={"ID":"b6b2ed51-0403-4f35-8a78-c468169f018c","Type":"ContainerDied","Data":"fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79"} Jul 22 02:23:05.074438 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:05.074127 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p9hms" event={"ID":"b6b2ed51-0403-4f35-8a78-c468169f018c","Type":"ContainerDied","Data":"7bd2ac5f00efb861547f82da75cdabdefaea30c2a763db53c8cb219f26083aa4"} Jul 22 02:23:05.074438 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:05.074148 2556 scope.go:117] "RemoveContainer" containerID="fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79" Jul 22 02:23:05.083283 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:05.083261 2556 scope.go:117] "RemoveContainer" containerID="fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79" Jul 22 02:23:05.083607 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:23:05.083586 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79\": container with ID starting with fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79 not found: ID does not exist" containerID="fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79" Jul 22 02:23:05.083661 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:05.083615 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79"} err="failed to get container status \"fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79\": rpc error: code = NotFound desc = could not find container \"fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79\": container with ID starting with fc570366ec70a3cf78cf4723c89e7425f155efb83beb3bbbc3cd1375d5688d79 not found: ID does not exist" Jul 22 02:23:05.089905 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:05.089879 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9hms"] Jul 22 02:23:05.093639 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:05.093615 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9hms"] Jul 22 02:23:07.025419 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:07.025385 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6b2ed51-0403-4f35-8a78-c468169f018c" path="/var/lib/kubelet/pods/b6b2ed51-0403-4f35-8a78-c468169f018c/volumes" Jul 22 02:23:11.274079 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:11.274042 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" Jul 22 02:23:11.274503 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:11.274110 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" Jul 22 02:23:11.296662 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:11.296638 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" Jul 22 02:23:12.128376 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:12.128347 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5mmzh" Jul 22 02:23:45.325105 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.325021 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl"] Jul 22 02:23:45.325535 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.325365 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b2ed51-0403-4f35-8a78-c468169f018c" containerName="registry-server" Jul 22 02:23:45.325535 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.325377 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b2ed51-0403-4f35-8a78-c468169f018c" containerName="registry-server" Jul 22 02:23:45.325535 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.325436 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6b2ed51-0403-4f35-8a78-c468169f018c" containerName="registry-server" Jul 22 02:23:45.327441 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.327424 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:23:45.330114 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.330093 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lhtht\"" Jul 22 02:23:45.336118 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.336095 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl"] Jul 22 02:23:45.420619 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.420583 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsmcx\" (UniqueName: \"kubernetes.io/projected/3c2ee724-639e-4000-8292-ff42cf3e11bb-kube-api-access-jsmcx\") pod \"limitador-operator-controller-manager-859d7b78bd-pdvdl\" (UID: \"3c2ee724-639e-4000-8292-ff42cf3e11bb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:23:45.521469 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.521432 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmcx\" (UniqueName: \"kubernetes.io/projected/3c2ee724-639e-4000-8292-ff42cf3e11bb-kube-api-access-jsmcx\") pod \"limitador-operator-controller-manager-859d7b78bd-pdvdl\" (UID: \"3c2ee724-639e-4000-8292-ff42cf3e11bb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:23:45.530510 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.530478 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsmcx\" (UniqueName: \"kubernetes.io/projected/3c2ee724-639e-4000-8292-ff42cf3e11bb-kube-api-access-jsmcx\") pod \"limitador-operator-controller-manager-859d7b78bd-pdvdl\" (UID: \"3c2ee724-639e-4000-8292-ff42cf3e11bb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:23:45.638388 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.638301 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:23:45.777758 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:45.777733 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl"] Jul 22 02:23:45.780234 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:23:45.780196 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2ee724_639e_4000_8292_ff42cf3e11bb.slice/crio-d13e50de02e1f3bdb5503b76233e2bca978b3321fe6e73d99008f995fafdd18e WatchSource:0}: Error finding container d13e50de02e1f3bdb5503b76233e2bca978b3321fe6e73d99008f995fafdd18e: Status 404 returned error can't find the container with id d13e50de02e1f3bdb5503b76233e2bca978b3321fe6e73d99008f995fafdd18e Jul 22 02:23:46.264085 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:46.264043 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" event={"ID":"3c2ee724-639e-4000-8292-ff42cf3e11bb","Type":"ContainerStarted","Data":"d13e50de02e1f3bdb5503b76233e2bca978b3321fe6e73d99008f995fafdd18e"} Jul 22 02:23:48.274339 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:48.274305 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" event={"ID":"3c2ee724-639e-4000-8292-ff42cf3e11bb","Type":"ContainerStarted","Data":"94d0f2d0b816bc13f5f4b654ea374f526fb84d7b88524d9e063525032279f660"} Jul 22 02:23:48.274918 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:48.274447 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:23:48.292659 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:48.292606 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" podStartSLOduration=1.487077087 podStartE2EDuration="3.292590898s" totalImagesPullingTime="1.805513811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:23:48.290686622 +0000 UTC m=+451.796673074" watchObservedRunningTime="2026-07-22 02:23:48.292590898 +0000 UTC m=+451.798577349" Jul 22 02:23:50.542664 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:50.542627 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5"] Jul 22 02:23:50.545948 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:50.545922 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:23:50.548736 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:50.548714 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hcqmt\"" Jul 22 02:23:50.563905 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:50.563878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6nss5\" (UID: \"9ace24ad-afd5-4bff-9dbe-ccc5261d5338\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:23:50.564194 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:50.564169 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwthv\" (UniqueName: \"kubernetes.io/projected/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-kube-api-access-pwthv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6nss5\" (UID: \"9ace24ad-afd5-4bff-9dbe-ccc5261d5338\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:23:50.566035 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:50.566001 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5"] Jul 22 02:23:50.665312 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:50.665271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6nss5\" (UID: \"9ace24ad-afd5-4bff-9dbe-ccc5261d5338\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:23:50.665493 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:50.665324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwthv\" (UniqueName: \"kubernetes.io/projected/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-kube-api-access-pwthv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6nss5\" (UID: \"9ace24ad-afd5-4bff-9dbe-ccc5261d5338\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:23:50.665730 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:50.665708 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6nss5\" (UID: \"9ace24ad-afd5-4bff-9dbe-ccc5261d5338\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:23:50.675212 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:50.675185 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwthv\" (UniqueName: \"kubernetes.io/projected/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-kube-api-access-pwthv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6nss5\" (UID: \"9ace24ad-afd5-4bff-9dbe-ccc5261d5338\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:23:50.856639 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:50.856551 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:23:51.016237 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:51.016209 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5"] Jul 22 02:23:51.018793 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:23:51.018764 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ace24ad_afd5_4bff_9dbe_ccc5261d5338.slice/crio-48a29ea14289cf391b13b257c0f45e256ccbb281edd97aa926abfa0a88520790 WatchSource:0}: Error finding container 48a29ea14289cf391b13b257c0f45e256ccbb281edd97aa926abfa0a88520790: Status 404 returned error can't find the container with id 48a29ea14289cf391b13b257c0f45e256ccbb281edd97aa926abfa0a88520790 Jul 22 02:23:51.290312 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:51.290274 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" event={"ID":"9ace24ad-afd5-4bff-9dbe-ccc5261d5338","Type":"ContainerStarted","Data":"48a29ea14289cf391b13b257c0f45e256ccbb281edd97aa926abfa0a88520790"} Jul 22 02:23:53.117651 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:53.117619 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q"] Jul 22 02:23:53.120949 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:53.120930 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q" Jul 22 02:23:53.128007 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:53.127954 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tb6j6\"" Jul 22 02:23:53.133654 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:53.133623 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q"] Jul 22 02:23:53.186745 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:53.186710 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdqmh\" (UniqueName: \"kubernetes.io/projected/ec49e1a5-b874-4113-bb54-2404c414db55-kube-api-access-rdqmh\") pod \"authorino-operator-75cc8d5cb7-xgq9q\" (UID: \"ec49e1a5-b874-4113-bb54-2404c414db55\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q" Jul 22 02:23:53.287714 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:53.287655 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdqmh\" (UniqueName: \"kubernetes.io/projected/ec49e1a5-b874-4113-bb54-2404c414db55-kube-api-access-rdqmh\") pod \"authorino-operator-75cc8d5cb7-xgq9q\" (UID: \"ec49e1a5-b874-4113-bb54-2404c414db55\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q" Jul 22 02:23:53.299866 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:53.299829 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdqmh\" (UniqueName: \"kubernetes.io/projected/ec49e1a5-b874-4113-bb54-2404c414db55-kube-api-access-rdqmh\") pod \"authorino-operator-75cc8d5cb7-xgq9q\" (UID: \"ec49e1a5-b874-4113-bb54-2404c414db55\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q" Jul 22 02:23:53.436235 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:53.436154 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q" Jul 22 02:23:53.599114 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:53.599079 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q"] Jul 22 02:23:53.604269 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:23:53.604227 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec49e1a5_b874_4113_bb54_2404c414db55.slice/crio-b763959ebeeb65a8c1558c2fbbacbcdfef1b71f487e73cfff41b676177eaf388 WatchSource:0}: Error finding container b763959ebeeb65a8c1558c2fbbacbcdfef1b71f487e73cfff41b676177eaf388: Status 404 returned error can't find the container with id b763959ebeeb65a8c1558c2fbbacbcdfef1b71f487e73cfff41b676177eaf388 Jul 22 02:23:54.306630 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:54.306590 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q" event={"ID":"ec49e1a5-b874-4113-bb54-2404c414db55","Type":"ContainerStarted","Data":"b763959ebeeb65a8c1558c2fbbacbcdfef1b71f487e73cfff41b676177eaf388"} Jul 22 02:23:57.325397 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:57.325351 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q" event={"ID":"ec49e1a5-b874-4113-bb54-2404c414db55","Type":"ContainerStarted","Data":"4d01a4dde4c4018823db171dc327eaa6524c40f4ccdb31bd650de636e49777e9"} Jul 22 02:23:57.325849 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:57.325421 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q" Jul 22 02:23:57.326958 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:57.326930 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" event={"ID":"9ace24ad-afd5-4bff-9dbe-ccc5261d5338","Type":"ContainerStarted","Data":"700a797f1814dc35c930e2c4070477eabe4b9e19bbc2a51afcb588c41fcd65dc"} Jul 22 02:23:57.327128 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:57.327113 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:23:57.342364 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:57.342314 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q" podStartSLOduration=0.768162951 podStartE2EDuration="4.34229812s" totalImagesPullingTime="3.574135169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:23:57.340695841 +0000 UTC m=+460.846682295" watchObservedRunningTime="2026-07-22 02:23:57.34229812 +0000 UTC m=+460.848284572" Jul 22 02:23:57.360758 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:57.360709 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" podStartSLOduration=1.190567896 podStartE2EDuration="7.360690264s" totalImagesPullingTime="6.170122368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:23:57.360034948 +0000 UTC m=+460.866021401" watchObservedRunningTime="2026-07-22 02:23:57.360690264 +0000 UTC m=+460.866676715" Jul 22 02:23:59.280642 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:23:59.280612 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:24:08.336731 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:08.336696 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:24:08.337463 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:08.337439 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgq9q" Jul 22 02:24:10.232253 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.232215 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5"] Jul 22 02:24:10.232678 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.232410 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" podUID="9ace24ad-afd5-4bff-9dbe-ccc5261d5338" containerName="manager" containerID="cri-o://700a797f1814dc35c930e2c4070477eabe4b9e19bbc2a51afcb588c41fcd65dc" gracePeriod=2 Jul 22 02:24:10.248619 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.248587 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5"] Jul 22 02:24:10.268698 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.268584 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl"] Jul 22 02:24:10.269241 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.269189 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" podUID="3c2ee724-639e-4000-8292-ff42cf3e11bb" containerName="manager" containerID="cri-o://94d0f2d0b816bc13f5f4b654ea374f526fb84d7b88524d9e063525032279f660" gracePeriod=2 Jul 22 02:24:10.275991 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.275946 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9"] Jul 22 02:24:10.276459 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.276399 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ace24ad-afd5-4bff-9dbe-ccc5261d5338" containerName="manager" Jul 22 02:24:10.276663 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.276648 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ace24ad-afd5-4bff-9dbe-ccc5261d5338" containerName="manager" Jul 22 02:24:10.276887 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.276873 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ace24ad-afd5-4bff-9dbe-ccc5261d5338" containerName="manager" Jul 22 02:24:10.280139 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.280113 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:10.284976 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.284946 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl"] Jul 22 02:24:10.285706 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:24:10.285666 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3c2ee724-639e-4000-8292-ff42cf3e11bb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-pdvdl\": pods \"limitador-operator-controller-manager-859d7b78bd-pdvdl\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:24:10.287750 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:24:10.287713 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6nss5\" is forbidden: User \"system:node:ip-10-0-135-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-238.ec2.internal' and this object" podUID="9ace24ad-afd5-4bff-9dbe-ccc5261d5338" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:24:10.290604 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:24:10.290559 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pdvdl\" is forbidden: User \"system:node:ip-10-0-135-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-238.ec2.internal' and this object" podUID="3c2ee724-639e-4000-8292-ff42cf3e11bb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:24:10.292098 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.292074 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv"] Jul 22 02:24:10.292460 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.292443 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2ee724-639e-4000-8292-ff42cf3e11bb" containerName="manager" Jul 22 02:24:10.292525 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.292463 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2ee724-639e-4000-8292-ff42cf3e11bb" containerName="manager" Jul 22 02:24:10.292575 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.292561 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2ee724-639e-4000-8292-ff42cf3e11bb" containerName="manager" Jul 22 02:24:10.292878 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:24:10.292837 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6nss5\" is forbidden: User \"system:node:ip-10-0-135-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-238.ec2.internal' and this object" podUID="9ace24ad-afd5-4bff-9dbe-ccc5261d5338" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:24:10.295814 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.295793 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv" Jul 22 02:24:10.309009 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.298384 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9"] Jul 22 02:24:10.330257 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.328466 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv"] Jul 22 02:24:10.331415 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:24:10.331372 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pdvdl\" is forbidden: User \"system:node:ip-10-0-135-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-238.ec2.internal' and this object" podUID="3c2ee724-639e-4000-8292-ff42cf3e11bb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:24:10.333664 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:24:10.333636 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6nss5\" is forbidden: User \"system:node:ip-10-0-135-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-238.ec2.internal' and this object" podUID="9ace24ad-afd5-4bff-9dbe-ccc5261d5338" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:24:10.342922 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.342882 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf9t9\" (UID: \"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:10.343078 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.343052 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w4jp\" (UniqueName: \"kubernetes.io/projected/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-kube-api-access-9w4jp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf9t9\" (UID: \"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:10.395925 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.395892 2556 generic.go:356] "Generic (PLEG): container finished" podID="9ace24ad-afd5-4bff-9dbe-ccc5261d5338" containerID="700a797f1814dc35c930e2c4070477eabe4b9e19bbc2a51afcb588c41fcd65dc" exitCode=0 Jul 22 02:24:10.398030 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.398002 2556 generic.go:356] "Generic (PLEG): container finished" podID="3c2ee724-639e-4000-8292-ff42cf3e11bb" containerID="94d0f2d0b816bc13f5f4b654ea374f526fb84d7b88524d9e063525032279f660" exitCode=0 Jul 22 02:24:10.443856 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.443823 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w4jp\" (UniqueName: \"kubernetes.io/projected/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-kube-api-access-9w4jp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf9t9\" (UID: \"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:10.443973 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.443896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf9t9\" (UID: \"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:10.444106 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.443966 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88fj5\" (UniqueName: \"kubernetes.io/projected/ed185d0b-ff2f-4301-9a75-1b0e87129f95-kube-api-access-88fj5\") pod \"limitador-operator-controller-manager-859d7b78bd-qv8sv\" (UID: \"ed185d0b-ff2f-4301-9a75-1b0e87129f95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv" Jul 22 02:24:10.444495 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.444470 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf9t9\" (UID: \"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:10.453446 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.453423 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w4jp\" (UniqueName: \"kubernetes.io/projected/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-kube-api-access-9w4jp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf9t9\" (UID: \"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:10.517615 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.517583 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:24:10.520118 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:24:10.520085 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pdvdl\" is forbidden: User \"system:node:ip-10-0-135-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-238.ec2.internal' and this object" podUID="3c2ee724-639e-4000-8292-ff42cf3e11bb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:24:10.522838 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:24:10.522806 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6nss5\" is forbidden: User \"system:node:ip-10-0-135-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-238.ec2.internal' and this object" podUID="9ace24ad-afd5-4bff-9dbe-ccc5261d5338" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:24:10.533828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.533803 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:24:10.536213 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:24:10.536168 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pdvdl\" is forbidden: User \"system:node:ip-10-0-135-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-238.ec2.internal' and this object" podUID="3c2ee724-639e-4000-8292-ff42cf3e11bb" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:24:10.538458 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:24:10.538433 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6nss5\" is forbidden: User \"system:node:ip-10-0-135-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-238.ec2.internal' and this object" podUID="9ace24ad-afd5-4bff-9dbe-ccc5261d5338" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:24:10.545019 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.544965 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88fj5\" (UniqueName: \"kubernetes.io/projected/ed185d0b-ff2f-4301-9a75-1b0e87129f95-kube-api-access-88fj5\") pod \"limitador-operator-controller-manager-859d7b78bd-qv8sv\" (UID: \"ed185d0b-ff2f-4301-9a75-1b0e87129f95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv" Jul 22 02:24:10.564678 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.564653 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88fj5\" (UniqueName: \"kubernetes.io/projected/ed185d0b-ff2f-4301-9a75-1b0e87129f95-kube-api-access-88fj5\") pod \"limitador-operator-controller-manager-859d7b78bd-qv8sv\" (UID: \"ed185d0b-ff2f-4301-9a75-1b0e87129f95\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv" Jul 22 02:24:10.645666 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.645628 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwthv\" (UniqueName: \"kubernetes.io/projected/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-kube-api-access-pwthv\") pod \"9ace24ad-afd5-4bff-9dbe-ccc5261d5338\" (UID: \"9ace24ad-afd5-4bff-9dbe-ccc5261d5338\") " Jul 22 02:24:10.645827 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.645820 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsmcx\" (UniqueName: \"kubernetes.io/projected/3c2ee724-639e-4000-8292-ff42cf3e11bb-kube-api-access-jsmcx\") pod \"3c2ee724-639e-4000-8292-ff42cf3e11bb\" (UID: \"3c2ee724-639e-4000-8292-ff42cf3e11bb\") " Jul 22 02:24:10.645899 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.645855 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-extensions-socket-volume\") pod \"9ace24ad-afd5-4bff-9dbe-ccc5261d5338\" (UID: \"9ace24ad-afd5-4bff-9dbe-ccc5261d5338\") " Jul 22 02:24:10.646403 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.646376 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9ace24ad-afd5-4bff-9dbe-ccc5261d5338" (UID: "9ace24ad-afd5-4bff-9dbe-ccc5261d5338"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:10.647729 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.647697 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-kube-api-access-pwthv" (OuterVolumeSpecName: "kube-api-access-pwthv") pod "9ace24ad-afd5-4bff-9dbe-ccc5261d5338" (UID: "9ace24ad-afd5-4bff-9dbe-ccc5261d5338"). InnerVolumeSpecName "kube-api-access-pwthv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:24:10.647831 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.647766 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2ee724-639e-4000-8292-ff42cf3e11bb-kube-api-access-jsmcx" (OuterVolumeSpecName: "kube-api-access-jsmcx") pod "3c2ee724-639e-4000-8292-ff42cf3e11bb" (UID: "3c2ee724-639e-4000-8292-ff42cf3e11bb"). InnerVolumeSpecName "kube-api-access-jsmcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:24:10.696115 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.696076 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:10.705160 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.705134 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv" Jul 22 02:24:10.747501 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.747416 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsmcx\" (UniqueName: \"kubernetes.io/projected/3c2ee724-639e-4000-8292-ff42cf3e11bb-kube-api-access-jsmcx\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:24:10.747501 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.747455 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-extensions-socket-volume\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:24:10.747501 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.747470 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwthv\" (UniqueName: \"kubernetes.io/projected/9ace24ad-afd5-4bff-9dbe-ccc5261d5338-kube-api-access-pwthv\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:24:10.848228 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.848185 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9"] Jul 22 02:24:10.851586 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:24:10.851560 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d217ae_ba0d_4438_b2a4_7fcfb7aafbd8.slice/crio-fad82620391845118f16cf22a1db2d263b3ca3bcc651c20843fc5d89a75b509f WatchSource:0}: Error finding container fad82620391845118f16cf22a1db2d263b3ca3bcc651c20843fc5d89a75b509f: Status 404 returned error can't find the container with id fad82620391845118f16cf22a1db2d263b3ca3bcc651c20843fc5d89a75b509f Jul 22 02:24:10.877214 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:10.877112 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv"] Jul 22 02:24:10.879923 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:24:10.879900 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded185d0b_ff2f_4301_9a75_1b0e87129f95.slice/crio-8f695cad4fff478efedc82a38a488bd4bbb9710ba90fad2ba73b32b2bf3eb66b WatchSource:0}: Error finding container 8f695cad4fff478efedc82a38a488bd4bbb9710ba90fad2ba73b32b2bf3eb66b: Status 404 returned error can't find the container with id 8f695cad4fff478efedc82a38a488bd4bbb9710ba90fad2ba73b32b2bf3eb66b Jul 22 02:24:11.025334 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.025251 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c2ee724-639e-4000-8292-ff42cf3e11bb" path="/var/lib/kubelet/pods/3c2ee724-639e-4000-8292-ff42cf3e11bb/volumes" Jul 22 02:24:11.025605 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.025593 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ace24ad-afd5-4bff-9dbe-ccc5261d5338" path="/var/lib/kubelet/pods/9ace24ad-afd5-4bff-9dbe-ccc5261d5338/volumes" Jul 22 02:24:11.404804 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.404706 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv" event={"ID":"ed185d0b-ff2f-4301-9a75-1b0e87129f95","Type":"ContainerStarted","Data":"e99e2ddb6be7f03b8fb9b6b527687d2ad03c6d8c9273c6ef197711b9ffe1b91d"} Jul 22 02:24:11.404804 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.404757 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv" event={"ID":"ed185d0b-ff2f-4301-9a75-1b0e87129f95","Type":"ContainerStarted","Data":"8f695cad4fff478efedc82a38a488bd4bbb9710ba90fad2ba73b32b2bf3eb66b"} Jul 22 02:24:11.404804 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.404795 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv" Jul 22 02:24:11.406496 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.406474 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" event={"ID":"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8","Type":"ContainerStarted","Data":"a9c89381febf7613bdae2d811b6f494a7ae3566f311b105835b0a4046a2db6de"} Jul 22 02:24:11.406608 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.406512 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" event={"ID":"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8","Type":"ContainerStarted","Data":"fad82620391845118f16cf22a1db2d263b3ca3bcc651c20843fc5d89a75b509f"} Jul 22 02:24:11.406608 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.406559 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:11.407794 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.407778 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pdvdl" Jul 22 02:24:11.407903 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.407828 2556 scope.go:117] "RemoveContainer" containerID="94d0f2d0b816bc13f5f4b654ea374f526fb84d7b88524d9e063525032279f660" Jul 22 02:24:11.409521 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.409504 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6nss5" Jul 22 02:24:11.417198 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.417163 2556 scope.go:117] "RemoveContainer" containerID="700a797f1814dc35c930e2c4070477eabe4b9e19bbc2a51afcb588c41fcd65dc" Jul 22 02:24:11.422792 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.422749 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv" podStartSLOduration=1.422734042 podStartE2EDuration="1.422734042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:24:11.42220595 +0000 UTC m=+474.928192407" watchObservedRunningTime="2026-07-22 02:24:11.422734042 +0000 UTC m=+474.928720493" Jul 22 02:24:11.442032 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:11.441946 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" podStartSLOduration=1.441930423 podStartE2EDuration="1.441930423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:24:11.440392899 +0000 UTC m=+474.946379389" watchObservedRunningTime="2026-07-22 02:24:11.441930423 +0000 UTC m=+474.947916875" Jul 22 02:24:22.421312 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:22.421274 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qv8sv" Jul 22 02:24:22.421725 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:22.421352 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:39.398039 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.397955 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9"] Jul 22 02:24:39.398632 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.398231 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" podUID="f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8" containerName="manager" containerID="cri-o://a9c89381febf7613bdae2d811b6f494a7ae3566f311b105835b0a4046a2db6de" gracePeriod=10 Jul 22 02:24:39.549121 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.549086 2556 generic.go:356] "Generic (PLEG): container finished" podID="f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8" containerID="a9c89381febf7613bdae2d811b6f494a7ae3566f311b105835b0a4046a2db6de" exitCode=0 Jul 22 02:24:39.549294 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.549148 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" event={"ID":"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8","Type":"ContainerDied","Data":"a9c89381febf7613bdae2d811b6f494a7ae3566f311b105835b0a4046a2db6de"} Jul 22 02:24:39.650369 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.650299 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:39.684239 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.684203 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn"] Jul 22 02:24:39.684548 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.684537 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8" containerName="manager" Jul 22 02:24:39.684591 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.684550 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8" containerName="manager" Jul 22 02:24:39.684631 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.684622 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8" containerName="manager" Jul 22 02:24:39.686638 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.686615 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:24:39.693478 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.693285 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-extensions-socket-volume\") pod \"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8\" (UID: \"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8\") " Jul 22 02:24:39.693478 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.693375 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w4jp\" (UniqueName: \"kubernetes.io/projected/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-kube-api-access-9w4jp\") pod \"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8\" (UID: \"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8\") " Jul 22 02:24:39.693621 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.693503 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3745ffe6-0571-43b8-a15a-cf52607c98a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b66jn\" (UID: \"3745ffe6-0571-43b8-a15a-cf52607c98a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:24:39.693676 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.693615 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxmqh\" (UniqueName: \"kubernetes.io/projected/3745ffe6-0571-43b8-a15a-cf52607c98a4-kube-api-access-jxmqh\") pod \"kuadrant-operator-controller-manager-86878c769f-b66jn\" (UID: \"3745ffe6-0571-43b8-a15a-cf52607c98a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:24:39.694106 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.694079 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8" (UID: "f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:24:39.695701 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.695673 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-kube-api-access-9w4jp" (OuterVolumeSpecName: "kube-api-access-9w4jp") pod "f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8" (UID: "f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8"). InnerVolumeSpecName "kube-api-access-9w4jp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:24:39.702239 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.702210 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn"] Jul 22 02:24:39.794555 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.794519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3745ffe6-0571-43b8-a15a-cf52607c98a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b66jn\" (UID: \"3745ffe6-0571-43b8-a15a-cf52607c98a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:24:39.794765 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.794699 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxmqh\" (UniqueName: \"kubernetes.io/projected/3745ffe6-0571-43b8-a15a-cf52607c98a4-kube-api-access-jxmqh\") pod \"kuadrant-operator-controller-manager-86878c769f-b66jn\" (UID: \"3745ffe6-0571-43b8-a15a-cf52607c98a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:24:39.794838 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.794796 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w4jp\" (UniqueName: \"kubernetes.io/projected/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-kube-api-access-9w4jp\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:24:39.794838 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.794814 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8-extensions-socket-volume\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:24:39.794915 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.794895 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3745ffe6-0571-43b8-a15a-cf52607c98a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-b66jn\" (UID: \"3745ffe6-0571-43b8-a15a-cf52607c98a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:24:39.803913 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.803890 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxmqh\" (UniqueName: \"kubernetes.io/projected/3745ffe6-0571-43b8-a15a-cf52607c98a4-kube-api-access-jxmqh\") pod \"kuadrant-operator-controller-manager-86878c769f-b66jn\" (UID: \"3745ffe6-0571-43b8-a15a-cf52607c98a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:24:39.997518 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:39.997466 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:24:40.163050 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:40.163018 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn"] Jul 22 02:24:40.164060 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:24:40.164035 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3745ffe6_0571_43b8_a15a_cf52607c98a4.slice/crio-b69b590f2b8fe92f2d7258303ab2c77cc2d0e82645a50c78283006e151d076b5 WatchSource:0}: Error finding container b69b590f2b8fe92f2d7258303ab2c77cc2d0e82645a50c78283006e151d076b5: Status 404 returned error can't find the container with id b69b590f2b8fe92f2d7258303ab2c77cc2d0e82645a50c78283006e151d076b5 Jul 22 02:24:40.557753 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:40.557719 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" event={"ID":"3745ffe6-0571-43b8-a15a-cf52607c98a4","Type":"ContainerStarted","Data":"743e065771c844a502d4474dc95826aa23dee7f5cefbd6381ae11970f05b963f"} Jul 22 02:24:40.558207 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:40.557782 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" event={"ID":"3745ffe6-0571-43b8-a15a-cf52607c98a4","Type":"ContainerStarted","Data":"b69b590f2b8fe92f2d7258303ab2c77cc2d0e82645a50c78283006e151d076b5"} Jul 22 02:24:40.558207 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:40.557809 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:24:40.559185 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:40.559161 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" event={"ID":"f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8","Type":"ContainerDied","Data":"fad82620391845118f16cf22a1db2d263b3ca3bcc651c20843fc5d89a75b509f"} Jul 22 02:24:40.559246 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:40.559187 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9" Jul 22 02:24:40.559246 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:40.559214 2556 scope.go:117] "RemoveContainer" containerID="a9c89381febf7613bdae2d811b6f494a7ae3566f311b105835b0a4046a2db6de" Jul 22 02:24:40.585454 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:40.585405 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" podStartSLOduration=1.585389502 podStartE2EDuration="1.585389502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:24:40.5838726 +0000 UTC m=+504.089859050" watchObservedRunningTime="2026-07-22 02:24:40.585389502 +0000 UTC m=+504.091375951" Jul 22 02:24:40.602719 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:40.602686 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9"] Jul 22 02:24:40.607376 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:40.607352 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf9t9"] Jul 22 02:24:41.025594 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:41.025561 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8" path="/var/lib/kubelet/pods/f7d217ae-ba0d-4438-b2a4-7fcfb7aafbd8/volumes" Jul 22 02:24:51.567137 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:51.567104 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:24:58.092858 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.092824 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:24:58.097730 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.097710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" Jul 22 02:24:58.100346 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.100327 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 22 02:24:58.100459 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.100346 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t62r7\"" Jul 22 02:24:58.105736 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.105709 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:24:58.134874 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.134844 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:24:58.141734 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.141707 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcdnm\" (UniqueName: \"kubernetes.io/projected/dbad0bd0-707d-46f3-9529-a5978ca6c5f3-kube-api-access-xcdnm\") pod \"limitador-limitador-54d6d988d5-wkbj4\" (UID: \"dbad0bd0-707d-46f3-9529-a5978ca6c5f3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" Jul 22 02:24:58.141855 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.141755 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dbad0bd0-707d-46f3-9529-a5978ca6c5f3-config-file\") pod \"limitador-limitador-54d6d988d5-wkbj4\" (UID: \"dbad0bd0-707d-46f3-9529-a5978ca6c5f3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" Jul 22 02:24:58.242651 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.242609 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcdnm\" (UniqueName: \"kubernetes.io/projected/dbad0bd0-707d-46f3-9529-a5978ca6c5f3-kube-api-access-xcdnm\") pod \"limitador-limitador-54d6d988d5-wkbj4\" (UID: \"dbad0bd0-707d-46f3-9529-a5978ca6c5f3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" Jul 22 02:24:58.242838 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.242664 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dbad0bd0-707d-46f3-9529-a5978ca6c5f3-config-file\") pod \"limitador-limitador-54d6d988d5-wkbj4\" (UID: \"dbad0bd0-707d-46f3-9529-a5978ca6c5f3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" Jul 22 02:24:58.243348 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.243329 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dbad0bd0-707d-46f3-9529-a5978ca6c5f3-config-file\") pod \"limitador-limitador-54d6d988d5-wkbj4\" (UID: \"dbad0bd0-707d-46f3-9529-a5978ca6c5f3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" Jul 22 02:24:58.252828 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.252806 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcdnm\" (UniqueName: \"kubernetes.io/projected/dbad0bd0-707d-46f3-9529-a5978ca6c5f3-kube-api-access-xcdnm\") pod \"limitador-limitador-54d6d988d5-wkbj4\" (UID: \"dbad0bd0-707d-46f3-9529-a5978ca6c5f3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" Jul 22 02:24:58.407878 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.407792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" Jul 22 02:24:58.552470 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.552448 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:24:58.554753 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:24:58.554728 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbad0bd0_707d_46f3_9529_a5978ca6c5f3.slice/crio-3d7d7f20d1f7c0bc7d997997250705837b27b6229e5d17cc4edeab886a703d3b WatchSource:0}: Error finding container 3d7d7f20d1f7c0bc7d997997250705837b27b6229e5d17cc4edeab886a703d3b: Status 404 returned error can't find the container with id 3d7d7f20d1f7c0bc7d997997250705837b27b6229e5d17cc4edeab886a703d3b Jul 22 02:24:58.650914 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.650880 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" event={"ID":"dbad0bd0-707d-46f3-9529-a5978ca6c5f3","Type":"ContainerStarted","Data":"3d7d7f20d1f7c0bc7d997997250705837b27b6229e5d17cc4edeab886a703d3b"} Jul 22 02:24:58.734743 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.734712 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-jzn6s"] Jul 22 02:24:58.739178 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.739160 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jzn6s" Jul 22 02:24:58.743848 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.743828 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qgq27\"" Jul 22 02:24:58.752705 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.752682 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jzn6s"] Jul 22 02:24:58.849388 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.849355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lxvs\" (UniqueName: \"kubernetes.io/projected/17870ba5-da9b-4335-bb18-ebe75e26d1a2-kube-api-access-9lxvs\") pod \"authorino-75d556bd77-jzn6s\" (UID: \"17870ba5-da9b-4335-bb18-ebe75e26d1a2\") " pod="kuadrant-system/authorino-75d556bd77-jzn6s" Jul 22 02:24:58.950705 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.950671 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lxvs\" (UniqueName: \"kubernetes.io/projected/17870ba5-da9b-4335-bb18-ebe75e26d1a2-kube-api-access-9lxvs\") pod \"authorino-75d556bd77-jzn6s\" (UID: \"17870ba5-da9b-4335-bb18-ebe75e26d1a2\") " pod="kuadrant-system/authorino-75d556bd77-jzn6s" Jul 22 02:24:58.961477 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:58.961451 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lxvs\" (UniqueName: \"kubernetes.io/projected/17870ba5-da9b-4335-bb18-ebe75e26d1a2-kube-api-access-9lxvs\") pod \"authorino-75d556bd77-jzn6s\" (UID: \"17870ba5-da9b-4335-bb18-ebe75e26d1a2\") " pod="kuadrant-system/authorino-75d556bd77-jzn6s" Jul 22 02:24:59.048319 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:59.048237 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jzn6s" Jul 22 02:24:59.234181 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:59.233924 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jzn6s"] Jul 22 02:24:59.237526 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:24:59.237493 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17870ba5_da9b_4335_bb18_ebe75e26d1a2.slice/crio-305e1eac0ab548208328beaac1af112da9fe94ea4768a8c3eaf2143afaccd616 WatchSource:0}: Error finding container 305e1eac0ab548208328beaac1af112da9fe94ea4768a8c3eaf2143afaccd616: Status 404 returned error can't find the container with id 305e1eac0ab548208328beaac1af112da9fe94ea4768a8c3eaf2143afaccd616 Jul 22 02:24:59.658454 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:24:59.658414 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jzn6s" event={"ID":"17870ba5-da9b-4335-bb18-ebe75e26d1a2","Type":"ContainerStarted","Data":"305e1eac0ab548208328beaac1af112da9fe94ea4768a8c3eaf2143afaccd616"} Jul 22 02:25:01.674123 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:01.674090 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" event={"ID":"dbad0bd0-707d-46f3-9529-a5978ca6c5f3","Type":"ContainerStarted","Data":"6eeb0c8f26ebdc56dccc682dc080929272126a7cc6bfa9a65c7252dc2a8f1530"} Jul 22 02:25:01.674610 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:01.674318 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" Jul 22 02:25:01.693052 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:01.692994 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" podStartSLOduration=1.148793599 podStartE2EDuration="3.692962472s" totalImagesPullingTime="2.544168873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:25:01.690741176 +0000 UTC m=+525.196727629" watchObservedRunningTime="2026-07-22 02:25:01.692962472 +0000 UTC m=+525.198949319" Jul 22 02:25:03.687366 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:03.687332 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jzn6s" event={"ID":"17870ba5-da9b-4335-bb18-ebe75e26d1a2","Type":"ContainerStarted","Data":"01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12"} Jul 22 02:25:03.704101 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:03.704049 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-jzn6s" podStartSLOduration=1.925116721 podStartE2EDuration="5.704033777s" totalImagesPullingTime="3.778917056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:25:03.702938341 +0000 UTC m=+527.208924795" watchObservedRunningTime="2026-07-22 02:25:03.704033777 +0000 UTC m=+527.210020228" Jul 22 02:25:12.681244 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:12.681163 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wkbj4" Jul 22 02:25:32.819820 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:32.819785 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57b855dcd4-dv6fz"] Jul 22 02:25:32.826607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:32.826583 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b855dcd4-dv6fz" Jul 22 02:25:32.829273 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:32.829245 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 22 02:25:32.831847 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:32.831824 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b855dcd4-dv6fz"] Jul 22 02:25:32.940344 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:32.940315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-tls-cert\") pod \"authorino-57b855dcd4-dv6fz\" (UID: \"6aab4d50-f1c1-41f8-8d1b-85142eae28a2\") " pod="kuadrant-system/authorino-57b855dcd4-dv6fz" Jul 22 02:25:32.940501 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:32.940455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtqpp\" (UniqueName: \"kubernetes.io/projected/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-kube-api-access-wtqpp\") pod \"authorino-57b855dcd4-dv6fz\" (UID: \"6aab4d50-f1c1-41f8-8d1b-85142eae28a2\") " pod="kuadrant-system/authorino-57b855dcd4-dv6fz" Jul 22 02:25:33.041316 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:33.041285 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtqpp\" (UniqueName: \"kubernetes.io/projected/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-kube-api-access-wtqpp\") pod \"authorino-57b855dcd4-dv6fz\" (UID: \"6aab4d50-f1c1-41f8-8d1b-85142eae28a2\") " pod="kuadrant-system/authorino-57b855dcd4-dv6fz" Jul 22 02:25:33.041316 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:33.041321 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-tls-cert\") pod \"authorino-57b855dcd4-dv6fz\" (UID: \"6aab4d50-f1c1-41f8-8d1b-85142eae28a2\") " pod="kuadrant-system/authorino-57b855dcd4-dv6fz" Jul 22 02:25:33.043887 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:33.043863 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-tls-cert\") pod \"authorino-57b855dcd4-dv6fz\" (UID: \"6aab4d50-f1c1-41f8-8d1b-85142eae28a2\") " pod="kuadrant-system/authorino-57b855dcd4-dv6fz" Jul 22 02:25:33.049961 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:33.049932 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtqpp\" (UniqueName: \"kubernetes.io/projected/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-kube-api-access-wtqpp\") pod \"authorino-57b855dcd4-dv6fz\" (UID: \"6aab4d50-f1c1-41f8-8d1b-85142eae28a2\") " pod="kuadrant-system/authorino-57b855dcd4-dv6fz" Jul 22 02:25:33.137187 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:33.137103 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b855dcd4-dv6fz" Jul 22 02:25:33.272033 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:33.272010 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b855dcd4-dv6fz"] Jul 22 02:25:33.274858 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:25:33.274824 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6aab4d50_f1c1_41f8_8d1b_85142eae28a2.slice/crio-045b34e3900ba00b80dd5a78dbdae22b3738b2cdfa250ce89b56befafdc2742e WatchSource:0}: Error finding container 045b34e3900ba00b80dd5a78dbdae22b3738b2cdfa250ce89b56befafdc2742e: Status 404 returned error can't find the container with id 045b34e3900ba00b80dd5a78dbdae22b3738b2cdfa250ce89b56befafdc2742e Jul 22 02:25:33.837234 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:33.837142 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b855dcd4-dv6fz" event={"ID":"6aab4d50-f1c1-41f8-8d1b-85142eae28a2","Type":"ContainerStarted","Data":"0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce"} Jul 22 02:25:33.837234 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:33.837192 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b855dcd4-dv6fz" event={"ID":"6aab4d50-f1c1-41f8-8d1b-85142eae28a2","Type":"ContainerStarted","Data":"045b34e3900ba00b80dd5a78dbdae22b3738b2cdfa250ce89b56befafdc2742e"} Jul 22 02:25:33.855252 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:33.855207 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57b855dcd4-dv6fz" podStartSLOduration=1.5555593829999999 podStartE2EDuration="1.855190819s" totalImagesPullingTime="299.631436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:25:33.853698068 +0000 UTC m=+557.359684520" watchObservedRunningTime="2026-07-22 02:25:33.855190819 +0000 UTC m=+557.361177269" Jul 22 02:25:33.882156 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:33.882118 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jzn6s"] Jul 22 02:25:33.882325 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:33.882284 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-jzn6s" podUID="17870ba5-da9b-4335-bb18-ebe75e26d1a2" containerName="authorino" containerID="cri-o://01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12" gracePeriod=30 Jul 22 02:25:34.127669 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.127640 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jzn6s" Jul 22 02:25:34.253185 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.253158 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lxvs\" (UniqueName: \"kubernetes.io/projected/17870ba5-da9b-4335-bb18-ebe75e26d1a2-kube-api-access-9lxvs\") pod \"17870ba5-da9b-4335-bb18-ebe75e26d1a2\" (UID: \"17870ba5-da9b-4335-bb18-ebe75e26d1a2\") " Jul 22 02:25:34.255131 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.255104 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17870ba5-da9b-4335-bb18-ebe75e26d1a2-kube-api-access-9lxvs" (OuterVolumeSpecName: "kube-api-access-9lxvs") pod "17870ba5-da9b-4335-bb18-ebe75e26d1a2" (UID: "17870ba5-da9b-4335-bb18-ebe75e26d1a2"). InnerVolumeSpecName "kube-api-access-9lxvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:25:34.354349 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.354312 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lxvs\" (UniqueName: \"kubernetes.io/projected/17870ba5-da9b-4335-bb18-ebe75e26d1a2-kube-api-access-9lxvs\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:25:34.843070 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.843033 2556 generic.go:356] "Generic (PLEG): container finished" podID="17870ba5-da9b-4335-bb18-ebe75e26d1a2" containerID="01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12" exitCode=0 Jul 22 02:25:34.843070 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.843073 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jzn6s" Jul 22 02:25:34.843534 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.843120 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jzn6s" event={"ID":"17870ba5-da9b-4335-bb18-ebe75e26d1a2","Type":"ContainerDied","Data":"01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12"} Jul 22 02:25:34.843534 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.843175 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jzn6s" event={"ID":"17870ba5-da9b-4335-bb18-ebe75e26d1a2","Type":"ContainerDied","Data":"305e1eac0ab548208328beaac1af112da9fe94ea4768a8c3eaf2143afaccd616"} Jul 22 02:25:34.843534 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.843205 2556 scope.go:117] "RemoveContainer" containerID="01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12" Jul 22 02:25:34.851877 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.851858 2556 scope.go:117] "RemoveContainer" containerID="01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12" Jul 22 02:25:34.852164 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:25:34.852146 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12\": container with ID starting with 01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12 not found: ID does not exist" containerID="01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12" Jul 22 02:25:34.852225 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.852172 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12"} err="failed to get container status \"01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12\": rpc error: code = NotFound desc = could not find container \"01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12\": container with ID starting with 01cbfa7c32fd3472e2833f78ab743230be4e10b6ed9656edfde2bb8962d90a12 not found: ID does not exist" Jul 22 02:25:34.870787 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.870761 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jzn6s"] Jul 22 02:25:34.872289 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:34.872270 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jzn6s"] Jul 22 02:25:35.025552 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:25:35.025517 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17870ba5-da9b-4335-bb18-ebe75e26d1a2" path="/var/lib/kubelet/pods/17870ba5-da9b-4335-bb18-ebe75e26d1a2/volumes" Jul 22 02:26:16.149881 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:16.149843 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:26:16.952782 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:16.952755 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:26:16.958027 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:16.958004 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:26:16.960618 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:16.960596 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:26:16.965638 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:16.965619 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:26:33.166393 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:33.166349 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:26:38.118481 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:38.118436 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:26:40.447928 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.447894 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg"] Jul 22 02:26:40.450221 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.448274 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17870ba5-da9b-4335-bb18-ebe75e26d1a2" containerName="authorino" Jul 22 02:26:40.450221 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.448287 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="17870ba5-da9b-4335-bb18-ebe75e26d1a2" containerName="authorino" Jul 22 02:26:40.450221 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.448363 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="17870ba5-da9b-4335-bb18-ebe75e26d1a2" containerName="authorino" Jul 22 02:26:40.451109 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.451092 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.456455 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.456428 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 02:26:40.457036 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.457014 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rs444\"" Jul 22 02:26:40.457164 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.457094 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 22 02:26:40.457585 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.457491 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 02:26:40.467698 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.467662 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg"] Jul 22 02:26:40.528212 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.528171 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.528376 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.528229 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.528376 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.528277 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37b68321-9eb6-42bd-88d8-e7bfad11fc64-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.528376 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.528329 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh85d\" (UniqueName: \"kubernetes.io/projected/37b68321-9eb6-42bd-88d8-e7bfad11fc64-kube-api-access-dh85d\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.528477 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.528380 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.528477 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.528404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.629600 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.629563 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.629600 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.629612 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37b68321-9eb6-42bd-88d8-e7bfad11fc64-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.629834 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.629647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh85d\" (UniqueName: \"kubernetes.io/projected/37b68321-9eb6-42bd-88d8-e7bfad11fc64-kube-api-access-dh85d\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.629834 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.629683 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.629834 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.629713 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.630009 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.629925 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.630086 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.630070 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.630151 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.630131 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.630310 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.630291 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.632036 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.632006 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37b68321-9eb6-42bd-88d8-e7bfad11fc64-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.632219 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.632200 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37b68321-9eb6-42bd-88d8-e7bfad11fc64-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.645704 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.645678 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh85d\" (UniqueName: \"kubernetes.io/projected/37b68321-9eb6-42bd-88d8-e7bfad11fc64-kube-api-access-dh85d\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6gttg\" (UID: \"37b68321-9eb6-42bd-88d8-e7bfad11fc64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.761883 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.761793 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:40.912381 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.912354 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg"] Jul 22 02:26:40.914813 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:26:40.914788 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b68321_9eb6_42bd_88d8_e7bfad11fc64.slice/crio-2db6f95cc21a82b31d2cd05e4500e1680f0ab9b0f38fe6081629be61ac7aa822 WatchSource:0}: Error finding container 2db6f95cc21a82b31d2cd05e4500e1680f0ab9b0f38fe6081629be61ac7aa822: Status 404 returned error can't find the container with id 2db6f95cc21a82b31d2cd05e4500e1680f0ab9b0f38fe6081629be61ac7aa822 Jul 22 02:26:40.916153 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:40.916134 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 02:26:41.169050 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:41.168936 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" event={"ID":"37b68321-9eb6-42bd-88d8-e7bfad11fc64","Type":"ContainerStarted","Data":"2db6f95cc21a82b31d2cd05e4500e1680f0ab9b0f38fe6081629be61ac7aa822"} Jul 22 02:26:41.613498 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:41.613458 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:26:42.175883 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:42.175846 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" event={"ID":"37b68321-9eb6-42bd-88d8-e7bfad11fc64","Type":"ContainerStarted","Data":"93d8bd451f5633e4955d368011e15d17538b65506c67a7c4320da0f246e56841"} Jul 22 02:26:42.196036 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:42.195970 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" podStartSLOduration=1.131811833 podStartE2EDuration="2.195954133s" totalImagesPullingTime="1.0641423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:26:42.195782377 +0000 UTC m=+625.701768828" watchObservedRunningTime="2026-07-22 02:26:42.195954133 +0000 UTC m=+625.701940583" Jul 22 02:26:50.508457 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:50.508409 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:26:50.763037 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:50.762930 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:50.763037 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:50.763018 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:50.775910 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:50.775882 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:26:51.232908 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:26:51.232878 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6gttg" Jul 22 02:27:10.918526 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:10.918486 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v"] Jul 22 02:27:10.921889 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:10.921865 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:10.924618 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:10.924596 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 22 02:27:10.940522 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:10.940495 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v"] Jul 22 02:27:11.104063 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.104030 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xjph\" (UniqueName: \"kubernetes.io/projected/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-kube-api-access-7xjph\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.104272 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.104072 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.104272 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.104108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.104272 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.104172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.104272 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.104225 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.104426 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.104296 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.204935 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.204901 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.205155 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.204947 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xjph\" (UniqueName: \"kubernetes.io/projected/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-kube-api-access-7xjph\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.205155 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.205070 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.205155 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.205151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.205337 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.205191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.205337 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.205231 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.205457 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.205438 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.205613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.205594 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.206066 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.206042 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.207241 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.207216 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.207560 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.207544 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.214328 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.214307 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xjph\" (UniqueName: \"kubernetes.io/projected/b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444-kube-api-access-7xjph\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-sft5v\" (UID: \"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.232502 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.232470 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:11.379034 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:11.379004 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v"] Jul 22 02:27:11.380534 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:27:11.380501 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a7fa33_a5a3_4fd4_aea4_c1d54dc4a444.slice/crio-8ccdf376c39e001e0a5226a6136a3d2533d2f46860d0f557d3d4eba16abc5aab WatchSource:0}: Error finding container 8ccdf376c39e001e0a5226a6136a3d2533d2f46860d0f557d3d4eba16abc5aab: Status 404 returned error can't find the container with id 8ccdf376c39e001e0a5226a6136a3d2533d2f46860d0f557d3d4eba16abc5aab Jul 22 02:27:12.320766 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:12.320722 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" event={"ID":"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444","Type":"ContainerStarted","Data":"d8e308c16a0ec7e6802f3713e0eac93dc6840d6305830a0ad065fdc07c1d397c"} Jul 22 02:27:12.321200 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:12.320814 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" event={"ID":"b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444","Type":"ContainerStarted","Data":"8ccdf376c39e001e0a5226a6136a3d2533d2f46860d0f557d3d4eba16abc5aab"} Jul 22 02:27:12.340607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:12.340550 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" podStartSLOduration=2.141459507 podStartE2EDuration="2.340534981s" totalImagesPullingTime="199.075474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:27:12.338833596 +0000 UTC m=+655.844820050" watchObservedRunningTime="2026-07-22 02:27:12.340534981 +0000 UTC m=+655.846521433" Jul 22 02:27:13.513902 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:13.513858 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:27:21.233169 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:21.233124 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:21.233693 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:21.233308 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:21.245486 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:21.245455 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:21.378759 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:21.378728 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-sft5v" Jul 22 02:27:22.813543 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:27:22.813500 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:28:09.337074 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:09.336974 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b95944d4f-rq5v8"] Jul 22 02:28:09.340562 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:09.340542 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b95944d4f-rq5v8" Jul 22 02:28:09.350824 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:09.350795 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b95944d4f-rq5v8"] Jul 22 02:28:09.416129 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:09.416092 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd7tx\" (UniqueName: \"kubernetes.io/projected/1602efac-d317-45cb-ab4c-aaa478852788-kube-api-access-pd7tx\") pod \"authorino-5b95944d4f-rq5v8\" (UID: \"1602efac-d317-45cb-ab4c-aaa478852788\") " pod="kuadrant-system/authorino-5b95944d4f-rq5v8" Jul 22 02:28:09.416319 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:09.416171 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1602efac-d317-45cb-ab4c-aaa478852788-tls-cert\") pod \"authorino-5b95944d4f-rq5v8\" (UID: \"1602efac-d317-45cb-ab4c-aaa478852788\") " pod="kuadrant-system/authorino-5b95944d4f-rq5v8" Jul 22 02:28:09.517286 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:09.517242 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1602efac-d317-45cb-ab4c-aaa478852788-tls-cert\") pod \"authorino-5b95944d4f-rq5v8\" (UID: \"1602efac-d317-45cb-ab4c-aaa478852788\") " pod="kuadrant-system/authorino-5b95944d4f-rq5v8" Jul 22 02:28:09.517467 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:09.517301 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd7tx\" (UniqueName: \"kubernetes.io/projected/1602efac-d317-45cb-ab4c-aaa478852788-kube-api-access-pd7tx\") pod \"authorino-5b95944d4f-rq5v8\" (UID: \"1602efac-d317-45cb-ab4c-aaa478852788\") " pod="kuadrant-system/authorino-5b95944d4f-rq5v8" Jul 22 02:28:09.519779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:09.519748 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1602efac-d317-45cb-ab4c-aaa478852788-tls-cert\") pod \"authorino-5b95944d4f-rq5v8\" (UID: \"1602efac-d317-45cb-ab4c-aaa478852788\") " pod="kuadrant-system/authorino-5b95944d4f-rq5v8" Jul 22 02:28:09.527434 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:09.527405 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd7tx\" (UniqueName: \"kubernetes.io/projected/1602efac-d317-45cb-ab4c-aaa478852788-kube-api-access-pd7tx\") pod \"authorino-5b95944d4f-rq5v8\" (UID: \"1602efac-d317-45cb-ab4c-aaa478852788\") " pod="kuadrant-system/authorino-5b95944d4f-rq5v8" Jul 22 02:28:09.650850 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:09.650768 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b95944d4f-rq5v8" Jul 22 02:28:09.801138 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:09.801112 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b95944d4f-rq5v8"] Jul 22 02:28:09.803615 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:28:09.803572 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1602efac_d317_45cb_ab4c_aaa478852788.slice/crio-820674ea363d267a70698eee9f50046187a0211ee62dc269e1407a8918756f0d WatchSource:0}: Error finding container 820674ea363d267a70698eee9f50046187a0211ee62dc269e1407a8918756f0d: Status 404 returned error can't find the container with id 820674ea363d267a70698eee9f50046187a0211ee62dc269e1407a8918756f0d Jul 22 02:28:10.608614 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:10.608496 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b95944d4f-rq5v8" event={"ID":"1602efac-d317-45cb-ab4c-aaa478852788","Type":"ContainerStarted","Data":"aa0b1db8fadf5c42d97afb954fe54278e088b0cc4e47e0a324c535d0d9c84111"} Jul 22 02:28:10.608614 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:10.608568 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b95944d4f-rq5v8" event={"ID":"1602efac-d317-45cb-ab4c-aaa478852788","Type":"ContainerStarted","Data":"820674ea363d267a70698eee9f50046187a0211ee62dc269e1407a8918756f0d"} Jul 22 02:28:10.629675 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:10.629596 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b95944d4f-rq5v8" podStartSLOduration=1.180442608 podStartE2EDuration="1.629577374s" totalImagesPullingTime="449.134766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:28:10.627755891 +0000 UTC m=+714.133742343" watchObservedRunningTime="2026-07-22 02:28:10.629577374 +0000 UTC m=+714.135563826" Jul 22 02:28:10.668479 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:10.668436 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57b855dcd4-dv6fz"] Jul 22 02:28:10.669146 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:10.668945 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-57b855dcd4-dv6fz" podUID="6aab4d50-f1c1-41f8-8d1b-85142eae28a2" containerName="authorino" containerID="cri-o://0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce" gracePeriod=30 Jul 22 02:28:10.946929 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:10.946902 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b855dcd4-dv6fz" Jul 22 02:28:11.028477 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.028435 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-tls-cert\") pod \"6aab4d50-f1c1-41f8-8d1b-85142eae28a2\" (UID: \"6aab4d50-f1c1-41f8-8d1b-85142eae28a2\") " Jul 22 02:28:11.028706 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.028501 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtqpp\" (UniqueName: \"kubernetes.io/projected/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-kube-api-access-wtqpp\") pod \"6aab4d50-f1c1-41f8-8d1b-85142eae28a2\" (UID: \"6aab4d50-f1c1-41f8-8d1b-85142eae28a2\") " Jul 22 02:28:11.031129 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.031082 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-kube-api-access-wtqpp" (OuterVolumeSpecName: "kube-api-access-wtqpp") pod "6aab4d50-f1c1-41f8-8d1b-85142eae28a2" (UID: "6aab4d50-f1c1-41f8-8d1b-85142eae28a2"). InnerVolumeSpecName "kube-api-access-wtqpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:28:11.040215 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.040180 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6aab4d50-f1c1-41f8-8d1b-85142eae28a2" (UID: "6aab4d50-f1c1-41f8-8d1b-85142eae28a2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:28:11.129706 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.129665 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtqpp\" (UniqueName: \"kubernetes.io/projected/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-kube-api-access-wtqpp\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:28:11.129706 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.129700 2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6aab4d50-f1c1-41f8-8d1b-85142eae28a2-tls-cert\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:28:11.615158 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.615123 2556 generic.go:356] "Generic (PLEG): container finished" podID="6aab4d50-f1c1-41f8-8d1b-85142eae28a2" containerID="0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce" exitCode=0 Jul 22 02:28:11.615634 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.615176 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b855dcd4-dv6fz" Jul 22 02:28:11.615634 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.615212 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b855dcd4-dv6fz" event={"ID":"6aab4d50-f1c1-41f8-8d1b-85142eae28a2","Type":"ContainerDied","Data":"0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce"} Jul 22 02:28:11.615634 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.615257 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b855dcd4-dv6fz" event={"ID":"6aab4d50-f1c1-41f8-8d1b-85142eae28a2","Type":"ContainerDied","Data":"045b34e3900ba00b80dd5a78dbdae22b3738b2cdfa250ce89b56befafdc2742e"} Jul 22 02:28:11.615634 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.615281 2556 scope.go:117] "RemoveContainer" containerID="0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce" Jul 22 02:28:11.624557 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.624503 2556 scope.go:117] "RemoveContainer" containerID="0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce" Jul 22 02:28:11.624918 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:28:11.624898 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce\": container with ID starting with 0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce not found: ID does not exist" containerID="0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce" Jul 22 02:28:11.625030 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.624928 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce"} err="failed to get container status \"0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce\": rpc error: code = NotFound desc = could not find container \"0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce\": container with ID starting with 0b475169f90763f7f4d03f0559d77a295fb1cbbc0bb003241fa0a7e240cefbce not found: ID does not exist" Jul 22 02:28:11.643846 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.643810 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57b855dcd4-dv6fz"] Jul 22 02:28:11.648420 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:11.648385 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57b855dcd4-dv6fz"] Jul 22 02:28:13.025490 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:13.025455 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aab4d50-f1c1-41f8-8d1b-85142eae28a2" path="/var/lib/kubelet/pods/6aab4d50-f1c1-41f8-8d1b-85142eae28a2/volumes" Jul 22 02:28:39.731563 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:39.731521 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:28:49.516998 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:28:49.516955 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:29:00.222446 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:29:00.222408 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:30:40.799325 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:30:40.799287 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:31:16.986455 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:31:16.986367 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:31:16.990862 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:31:16.990839 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:31:16.992006 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:31:16.991966 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:31:16.996089 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:31:16.996068 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:31:17.217171 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:31:17.217135 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:31:26.567663 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:31:26.567624 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:31:37.213345 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:31:37.213305 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:31:46.329492 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:31:46.329459 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:31:56.938233 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:31:56.938203 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:32:09.064607 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:32:09.064571 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:32:19.822647 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:32:19.822614 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:32:29.639562 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:32:29.639517 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:32:52.615745 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:32:52.615655 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:33:04.544179 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:33:04.544141 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:33:31.621248 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:33:31.621209 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:33:43.145935 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:33:43.145883 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:33:59.629633 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:33:59.629588 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:34:09.150541 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:34:09.150441 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:34:18.653972 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:34:18.653927 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:34:28.574345 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:34:28.574306 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:34:38.022518 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:34:38.022481 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:35:04.044433 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:04.044396 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn"] Jul 22 02:35:04.045182 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:04.044634 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" podUID="3745ffe6-0571-43b8-a15a-cf52607c98a4" containerName="manager" containerID="cri-o://743e065771c844a502d4474dc95826aa23dee7f5cefbd6381ae11970f05b963f" gracePeriod=10 Jul 22 02:35:06.693274 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:06.693192 2556 generic.go:356] "Generic (PLEG): container finished" podID="3745ffe6-0571-43b8-a15a-cf52607c98a4" containerID="743e065771c844a502d4474dc95826aa23dee7f5cefbd6381ae11970f05b963f" exitCode=0 Jul 22 02:35:06.693274 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:06.693241 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" event={"ID":"3745ffe6-0571-43b8-a15a-cf52607c98a4","Type":"ContainerDied","Data":"743e065771c844a502d4474dc95826aa23dee7f5cefbd6381ae11970f05b963f"} Jul 22 02:35:07.001232 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.001204 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:35:07.025164 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.025135 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxmqh\" (UniqueName: \"kubernetes.io/projected/3745ffe6-0571-43b8-a15a-cf52607c98a4-kube-api-access-jxmqh\") pod \"3745ffe6-0571-43b8-a15a-cf52607c98a4\" (UID: \"3745ffe6-0571-43b8-a15a-cf52607c98a4\") " Jul 22 02:35:07.025323 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.025198 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3745ffe6-0571-43b8-a15a-cf52607c98a4-extensions-socket-volume\") pod \"3745ffe6-0571-43b8-a15a-cf52607c98a4\" (UID: \"3745ffe6-0571-43b8-a15a-cf52607c98a4\") " Jul 22 02:35:07.025619 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.025590 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3745ffe6-0571-43b8-a15a-cf52607c98a4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3745ffe6-0571-43b8-a15a-cf52607c98a4" (UID: "3745ffe6-0571-43b8-a15a-cf52607c98a4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:35:07.028075 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.028044 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3745ffe6-0571-43b8-a15a-cf52607c98a4-kube-api-access-jxmqh" (OuterVolumeSpecName: "kube-api-access-jxmqh") pod "3745ffe6-0571-43b8-a15a-cf52607c98a4" (UID: "3745ffe6-0571-43b8-a15a-cf52607c98a4"). InnerVolumeSpecName "kube-api-access-jxmqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:35:07.126180 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.126137 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxmqh\" (UniqueName: \"kubernetes.io/projected/3745ffe6-0571-43b8-a15a-cf52607c98a4-kube-api-access-jxmqh\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:35:07.126180 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.126175 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3745ffe6-0571-43b8-a15a-cf52607c98a4-extensions-socket-volume\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:35:07.698995 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.698956 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" event={"ID":"3745ffe6-0571-43b8-a15a-cf52607c98a4","Type":"ContainerDied","Data":"b69b590f2b8fe92f2d7258303ab2c77cc2d0e82645a50c78283006e151d076b5"} Jul 22 02:35:07.699472 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.699054 2556 scope.go:117] "RemoveContainer" containerID="743e065771c844a502d4474dc95826aa23dee7f5cefbd6381ae11970f05b963f" Jul 22 02:35:07.699472 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.698964 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn" Jul 22 02:35:07.721510 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.721481 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn"] Jul 22 02:35:07.726643 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:07.726620 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-b66jn"] Jul 22 02:35:09.025086 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:35:09.025053 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3745ffe6-0571-43b8-a15a-cf52607c98a4" path="/var/lib/kubelet/pods/3745ffe6-0571-43b8-a15a-cf52607c98a4/volumes" Jul 22 02:36:05.230381 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.230331 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp"] Jul 22 02:36:05.231025 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.230727 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aab4d50-f1c1-41f8-8d1b-85142eae28a2" containerName="authorino" Jul 22 02:36:05.231025 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.230742 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aab4d50-f1c1-41f8-8d1b-85142eae28a2" containerName="authorino" Jul 22 02:36:05.231025 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.230750 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3745ffe6-0571-43b8-a15a-cf52607c98a4" containerName="manager" Jul 22 02:36:05.231025 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.230756 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3745ffe6-0571-43b8-a15a-cf52607c98a4" containerName="manager" Jul 22 02:36:05.231025 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.230839 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3745ffe6-0571-43b8-a15a-cf52607c98a4" containerName="manager" Jul 22 02:36:05.231025 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.230850 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aab4d50-f1c1-41f8-8d1b-85142eae28a2" containerName="authorino" Jul 22 02:36:05.233922 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.233898 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" Jul 22 02:36:05.236811 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.236787 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hcqmt\"" Jul 22 02:36:05.244639 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.244616 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp"] Jul 22 02:36:05.336365 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.336328 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c77526a9-5984-4fc6-8d4e-dd8c11709943-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-clrnp\" (UID: \"c77526a9-5984-4fc6-8d4e-dd8c11709943\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" Jul 22 02:36:05.336365 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.336371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j57m\" (UniqueName: \"kubernetes.io/projected/c77526a9-5984-4fc6-8d4e-dd8c11709943-kube-api-access-6j57m\") pod \"kuadrant-operator-controller-manager-86878c769f-clrnp\" (UID: \"c77526a9-5984-4fc6-8d4e-dd8c11709943\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" Jul 22 02:36:05.436817 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.436787 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c77526a9-5984-4fc6-8d4e-dd8c11709943-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-clrnp\" (UID: \"c77526a9-5984-4fc6-8d4e-dd8c11709943\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" Jul 22 02:36:05.436957 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.436829 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j57m\" (UniqueName: \"kubernetes.io/projected/c77526a9-5984-4fc6-8d4e-dd8c11709943-kube-api-access-6j57m\") pod \"kuadrant-operator-controller-manager-86878c769f-clrnp\" (UID: \"c77526a9-5984-4fc6-8d4e-dd8c11709943\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" Jul 22 02:36:05.437212 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.437191 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c77526a9-5984-4fc6-8d4e-dd8c11709943-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-clrnp\" (UID: \"c77526a9-5984-4fc6-8d4e-dd8c11709943\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" Jul 22 02:36:05.448764 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.448735 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j57m\" (UniqueName: \"kubernetes.io/projected/c77526a9-5984-4fc6-8d4e-dd8c11709943-kube-api-access-6j57m\") pod \"kuadrant-operator-controller-manager-86878c769f-clrnp\" (UID: \"c77526a9-5984-4fc6-8d4e-dd8c11709943\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" Jul 22 02:36:05.544930 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.544827 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" Jul 22 02:36:05.688075 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.688050 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp"] Jul 22 02:36:05.690189 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:36:05.690164 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77526a9_5984_4fc6_8d4e_dd8c11709943.slice/crio-adde99e8221ee2852fa2c44b864eb8c6817fe19086d3f3994480475f64bbeb61 WatchSource:0}: Error finding container adde99e8221ee2852fa2c44b864eb8c6817fe19086d3f3994480475f64bbeb61: Status 404 returned error can't find the container with id adde99e8221ee2852fa2c44b864eb8c6817fe19086d3f3994480475f64bbeb61 Jul 22 02:36:05.987198 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.987158 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" event={"ID":"c77526a9-5984-4fc6-8d4e-dd8c11709943","Type":"ContainerStarted","Data":"40d54c15a3f7d81554f70aed501b9346b9f0bc6739c4bc382764d2ccca3b3964"} Jul 22 02:36:05.987386 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.987224 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" event={"ID":"c77526a9-5984-4fc6-8d4e-dd8c11709943","Type":"ContainerStarted","Data":"adde99e8221ee2852fa2c44b864eb8c6817fe19086d3f3994480475f64bbeb61"} Jul 22 02:36:05.987386 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:05.987351 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" Jul 22 02:36:06.024482 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:06.024431 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" podStartSLOduration=1.024415581 podStartE2EDuration="1.024415581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:36:06.023638172 +0000 UTC m=+1189.529624623" watchObservedRunningTime="2026-07-22 02:36:06.024415581 +0000 UTC m=+1189.530402031" Jul 22 02:36:16.995107 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:16.995075 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-clrnp" Jul 22 02:36:17.017722 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:17.017695 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:36:17.020348 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:17.020326 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:36:17.024577 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:17.024561 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:36:17.026124 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:17.026105 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:36:26.029634 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:26.029600 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:36:35.408449 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:35.408409 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:36:48.107827 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:48.107789 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:36:59.141730 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:36:59.141684 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:37:11.300774 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:37:11.300692 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:37:20.605591 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:37:20.605552 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:37:31.113719 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:37:31.113681 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:37:41.302162 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:37:41.302123 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:37:52.319309 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:37:52.319270 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:38:01.104744 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:01.104705 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:38:12.310001 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:12.309954 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:38:36.203071 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:36.203029 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:38:44.009564 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:44.009471 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:38:58.840543 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.840505 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk"] Jul 22 02:38:58.843936 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.843916 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.847044 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.847017 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-c5afd956-kserve-self-signed-certs\"" Jul 22 02:38:58.878122 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.878085 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-home\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.878328 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.878254 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-dshm\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.878328 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.878304 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tmp-dir\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.878451 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.878342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-model-cache\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.878451 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.878417 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcm97\" (UniqueName: \"kubernetes.io/projected/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-kube-api-access-qcm97\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.878549 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.878460 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tls-certs\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.881081 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.881044 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk"] Jul 22 02:38:58.979588 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.979556 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tmp-dir\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.979779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.979594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-model-cache\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.979779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.979619 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcm97\" (UniqueName: \"kubernetes.io/projected/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-kube-api-access-qcm97\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.979779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.979640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tls-certs\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.979779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.979672 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-home\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.979779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.979749 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-dshm\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.980108 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.980081 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tmp-dir\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.980229 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.980128 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-model-cache\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.980286 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.980236 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-home\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.982085 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.982056 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-dshm\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.982347 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.982328 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tls-certs\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:58.988221 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:58.988187 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcm97\" (UniqueName: \"kubernetes.io/projected/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-kube-api-access-qcm97\") pod \"e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:59.153782 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:59.153681 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:38:59.296668 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:59.296637 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk"] Jul 22 02:38:59.298690 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:38:59.298637 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e086d1f_029f_4ad0_acf4_0c3554ca0f59.slice/crio-c84b4285473c345738dafccf71f1485b8a929d772c95c40c98e434a84d0e3e2b WatchSource:0}: Error finding container c84b4285473c345738dafccf71f1485b8a929d772c95c40c98e434a84d0e3e2b: Status 404 returned error can't find the container with id c84b4285473c345738dafccf71f1485b8a929d772c95c40c98e434a84d0e3e2b Jul 22 02:38:59.889878 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:59.889838 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" event={"ID":"4e086d1f-029f-4ad0-acf4-0c3554ca0f59","Type":"ContainerStarted","Data":"edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee"} Jul 22 02:38:59.889878 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:59.889880 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" event={"ID":"4e086d1f-029f-4ad0-acf4-0c3554ca0f59","Type":"ContainerStarted","Data":"c84b4285473c345738dafccf71f1485b8a929d772c95c40c98e434a84d0e3e2b"} Jul 22 02:38:59.913186 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:38:59.913128 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" podStartSLOduration=1.91311101 podStartE2EDuration="1.91311101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:59.913072019 +0000 UTC m=+1363.419058470" watchObservedRunningTime="2026-07-22 02:38:59.91311101 +0000 UTC m=+1363.419097461" Jul 22 02:39:02.050863 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:39:02.050820 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:39:09.154558 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:39:09.154511 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:39:09.155006 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:39:09.154582 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:39:09.167831 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:39:09.167802 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:39:09.954479 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:39:09.954445 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:39:16.514026 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:39:16.513971 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:39:57.734665 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:39:57.734622 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk"] Jul 22 02:40:01.057681 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:01.057636 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:40:12.758779 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:12.758622 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" podUID="4e086d1f-029f-4ad0-acf4-0c3554ca0f59" containerName="main" containerID="cri-o://edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee" gracePeriod=45 Jul 22 02:40:13.021442 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.021372 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:40:13.160365 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.160312 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-home\") pod \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " Jul 22 02:40:13.160365 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.160372 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-dshm\") pod \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " Jul 22 02:40:13.160621 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.160396 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tls-certs\") pod \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " Jul 22 02:40:13.160621 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.160421 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-model-cache\") pod \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " Jul 22 02:40:13.160621 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.160462 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tmp-dir\") pod \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " Jul 22 02:40:13.160621 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.160479 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcm97\" (UniqueName: \"kubernetes.io/projected/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-kube-api-access-qcm97\") pod \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\" (UID: \"4e086d1f-029f-4ad0-acf4-0c3554ca0f59\") " Jul 22 02:40:13.160820 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.160648 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-home" (OuterVolumeSpecName: "home") pod "4e086d1f-029f-4ad0-acf4-0c3554ca0f59" (UID: "4e086d1f-029f-4ad0-acf4-0c3554ca0f59"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:40:13.160820 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.160691 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-model-cache" (OuterVolumeSpecName: "model-cache") pod "4e086d1f-029f-4ad0-acf4-0c3554ca0f59" (UID: "4e086d1f-029f-4ad0-acf4-0c3554ca0f59"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:40:13.160820 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.160723 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4e086d1f-029f-4ad0-acf4-0c3554ca0f59" (UID: "4e086d1f-029f-4ad0-acf4-0c3554ca0f59"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:40:13.162838 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.162809 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-dshm" (OuterVolumeSpecName: "dshm") pod "4e086d1f-029f-4ad0-acf4-0c3554ca0f59" (UID: "4e086d1f-029f-4ad0-acf4-0c3554ca0f59"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 02:40:13.162838 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.162821 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4e086d1f-029f-4ad0-acf4-0c3554ca0f59" (UID: "4e086d1f-029f-4ad0-acf4-0c3554ca0f59"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 02:40:13.162971 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.162823 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-kube-api-access-qcm97" (OuterVolumeSpecName: "kube-api-access-qcm97") pod "4e086d1f-029f-4ad0-acf4-0c3554ca0f59" (UID: "4e086d1f-029f-4ad0-acf4-0c3554ca0f59"). InnerVolumeSpecName "kube-api-access-qcm97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 02:40:13.261790 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.261747 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tmp-dir\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:40:13.261790 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.261787 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcm97\" (UniqueName: \"kubernetes.io/projected/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-kube-api-access-qcm97\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:40:13.262053 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.261800 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-home\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:40:13.262053 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.261813 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-dshm\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:40:13.262053 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.261823 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-tls-certs\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:40:13.262053 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.261834 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e086d1f-029f-4ad0-acf4-0c3554ca0f59-model-cache\") on node \"ip-10-0-135-238.ec2.internal\" DevicePath \"\"" Jul 22 02:40:13.268086 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.268051 2556 generic.go:356] "Generic (PLEG): container finished" podID="4e086d1f-029f-4ad0-acf4-0c3554ca0f59" containerID="edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee" exitCode=0 Jul 22 02:40:13.268289 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.268103 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" Jul 22 02:40:13.268289 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.268114 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" event={"ID":"4e086d1f-029f-4ad0-acf4-0c3554ca0f59","Type":"ContainerDied","Data":"edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee"} Jul 22 02:40:13.268289 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.268159 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk" event={"ID":"4e086d1f-029f-4ad0-acf4-0c3554ca0f59","Type":"ContainerDied","Data":"c84b4285473c345738dafccf71f1485b8a929d772c95c40c98e434a84d0e3e2b"} Jul 22 02:40:13.268289 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.268187 2556 scope.go:117] "RemoveContainer" containerID="edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee" Jul 22 02:40:13.279961 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.279934 2556 scope.go:117] "RemoveContainer" containerID="edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee" Jul 22 02:40:13.280343 ip-10-0-135-238 kubenswrapper[2556]: E0722 02:40:13.280320 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee\": container with ID starting with edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee not found: ID does not exist" containerID="edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee" Jul 22 02:40:13.280411 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.280358 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee"} err="failed to get container status \"edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee\": rpc error: code = NotFound desc = could not find container \"edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee\": container with ID starting with edaab467619f01bf63a434ba9f3dad27e2bb272a767b4aed01afed14b9e231ee not found: ID does not exist" Jul 22 02:40:13.292506 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.292463 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk"] Jul 22 02:40:13.299868 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:13.299822 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-c5afd956-kserve-54c6d8c759-n79xk"] Jul 22 02:40:15.026313 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:15.026278 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e086d1f-029f-4ad0-acf4-0c3554ca0f59" path="/var/lib/kubelet/pods/4e086d1f-029f-4ad0-acf4-0c3554ca0f59/volumes" Jul 22 02:40:17.705259 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:17.705218 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:40:27.208054 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:27.208015 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:40:40.510492 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:40.510449 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:40:50.206017 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:50.205957 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:40:59.913851 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:40:59.913808 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:41:08.414755 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:41:08.414716 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:41:17.062316 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:41:17.062283 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:41:17.062763 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:41:17.062526 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:41:17.068112 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:41:17.068084 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:41:17.068317 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:41:17.068301 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:41:19.312864 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:41:19.312822 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:41:30.423847 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:41:30.423806 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:41:42.319896 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:41:42.319786 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:41:58.508873 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:41:58.508831 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:42:13.413148 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:42:13.413107 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:42:25.511749 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:42:25.511701 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:42:42.813098 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:42:42.813058 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:42:54.713568 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:42:54.713524 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:43:07.914153 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:43:07.914110 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:43:22.001997 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:43:22.001883 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:43:31.908605 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:43:31.908567 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:43:42.324372 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:43:42.324329 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:43:52.511543 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:43:52.511499 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:44:22.513611 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:44:22.513571 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:44:34.533613 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:44:34.533570 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:45:07.036180 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:45:07.036123 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:45:18.622094 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:45:18.622055 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:45:50.619095 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:45:50.619052 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:46:02.010384 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:46:02.010341 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:46:17.096132 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:46:17.096103 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:46:17.097597 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:46:17.097569 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:46:17.101812 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:46:17.101788 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:46:17.103124 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:46:17.103094 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gx5c8_932b05c4-02a6-428a-b8ad-d0a7fb2e73d4/ovn-acl-logging/0.log" Jul 22 02:46:35.616796 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:46:35.616756 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:48:06.971413 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:48:06.971370 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:48:18.504168 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:48:18.504130 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:48:29.707907 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:48:29.707865 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:48:52.009916 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:48:52.009874 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wkbj4"] Jul 22 02:49:16.051043 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:16.050919 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b95944d4f-rq5v8_1602efac-d317-45cb-ab4c-aaa478852788/authorino/0.log" Jul 22 02:49:21.565901 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:21.565861 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r8m5r_f816e362-d4dc-4fb2-8163-a6f36e465187/manager/0.log" Jul 22 02:49:21.795784 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:21.795748 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gkbz9_150974e6-f10a-4460-b3af-055e40bd37bb/server/0.log" Jul 22 02:49:21.908560 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:21.908475 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hc7c4_d06e2e9e-733e-4ed0-974f-63a06c7913ad/manager/0.log" Jul 22 02:49:22.148000 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:22.147947 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-5vp2h_fe9d9784-0142-4104-834a-96c11a11c28f/copy-manifests/0.log" Jul 22 02:49:22.156085 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:22.156059 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-5vp2h_fe9d9784-0142-4104-834a-96c11a11c28f/manager/0.log" Jul 22 02:49:24.308127 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:24.308095 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b95944d4f-rq5v8_1602efac-d317-45cb-ab4c-aaa478852788/authorino/0.log" Jul 22 02:49:24.422770 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:24.422736 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xgq9q_ec49e1a5-b874-4113-bb54-2404c414db55/manager/0.log" Jul 22 02:49:24.753141 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:24.753109 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5mmzh_f39ab534-7fe4-4502-8dd3-11be6a89149e/registry-server/0.log" Jul 22 02:49:24.881818 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:24.881779 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-clrnp_c77526a9-5984-4fc6-8d4e-dd8c11709943/manager/0.log" Jul 22 02:49:24.998288 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:24.998256 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wkbj4_dbad0bd0-707d-46f3-9529-a5978ca6c5f3/limitador/0.log" Jul 22 02:49:25.117213 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:25.117132 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qv8sv_ed185d0b-ff2f-4301-9a75-1b0e87129f95/manager/0.log" Jul 22 02:49:25.835509 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:25.835477 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7756896c6-zbglf_0de272f9-cd4e-44a2-8702-8b84cdca4ecd/kube-auth-proxy/0.log" Jul 22 02:49:26.319215 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:26.319182 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c4c584546-b2wlb_d028023b-927c-4ed9-bb9a-8d2ba98cfb45/router/0.log" Jul 22 02:49:26.935222 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:26.935192 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6gttg_37b68321-9eb6-42bd-88d8-e7bfad11fc64/main/0.log" Jul 22 02:49:27.162220 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:27.162192 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-sft5v_b2a7fa33-a5a3-4fd4-aea4-c1d54dc4a444/main/0.log" Jul 22 02:49:35.309043 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:35.309013 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-whfqq_8f0076ef-a5ed-46b5-b528-b73e33cebcf1/global-pull-secret-syncer/0.log" Jul 22 02:49:35.427657 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:35.427616 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xxxj8_bb9601e3-b459-493e-b6ba-0c195220abb7/konnectivity-agent/0.log" Jul 22 02:49:35.477071 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:35.477034 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-238.ec2.internal_43547df299046b716198ac6f0727dbc5/haproxy/0.log" Jul 22 02:49:40.820196 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:40.820159 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b95944d4f-rq5v8_1602efac-d317-45cb-ab4c-aaa478852788/authorino/0.log" Jul 22 02:49:40.894597 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:40.894551 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xgq9q_ec49e1a5-b874-4113-bb54-2404c414db55/manager/0.log" Jul 22 02:49:41.080083 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:41.079114 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5mmzh_f39ab534-7fe4-4502-8dd3-11be6a89149e/registry-server/0.log" Jul 22 02:49:41.416022 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:41.415905 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-clrnp_c77526a9-5984-4fc6-8d4e-dd8c11709943/manager/0.log" Jul 22 02:49:41.518278 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:41.518247 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wkbj4_dbad0bd0-707d-46f3-9529-a5978ca6c5f3/limitador/0.log" Jul 22 02:49:41.622762 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:41.622727 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qv8sv_ed185d0b-ff2f-4301-9a75-1b0e87129f95/manager/0.log" Jul 22 02:49:43.442366 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:43.442331 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-hdkxj_9d79edf4-e8ea-48ff-913f-df6ffab993a3/cluster-monitoring-operator/0.log" Jul 22 02:49:43.863094 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:43.863055 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5scxs_1385c74d-5913-4cba-a051-95976db46c5f/node-exporter/0.log" Jul 22 02:49:43.927292 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:43.927255 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5scxs_1385c74d-5913-4cba-a051-95976db46c5f/kube-rbac-proxy/0.log" Jul 22 02:49:43.956554 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:43.956529 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5scxs_1385c74d-5913-4cba-a051-95976db46c5f/init-textfile/0.log" Jul 22 02:49:44.974510 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:44.974478 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7"] Jul 22 02:49:44.974903 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:44.974873 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e086d1f-029f-4ad0-acf4-0c3554ca0f59" containerName="main" Jul 22 02:49:44.974903 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:44.974884 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e086d1f-029f-4ad0-acf4-0c3554ca0f59" containerName="main" Jul 22 02:49:44.974977 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:44.974960 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e086d1f-029f-4ad0-acf4-0c3554ca0f59" containerName="main" Jul 22 02:49:44.978284 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:44.978259 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:44.981064 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:44.981039 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9wvl\"/\"openshift-service-ca.crt\"" Jul 22 02:49:44.981212 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:44.981098 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9wvl\"/\"kube-root-ca.crt\"" Jul 22 02:49:44.981212 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:44.981114 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j9wvl\"/\"default-dockercfg-sp5qx\"" Jul 22 02:49:44.989471 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:44.989439 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7"] Jul 22 02:49:45.094776 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.094724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-lib-modules\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.094776 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.094781 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-sys\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.095015 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.094889 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-podres\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.095015 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.094961 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-proc\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.095091 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.095013 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5cgs\" (UniqueName: \"kubernetes.io/projected/adb9f75e-c98d-4743-bf2d-9927bae26274-kube-api-access-c5cgs\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.195810 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.195771 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-proc\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.195810 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.195815 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5cgs\" (UniqueName: \"kubernetes.io/projected/adb9f75e-c98d-4743-bf2d-9927bae26274-kube-api-access-c5cgs\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.196075 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.195836 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-lib-modules\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.196075 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.195885 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-sys\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.196075 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.195964 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-lib-modules\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.196075 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.196011 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-podres\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.196075 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.196010 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-proc\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.196075 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.196042 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-sys\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.196274 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.196117 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/adb9f75e-c98d-4743-bf2d-9927bae26274-podres\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.204910 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.204879 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5cgs\" (UniqueName: \"kubernetes.io/projected/adb9f75e-c98d-4743-bf2d-9927bae26274-kube-api-access-c5cgs\") pod \"perf-node-gather-daemonset-l4zd7\" (UID: \"adb9f75e-c98d-4743-bf2d-9927bae26274\") " pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.289895 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.289798 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:45.437033 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:45.437002 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7"] Jul 22 02:49:45.439642 ip-10-0-135-238 kubenswrapper[2556]: W0722 02:49:45.439612 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podadb9f75e_c98d_4743_bf2d_9927bae26274.slice/crio-3174237d5e6d04c0ac49fb11139024565cf24ca3f6df3ed7f821beb2d4643543 WatchSource:0}: Error finding container 3174237d5e6d04c0ac49fb11139024565cf24ca3f6df3ed7f821beb2d4643543: Status 404 returned error can't find the container with id 3174237d5e6d04c0ac49fb11139024565cf24ca3f6df3ed7f821beb2d4643543 Jul 22 02:49:46.031289 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:46.031261 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-ff2jk_515007d6-343c-4176-9e24-e2531a39b46a/networking-console-plugin/0.log" Jul 22 02:49:46.177814 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:46.177774 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" event={"ID":"adb9f75e-c98d-4743-bf2d-9927bae26274","Type":"ContainerStarted","Data":"5103d1acafac220026c595eebd0db2fef9806ddeea9835b53d858d87ff29f42d"} Jul 22 02:49:46.178042 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:46.177831 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" event={"ID":"adb9f75e-c98d-4743-bf2d-9927bae26274","Type":"ContainerStarted","Data":"3174237d5e6d04c0ac49fb11139024565cf24ca3f6df3ed7f821beb2d4643543"} Jul 22 02:49:46.178042 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:46.177865 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:46.195831 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:46.195772 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" podStartSLOduration=2.1957521939999998 podStartE2EDuration="2.195752194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:49:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:49:46.194365783 +0000 UTC m=+2009.700352236" watchObservedRunningTime="2026-07-22 02:49:46.195752194 +0000 UTC m=+2009.701738649" Jul 22 02:49:46.626536 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:46.626503 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/1.log" Jul 22 02:49:46.632947 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:46.632908 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-smzl5_f346f302-e3d1-47db-bff3-d33210c01f39/console-operator/2.log" Jul 22 02:49:47.119652 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:47.119618 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-78spx_1258f8b9-f2a8-49a2-9f42-efb45d3096ee/download-server/0.log" Jul 22 02:49:47.699704 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:47.699672 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-s6kh2_41a87a1c-0fc3-4169-bc4b-3a31d814e4e2/volume-data-source-validator/0.log" Jul 22 02:49:48.869231 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:48.869202 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jxb8n_cea823f6-3bb0-41cc-b9a0-49267e8d0fb2/dns/0.log" Jul 22 02:49:48.895415 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:48.895385 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jxb8n_cea823f6-3bb0-41cc-b9a0-49267e8d0fb2/kube-rbac-proxy/0.log" Jul 22 02:49:48.949760 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:48.949730 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8hjrj_90829ff4-eea6-4fab-bbbc-c03855b2f347/dns-node-resolver/0.log" Jul 22 02:49:49.525568 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:49.525526 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-79gb4_57d753f0-2e81-4640-ae5f-ec2649d0a1f5/node-ca/0.log" Jul 22 02:49:50.674734 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:50.674705 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7756896c6-zbglf_0de272f9-cd4e-44a2-8702-8b84cdca4ecd/kube-auth-proxy/0.log" Jul 22 02:49:50.843249 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:50.843225 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c4c584546-b2wlb_d028023b-927c-4ed9-bb9a-8d2ba98cfb45/router/0.log" Jul 22 02:49:51.477465 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:51.477426 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7fjrj_3b23627b-2b94-4d5d-9acb-e452f69d0e6b/serve-healthcheck-canary/0.log" Jul 22 02:49:51.978941 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:51.978904 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-t2cwg_39b4a0c9-5629-46ee-9c38-839e2785e93b/insights-operator/0.log" Jul 22 02:49:51.980656 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:51.980633 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-t2cwg_39b4a0c9-5629-46ee-9c38-839e2785e93b/insights-operator/1.log" Jul 22 02:49:52.005420 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:52.005382 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c78t5_a0a243c1-edde-4738-8d57-b517b4dad2a6/kube-rbac-proxy/0.log" Jul 22 02:49:52.028761 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:52.028735 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c78t5_a0a243c1-edde-4738-8d57-b517b4dad2a6/exporter/0.log" Jul 22 02:49:52.051654 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:52.051623 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c78t5_a0a243c1-edde-4738-8d57-b517b4dad2a6/extractor/0.log" Jul 22 02:49:52.193387 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:52.193358 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j9wvl/perf-node-gather-daemonset-l4zd7" Jul 22 02:49:54.792460 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:54.792420 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-r8m5r_f816e362-d4dc-4fb2-8163-a6f36e465187/manager/0.log" Jul 22 02:49:54.911308 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:54.911278 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gkbz9_150974e6-f10a-4460-b3af-055e40bd37bb/server/0.log" Jul 22 02:49:54.971396 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:54.971359 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hc7c4_d06e2e9e-733e-4ed0-974f-63a06c7913ad/manager/0.log" Jul 22 02:49:55.090352 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:55.090318 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-5vp2h_fe9d9784-0142-4104-834a-96c11a11c28f/manager/0.log" Jul 22 02:49:55.120244 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:55.120217 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57f477d5fd-5vp2h_fe9d9784-0142-4104-834a-96c11a11c28f/copy-manifests/0.log" Jul 22 02:49:55.600834 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:55.600748 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7756896c6-zbglf_0de272f9-cd4e-44a2-8702-8b84cdca4ecd/kube-auth-proxy/0.log" Jul 22 02:49:55.753113 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:55.753084 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c4c584546-b2wlb_d028023b-927c-4ed9-bb9a-8d2ba98cfb45/router/0.log" Jul 22 02:49:57.045542 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:57.045505 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7756896c6-zbglf_0de272f9-cd4e-44a2-8702-8b84cdca4ecd/kube-auth-proxy/0.log" Jul 22 02:49:57.181389 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:49:57.181362 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c4c584546-b2wlb_d028023b-927c-4ed9-bb9a-8d2ba98cfb45/router/0.log" Jul 22 02:50:01.417453 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:50:01.417417 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-m9hdz_af7c868a-dc6f-44fc-9e28-4a7ee46acb4f/migrator/0.log" Jul 22 02:50:01.441915 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:50:01.441871 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-m9hdz_af7c868a-dc6f-44fc-9e28-4a7ee46acb4f/graceful-termination/0.log" Jul 22 02:50:01.825049 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:50:01.825008 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-mlcq4_a13a4c7d-b104-42df-8a67-ed5e9d8f55b6/kube-storage-version-migrator-operator/1.log" Jul 22 02:50:01.825835 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:50:01.825781 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-mlcq4_a13a4c7d-b104-42df-8a67-ed5e9d8f55b6/kube-storage-version-migrator-operator/0.log" Jul 22 02:50:02.965222 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:50:02.965187 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vfd6_80c1edab-fed5-4b64-b763-4afd12faa9f6/kube-multus-additional-cni-plugins/0.log" Jul 22 02:50:02.990523 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:50:02.990491 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vfd6_80c1edab-fed5-4b64-b763-4afd12faa9f6/egress-router-binary-copy/0.log" Jul 22 02:50:03.013761 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:50:03.013735 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vfd6_80c1edab-fed5-4b64-b763-4afd12faa9f6/cni-plugins/0.log" Jul 22 02:50:03.037526 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:50:03.037496 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vfd6_80c1edab-fed5-4b64-b763-4afd12faa9f6/bond-cni-plugin/0.log" Jul 22 02:50:03.068719 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:50:03.068692 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vfd6_80c1edab-fed5-4b64-b763-4afd12faa9f6/routeoverride-cni/0.log" Jul 22 02:50:03.094197 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:50:03.094156 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vfd6_80c1edab-fed5-4b64-b763-4afd12faa9f6/whereabouts-cni-bincopy/0.log" Jul 22 02:50:03.121839 ip-10-0-135-238 kubenswrapper[2556]: I0722 02:50:03.121808 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7vfd6_80c1edab-fed5-4b64-b763-4afd12faa9f6/whereabouts-cni/0.log"