Jul 18 00:54:38.133282 ip-10-0-132-32 systemd[1]: Starting Kubernetes Kubelet... Jul 18 00:54:38.571893 ip-10-0-132-32 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:54:38.571893 ip-10-0-132-32 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 18 00:54:38.571893 ip-10-0-132-32 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:54:38.571893 ip-10-0-132-32 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 18 00:54:38.571893 ip-10-0-132-32 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:54:38.574787 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.574699 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 18 00:54:38.582108 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582086 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:38.582108 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582105 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:38.582108 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582109 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:38.582108 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582112 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:38.582108 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582115 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:38.582108 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582118 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582123 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582127 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582130 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582133 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582136 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582138 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582141 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582144 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582146 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582149 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582151 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582154 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582157 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582159 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582162 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582164 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582167 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582169 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:38.582325 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582172 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582174 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582180 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582183 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582185 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582188 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582190 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582193 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582196 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582198 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582201 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582204 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582206 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582209 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582212 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582215 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582218 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582220 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582223 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582226 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:38.582772 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582228 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582231 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582233 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582236 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582238 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582241 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582243 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582246 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582248 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582251 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582253 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582256 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582258 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582261 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582264 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582266 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582269 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582271 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582274 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582276 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:38.583261 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582278 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582281 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582283 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582286 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582288 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582292 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582294 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582298 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582301 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582303 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582306 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582308 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582312 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582316 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582319 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582322 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582325 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582327 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582330 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582333 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:38.583733 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582336 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582339 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582341 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582345 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582347 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582350 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582353 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582356 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582359 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582362 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582365 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582367 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582370 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582372 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.582375 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.583953 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.583960 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.583963 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.583966 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:38.584220 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.583969 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.583972 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.583975 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.583977 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.583994 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.583997 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584000 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584002 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584005 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584007 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584010 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584012 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584015 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584018 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584020 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584024 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584027 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584029 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584032 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584034 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:38.584768 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584037 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584039 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584041 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584044 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584047 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584049 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584051 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584056 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584059 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584062 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584066 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584069 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584071 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584074 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584076 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584079 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584082 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584084 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584087 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:38.585292 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584090 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584093 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584095 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584098 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584100 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584103 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584105 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584108 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584111 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584114 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584116 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584119 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584122 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584124 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584126 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584129 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584131 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584134 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584136 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584138 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:38.585743 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584141 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584144 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584146 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584149 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584151 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584153 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584156 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584158 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584161 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584165 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584167 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584169 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584172 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584174 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584178 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584181 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584184 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584186 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584189 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:38.586240 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584191 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584194 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584198 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584200 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584203 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584205 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584207 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584210 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584212 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584216 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584219 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584222 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584225 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584228 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584231 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584234 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584236 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584610 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584615 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:38.586716 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584618 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584620 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584623 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584627 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584631 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584634 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584637 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584640 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584643 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584645 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584649 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584653 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584655 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584658 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584661 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584664 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584666 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584669 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:38.587191 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584671 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584675 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584677 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584680 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584682 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584684 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584687 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584690 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584693 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584695 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584698 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584700 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584702 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584705 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584708 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584711 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584713 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584715 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584718 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584720 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:38.587628 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584723 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584725 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584728 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584730 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584732 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584739 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584741 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584743 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584746 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584749 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584752 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584754 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584757 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584759 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584762 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584764 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584767 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584769 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584772 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584775 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:38.588151 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584777 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584780 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584782 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584785 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584787 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584790 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584793 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584795 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584797 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584800 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584802 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584805 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584807 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584809 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584812 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584814 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584817 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584821 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584824 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:38.588650 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584828 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584830 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584832 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584835 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584838 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584840 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584843 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584845 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584847 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584850 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584852 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584854 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584861 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584864 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584866 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584869 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584871 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584874 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584877 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.584879 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.584949 2585 flags.go:64] FLAG: --address="0.0.0.0" Jul 18 00:54:38.589131 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.584956 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.584962 2585 flags.go:64] FLAG: --anonymous-auth="true" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.584967 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.584971 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.584974 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.584978 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585000 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585003 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585006 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585010 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585013 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585016 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585019 2585 flags.go:64] FLAG: --cgroup-root="" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585022 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585025 2585 flags.go:64] FLAG: --client-ca-file="" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585028 2585 flags.go:64] FLAG: --cloud-provider="external" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585031 2585 flags.go:64] FLAG: --cluster-dns="[]" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585035 2585 flags.go:64] FLAG: --cluster-domain="" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585038 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585041 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585044 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585048 2585 flags.go:64] FLAG: --container-log-max-files="5" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585051 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 18 00:54:38.589657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585056 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585059 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585062 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585065 2585 flags.go:64] FLAG: --contention-profiling="false" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585067 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585070 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585075 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585078 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585082 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585085 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585088 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585091 2585 flags.go:64] FLAG: --enable-load-reader="false" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585094 2585 flags.go:64] FLAG: --enable-server="true" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585097 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585101 2585 flags.go:64] FLAG: --event-burst="100" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585104 2585 flags.go:64] FLAG: --event-qps="50" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585107 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585110 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585113 2585 flags.go:64] FLAG: --eviction-hard="" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585121 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585124 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585128 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585131 2585 flags.go:64] FLAG: --eviction-soft="" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585134 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585136 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 18 00:54:38.590215 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585140 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585143 2585 flags.go:64] FLAG: --experimental-mounter-path="" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585145 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585148 2585 flags.go:64] FLAG: --fail-swap-on="true" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585151 2585 flags.go:64] FLAG: --feature-gates="" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585154 2585 flags.go:64] FLAG: --file-check-frequency="20s" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585157 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585162 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585165 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585167 2585 flags.go:64] FLAG: --healthz-port="10248" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585170 2585 flags.go:64] FLAG: --help="false" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585173 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-132-32.ec2.internal" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585176 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585180 2585 flags.go:64] FLAG: --http-check-frequency="20s" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585183 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585186 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585189 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585192 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585195 2585 flags.go:64] FLAG: --image-service-endpoint="" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585198 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585201 2585 flags.go:64] FLAG: --kube-api-burst="100" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585203 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585207 2585 flags.go:64] FLAG: --kube-api-qps="50" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585209 2585 flags.go:64] FLAG: --kube-reserved="" Jul 18 00:54:38.590811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585212 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585215 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585218 2585 flags.go:64] FLAG: --kubelet-cgroups="" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585221 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585223 2585 flags.go:64] FLAG: --lock-file="" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585226 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585229 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585231 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585237 2585 flags.go:64] FLAG: --log-json-split-stream="false" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585240 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585243 2585 flags.go:64] FLAG: --log-text-split-stream="false" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585245 2585 flags.go:64] FLAG: --logging-format="text" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585248 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585251 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585254 2585 flags.go:64] FLAG: --manifest-url="" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585257 2585 flags.go:64] FLAG: --manifest-url-header="" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585261 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585264 2585 flags.go:64] FLAG: --max-open-files="1000000" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585268 2585 flags.go:64] FLAG: --max-pods="110" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585271 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585274 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585278 2585 flags.go:64] FLAG: --memory-manager-policy="None" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585281 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585284 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585287 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 18 00:54:38.591424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585289 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585296 2585 flags.go:64] FLAG: --node-status-max-images="50" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585299 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585302 2585 flags.go:64] FLAG: --oom-score-adj="-999" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585305 2585 flags.go:64] FLAG: --pod-cidr="" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585308 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585313 2585 flags.go:64] FLAG: --pod-manifest-path="" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585316 2585 flags.go:64] FLAG: --pod-max-pids="-1" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585319 2585 flags.go:64] FLAG: --pods-per-core="0" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585322 2585 flags.go:64] FLAG: --port="10250" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585325 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585327 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07a847658063fb9a9" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585330 2585 flags.go:64] FLAG: --qos-reserved="" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585333 2585 flags.go:64] FLAG: --read-only-port="10255" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585336 2585 flags.go:64] FLAG: --register-node="true" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585339 2585 flags.go:64] FLAG: --register-with-taints="" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585342 2585 flags.go:64] FLAG: --registry-burst="10" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585345 2585 flags.go:64] FLAG: --registry-qps="5" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585348 2585 flags.go:64] FLAG: --reserved-cpus="" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585350 2585 flags.go:64] FLAG: --reserved-memory="" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585354 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585357 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585359 2585 flags.go:64] FLAG: --rotate-certificates="false" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585364 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585367 2585 flags.go:64] FLAG: --runonce="false" Jul 18 00:54:38.592222 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585370 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585372 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585375 2585 flags.go:64] FLAG: --seccomp-default="false" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585379 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585382 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585385 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585388 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585391 2585 flags.go:64] FLAG: --storage-driver-password="root" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585394 2585 flags.go:64] FLAG: --storage-driver-secure="false" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585397 2585 flags.go:64] FLAG: --storage-driver-table="stats" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585400 2585 flags.go:64] FLAG: --storage-driver-user="root" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585403 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585406 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585409 2585 flags.go:64] FLAG: --system-cgroups="" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585411 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585416 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585419 2585 flags.go:64] FLAG: --tls-cert-file="" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585422 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585426 2585 flags.go:64] FLAG: --tls-min-version="" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585428 2585 flags.go:64] FLAG: --tls-private-key-file="" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585431 2585 flags.go:64] FLAG: --topology-manager-policy="none" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585434 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585437 2585 flags.go:64] FLAG: --topology-manager-scope="container" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585440 2585 flags.go:64] FLAG: --v="2" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585443 2585 flags.go:64] FLAG: --version="false" Jul 18 00:54:38.593297 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585448 2585 flags.go:64] FLAG: --vmodule="" Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585451 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585454 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585581 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585585 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585589 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585594 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585597 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585600 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585603 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585607 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585610 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585612 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585615 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585618 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585620 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585623 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585626 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585628 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:38.594402 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585631 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585633 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585635 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585638 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585640 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585643 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585645 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585648 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585650 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585653 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585655 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585658 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585660 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585662 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585666 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585668 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585671 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585673 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585676 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585679 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:38.595247 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585682 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585684 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585686 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585690 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585693 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585695 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585698 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585700 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585703 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585705 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585708 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585710 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585712 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585715 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585717 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585719 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585722 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585725 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585728 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:38.596149 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585731 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585734 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585737 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585739 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585742 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585744 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585748 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585752 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585755 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585758 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585760 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585763 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585766 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585768 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585771 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585773 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585776 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585778 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585781 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585783 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:38.596649 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585785 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585788 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585790 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585792 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585795 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585797 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585800 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585802 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585804 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585807 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585809 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585811 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585814 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585816 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585818 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585821 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585823 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585826 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585829 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585831 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:38.597382 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585833 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585837 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585839 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.585841 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.585846 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.594527 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.594553 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.594579 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.594588 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594678 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594687 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594693 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594698 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594702 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:38.598241 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594707 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594712 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594716 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594721 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594726 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594730 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594735 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594740 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594744 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594749 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594753 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594758 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594763 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594768 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594772 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594777 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594781 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594785 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594789 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594793 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:38.598669 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594797 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594801 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594805 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594809 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594824 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594829 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594833 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594837 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594841 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594845 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594849 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594853 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594857 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594861 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594865 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594869 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594873 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594878 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594882 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594885 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:38.599263 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594889 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594894 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594898 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594903 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594907 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594911 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594917 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594923 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594927 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594931 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594935 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594939 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594943 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594947 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594951 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594955 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594959 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594971 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594976 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.594999 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:38.599789 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595004 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595008 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595015 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595021 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595026 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595031 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595035 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595039 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595043 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595047 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595051 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595055 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595059 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595063 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595068 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595072 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595077 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595081 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595085 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:38.600321 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595089 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595093 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595097 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595101 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595105 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595109 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595114 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595118 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595122 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595129 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595134 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595146 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595151 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595155 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:38.600775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595159 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.595167 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595383 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595393 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595398 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595403 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595407 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595412 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595416 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595421 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595425 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595430 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595434 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595439 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:38.601288 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595443 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595448 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595452 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595456 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595460 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595464 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595468 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595473 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595477 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595481 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595486 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595490 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595494 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595498 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595502 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595506 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595518 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595522 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595526 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595530 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:38.601636 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595534 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595538 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595542 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595546 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595550 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595554 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595558 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595562 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595566 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595570 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595574 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595579 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595583 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595587 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595591 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595596 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595600 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595604 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595608 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:38.602137 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595612 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595616 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595620 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595624 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595629 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595633 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595639 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595644 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595649 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595653 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595665 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595670 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595674 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595679 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595683 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595687 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595691 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595695 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595699 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595703 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:38.602593 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595707 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595711 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595715 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595719 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595723 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595728 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595734 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595744 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595749 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595753 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595758 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595762 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595767 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595771 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595775 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595779 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595784 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595788 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595792 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:38.603084 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595796 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595800 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595804 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595808 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595820 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595824 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595828 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595832 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:38.595836 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.595844 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.596050 2585 server.go:962] "Client rotation is on, will bootstrap in background" Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.599153 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.600943 2585 server.go:1019] "Starting client certificate rotation" Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.601095 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 00:54:38.603541 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.601128 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 00:54:38.604286 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.604261 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 00:54:38.610799 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.610768 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 00:54:38.622727 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.622707 2585 log.go:25] "Validated CRI v1 runtime API" Jul 18 00:54:38.625376 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.625363 2585 log.go:25] "Validated CRI v1 image API" Jul 18 00:54:38.626174 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.626159 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 18 00:54:38.631001 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.630954 2585 fs.go:135] Filesystem UUIDs: map[763583bb-bc55-4d69-9708-c704e1de9177:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 de1c2c54-1b52-437d-af16-e0f8c8163102:/dev/nvme0n1p3] Jul 18 00:54:38.631072 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.631001 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 18 00:54:38.632528 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.632513 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 00:54:38.637107 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.636974 2585 manager.go:216] Machine: {Timestamp:2026-07-18 00:54:38.635597962 +0000 UTC m=+0.374470169 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092747 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec208c22a103e64245eabb2d51525cf7 SystemUUID:ec208c22-a103-e642-45ea-bb2d51525cf7 BootID:9120d021-25ff-44c1-87d7-ab450035be69 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c7:8f:77:4d:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c7:8f:77:4d:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:19:43:98:ee:5a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 18 00:54:38.637107 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.637099 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 18 00:54:38.637253 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.637175 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 18 00:54:38.640750 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.640720 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 18 00:54:38.640893 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.640752 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-32.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 18 00:54:38.641622 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.641612 2585 topology_manager.go:138] "Creating topology manager with none policy" Jul 18 00:54:38.641659 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.641624 2585 container_manager_linux.go:309] "Creating device plugin manager" Jul 18 00:54:38.641659 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.641639 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 00:54:38.642664 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.642653 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 00:54:38.644560 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.644548 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 18 00:54:38.649275 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.649262 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 18 00:54:38.649391 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.649382 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 18 00:54:38.649421 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.649413 2585 kubelet.go:486] "Attempting to sync node with API server" Jul 18 00:54:38.649451 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.649423 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 18 00:54:38.649451 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.649443 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 18 00:54:38.649503 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.649454 2585 kubelet.go:398] "Adding apiserver pod source" Jul 18 00:54:38.649503 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.649466 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 18 00:54:38.649880 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.649861 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 00:54:38.649880 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.649881 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 00:54:38.653170 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.653151 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 18 00:54:38.655487 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.655473 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 18 00:54:38.655542 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.655504 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 18 00:54:38.656848 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656837 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 18 00:54:38.656891 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656853 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 18 00:54:38.656891 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656859 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 18 00:54:38.656891 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656865 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 18 00:54:38.656891 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656874 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 18 00:54:38.656891 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656880 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 18 00:54:38.656891 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656888 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 18 00:54:38.656891 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656894 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 18 00:54:38.657091 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656901 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 18 00:54:38.657091 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656907 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 18 00:54:38.657091 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656915 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 18 00:54:38.657091 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.656921 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 18 00:54:38.657864 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.657854 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 18 00:54:38.657864 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.657864 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 18 00:54:38.662174 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.662153 2585 server.go:1268] "Started kubelet" Jul 18 00:54:38.662483 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.662429 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 18 00:54:38.662553 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.662460 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 18 00:54:38.662553 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.662515 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 18 00:54:38.663096 ip-10-0-132-32 systemd[1]: Started Kubernetes Kubelet. Jul 18 00:54:38.664132 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.663417 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 18 00:54:38.664132 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.663601 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-32.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 18 00:54:38.665604 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.665579 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 18 00:54:38.665604 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.665599 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 18 00:54:38.665842 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.665830 2585 server.go:310] "Adding debug handlers to kubelet server" Jul 18 00:54:38.668198 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.668175 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 18 00:54:38.674571 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.673394 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-32.ec2.internal.18c33c35b0917054 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-32.ec2.internal,UID:ip-10-0-132-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-32.ec2.internal,},FirstTimestamp:2026-07-18 00:54:38.662103124 +0000 UTC m=+0.400975332,LastTimestamp:2026-07-18 00:54:38.662103124 +0000 UTC m=+0.400975332,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-32.ec2.internal,}" Jul 18 00:54:38.677377 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.677359 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-krvnm" Jul 18 00:54:38.680669 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.680645 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 18 00:54:38.680730 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.680654 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 18 00:54:38.680801 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.680781 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:38.681495 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.681477 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 18 00:54:38.681586 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.681503 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 18 00:54:38.681586 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.681550 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 18 00:54:38.681702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.681534 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 18 00:54:38.681702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.681620 2585 factory.go:55] Registering systemd factory Jul 18 00:54:38.681702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.681630 2585 factory.go:223] Registration of the systemd container factory successfully Jul 18 00:54:38.681702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.681688 2585 reconstruct.go:97] "Volume reconstruction finished" Jul 18 00:54:38.681702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.681696 2585 reconciler.go:29] "Reconciler: start to sync state" Jul 18 00:54:38.681937 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.681923 2585 factory.go:153] Registering CRI-O factory Jul 18 00:54:38.681974 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.681941 2585 factory.go:223] Registration of the crio container factory successfully Jul 18 00:54:38.681974 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.681966 2585 factory.go:103] Registering Raw factory Jul 18 00:54:38.682055 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.682001 2585 manager.go:1196] Started watching for new ooms in manager Jul 18 00:54:38.682645 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.682628 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 18 00:54:38.682684 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.682628 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 18 00:54:38.683335 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.683251 2585 manager.go:349] Starting recovery of all containers Jul 18 00:54:38.685213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.685192 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-krvnm" Jul 18 00:54:38.692718 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.692702 2585 manager.go:354] Recovery completed Jul 18 00:54:38.697218 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.697205 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:38.699150 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.699132 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:38.699230 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.699168 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:38.699230 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.699185 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:38.699714 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.699698 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 18 00:54:38.699774 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.699716 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 18 00:54:38.699774 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.699704 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:38.699774 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.699731 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 18 00:54:38.700403 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.700387 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:38.700471 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.700414 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:38.700471 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.700425 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:38.701911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.701900 2585 policy_none.go:49] "None policy: Start" Jul 18 00:54:38.701957 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.701915 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 18 00:54:38.701957 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.701926 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 18 00:54:38.703964 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.703950 2585 policy_none.go:47] "Start" Jul 18 00:54:38.751825 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.751647 2585 manager.go:337] "Starting Device Plugin manager" Jul 18 00:54:38.762256 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.751851 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 18 00:54:38.762256 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.751865 2585 server.go:87] "Starting device plugin registration server" Jul 18 00:54:38.762256 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.752185 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 18 00:54:38.762256 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.752199 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 18 00:54:38.762256 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.752308 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 18 00:54:38.762256 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.752395 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 18 00:54:38.762256 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.752404 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 18 00:54:38.762256 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.753137 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 18 00:54:38.762256 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.753182 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:38.788216 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.788181 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 18 00:54:38.789503 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.789483 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 18 00:54:38.789556 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.789539 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 18 00:54:38.789608 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.789566 2585 kubelet.go:2448] "Starting kubelet main sync loop" Jul 18 00:54:38.789654 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.789609 2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 18 00:54:38.792269 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.792250 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:54:38.852423 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.852308 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:38.853407 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.853389 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:38.853524 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.853424 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:38.853524 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.853440 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:38.853524 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.853470 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-32.ec2.internal" Jul 18 00:54:38.865252 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.865231 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-32.ec2.internal" Jul 18 00:54:38.865335 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.865257 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-32.ec2.internal\": node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:38.885111 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.885084 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:38.890628 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.890604 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-32.ec2.internal"] Jul 18 00:54:38.890749 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.890668 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:38.891609 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.891593 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:38.891698 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.891624 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:38.891698 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.891640 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:38.893963 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.893949 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:38.894083 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.894069 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" Jul 18 00:54:38.894132 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.894100 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:38.894691 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.894663 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:38.894791 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.894697 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:38.894791 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.894709 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:38.894791 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.894779 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:38.894906 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.894804 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:38.894906 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.894814 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:38.896930 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.896912 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-32.ec2.internal" Jul 18 00:54:38.897027 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.896937 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:38.897639 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.897624 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:38.897696 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.897653 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:38.897696 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.897666 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:38.922677 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.922649 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-32.ec2.internal\" not found" node="ip-10-0-132-32.ec2.internal" Jul 18 00:54:38.926885 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.926869 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-32.ec2.internal\" not found" node="ip-10-0-132-32.ec2.internal" Jul 18 00:54:38.983748 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.983718 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/537dd81a17ca652b25fa865e81ce5b47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal\" (UID: \"537dd81a17ca652b25fa865e81ce5b47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" Jul 18 00:54:38.983876 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.983755 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c304919a739b1d1733f194b8c3cd0ceb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-32.ec2.internal\" (UID: \"c304919a739b1d1733f194b8c3cd0ceb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-32.ec2.internal" Jul 18 00:54:38.983876 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:38.983773 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/537dd81a17ca652b25fa865e81ce5b47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal\" (UID: \"537dd81a17ca652b25fa865e81ce5b47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" Jul 18 00:54:38.985823 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:38.985806 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:39.084769 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.084724 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c304919a739b1d1733f194b8c3cd0ceb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-32.ec2.internal\" (UID: \"c304919a739b1d1733f194b8c3cd0ceb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-32.ec2.internal" Jul 18 00:54:39.084947 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.084782 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/537dd81a17ca652b25fa865e81ce5b47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal\" (UID: \"537dd81a17ca652b25fa865e81ce5b47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" Jul 18 00:54:39.084947 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.084806 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/537dd81a17ca652b25fa865e81ce5b47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal\" (UID: \"537dd81a17ca652b25fa865e81ce5b47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" Jul 18 00:54:39.084947 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.084838 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c304919a739b1d1733f194b8c3cd0ceb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-32.ec2.internal\" (UID: \"c304919a739b1d1733f194b8c3cd0ceb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-32.ec2.internal" Jul 18 00:54:39.084947 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.084851 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/537dd81a17ca652b25fa865e81ce5b47-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal\" (UID: \"537dd81a17ca652b25fa865e81ce5b47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" Jul 18 00:54:39.084947 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.084880 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/537dd81a17ca652b25fa865e81ce5b47-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal\" (UID: \"537dd81a17ca652b25fa865e81ce5b47\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" Jul 18 00:54:39.086858 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:39.086839 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:39.187763 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:39.187696 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:39.225899 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.225872 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" Jul 18 00:54:39.229181 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.229160 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-32.ec2.internal" Jul 18 00:54:39.288811 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:39.288778 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:39.389411 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:39.389385 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:39.489921 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:39.489851 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:39.590512 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:39.590483 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:39.599642 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.599626 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 18 00:54:39.599761 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.599742 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 00:54:39.691352 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.691319 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 00:49:39 +0000 UTC" deadline="2028-02-19 06:39:37.450982889 +0000 UTC" Jul 18 00:54:39.691352 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.691351 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13949h44m57.759634832s" Jul 18 00:54:39.691352 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:39.691332 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:39.787852 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:39.787792 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc304919a739b1d1733f194b8c3cd0ceb.slice/crio-a798c9b35bf2786c9422218e2fc9ad87af2cae43fa0e053f909e0312e3f9feb3 WatchSource:0}: Error finding container a798c9b35bf2786c9422218e2fc9ad87af2cae43fa0e053f909e0312e3f9feb3: Status 404 returned error can't find the container with id a798c9b35bf2786c9422218e2fc9ad87af2cae43fa0e053f909e0312e3f9feb3 Jul 18 00:54:39.788107 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:39.788076 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537dd81a17ca652b25fa865e81ce5b47.slice/crio-ec938d7dff4e87e23d87b355a02817d8c22994b988fa5d5c4f0297abcbc128ec WatchSource:0}: Error finding container ec938d7dff4e87e23d87b355a02817d8c22994b988fa5d5c4f0297abcbc128ec: Status 404 returned error can't find the container with id ec938d7dff4e87e23d87b355a02817d8c22994b988fa5d5c4f0297abcbc128ec Jul 18 00:54:39.791461 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:39.791438 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:39.793277 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.793230 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" event={"ID":"537dd81a17ca652b25fa865e81ce5b47","Type":"ContainerStarted","Data":"ec938d7dff4e87e23d87b355a02817d8c22994b988fa5d5c4f0297abcbc128ec"} Jul 18 00:54:39.793738 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.793724 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 00:54:39.794400 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.794381 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-32.ec2.internal" event={"ID":"c304919a739b1d1733f194b8c3cd0ceb","Type":"ContainerStarted","Data":"a798c9b35bf2786c9422218e2fc9ad87af2cae43fa0e053f909e0312e3f9feb3"} Jul 18 00:54:39.891805 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:39.891760 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:39.982316 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:39.982284 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:54:39.992135 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:39.992111 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-32.ec2.internal\" not found" Jul 18 00:54:40.003313 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.003293 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:54:40.004517 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.004502 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:54:40.081196 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.081116 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-32.ec2.internal" Jul 18 00:54:40.090688 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.090666 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 00:54:40.091794 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.091781 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" Jul 18 00:54:40.102369 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.102347 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 00:54:40.552217 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.551942 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:54:40.650510 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.650466 2585 apiserver.go:52] "Watching apiserver" Jul 18 00:54:40.659377 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.659347 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 18 00:54:40.660597 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.660568 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal","openshift-multus/multus-additional-cni-plugins-2984k","openshift-multus/network-metrics-daemon-rhg65","openshift-network-diagnostics/network-check-target-4qzlg","kube-system/global-pull-secret-syncer-8nphz","kube-system/konnectivity-agent-rzpmd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf","openshift-dns/node-resolver-zdrj5","openshift-multus/multus-dvg9j","openshift-network-operator/iptables-alerter-l6plv","openshift-ovn-kubernetes/ovnkube-node-2kwdv","kube-system/kube-apiserver-proxy-ip-10-0-132-32.ec2.internal","openshift-cluster-node-tuning-operator/tuned-85wmf","openshift-image-registry/node-ca-j8lkk"] Jul 18 00:54:40.663524 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.663502 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.665811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.665786 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.666394 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.666194 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 18 00:54:40.666394 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.666267 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 18 00:54:40.666394 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.666328 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qvdrm\"" Jul 18 00:54:40.666625 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.666443 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 18 00:54:40.668712 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.668253 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:40.668712 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:40.668330 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:54:40.668712 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.668585 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:54:40.668907 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.668873 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rxr25\"" Jul 18 00:54:40.668966 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.668944 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 18 00:54:40.670630 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.670609 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:40.670725 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:40.670688 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:54:40.673642 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.673266 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:40.673642 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:40.673339 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:54:40.675596 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.675360 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:54:40.677654 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.677635 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 18 00:54:40.677930 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.677913 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 18 00:54:40.678126 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.678103 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b9xjd\"" Jul 18 00:54:40.678210 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.678169 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.680292 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.680271 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j8lkk" Jul 18 00:54:40.681130 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.680640 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 18 00:54:40.681130 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.680735 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 18 00:54:40.681130 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.680755 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 18 00:54:40.681130 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.680852 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 18 00:54:40.681130 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.680871 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vm5f4\"" Jul 18 00:54:40.681130 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.680951 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 18 00:54:40.684031 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.684010 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.684815 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.684793 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 18 00:54:40.684978 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.684958 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 18 00:54:40.685053 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.685038 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 18 00:54:40.685711 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.685677 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ztncn\"" Jul 18 00:54:40.687204 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.687181 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l6plv" Jul 18 00:54:40.687985 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.687964 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 18 00:54:40.689426 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.689403 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 18 00:54:40.689669 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.689651 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ncdnl\"" Jul 18 00:54:40.690407 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.690377 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.690949 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.690921 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 18 00:54:40.691686 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.691663 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:54:40.691782 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.691744 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 18 00:54:40.691895 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.691875 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t6frr\"" Jul 18 00:54:40.693734 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693707 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-kubernetes\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.693841 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693754 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64302c11-8b83-4992-bf49-089c75a48e2e-kubelet-config\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:40.693841 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693779 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:40.693841 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693798 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-device-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.693841 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693815 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-os-release\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.693841 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693829 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-socket-dir-parent\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693844 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-var-lib-kubelet\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693862 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-host\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693881 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693904 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b09f54df-61eb-4b1b-bef8-06f18f9a5944-konnectivity-ca\") pod \"konnectivity-agent-rzpmd\" (UID: \"b09f54df-61eb-4b1b-bef8-06f18f9a5944\") " pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693925 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-os-release\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693940 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-run-k8s-cni-cncf-io\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693955 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-lib-modules\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693971 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.693987 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-cni-dir\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694016 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-var-lib-cni-bin\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694032 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-run\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694049 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-sys\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694072 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-system-cni-dir\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694102 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-daemon-config\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.694133 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694127 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-modprobe-d\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694172 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89xg9\" (UniqueName: \"kubernetes.io/projected/ad532d7f-9846-4831-a19a-ae39b26be8b0-kube-api-access-89xg9\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694231 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694258 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-cnibin\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694284 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jl7s\" (UniqueName: \"kubernetes.io/projected/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-kube-api-access-7jl7s\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694285 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zdrj5" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694322 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694353 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-registration-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694405 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b09f54df-61eb-4b1b-bef8-06f18f9a5944-agent-certs\") pod \"konnectivity-agent-rzpmd\" (UID: \"b09f54df-61eb-4b1b-bef8-06f18f9a5944\") " pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694433 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-sysconfig\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694470 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-tuned\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694495 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b445\" (UniqueName: \"kubernetes.io/projected/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-kube-api-access-8b445\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694524 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-socket-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694544 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-var-lib-cni-multus\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694582 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-sysctl-conf\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694608 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-systemd\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694631 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9474dba-cf39-4e3d-b0af-e7efbdfdb495-host\") pod \"node-ca-j8lkk\" (UID: \"b9474dba-cf39-4e3d-b0af-e7efbdfdb495\") " pod="openshift-image-registry/node-ca-j8lkk" Jul 18 00:54:40.694878 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694653 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-sys-fs\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694675 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-var-lib-kubelet\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694699 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-conf-dir\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694735 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-sysctl-d\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694760 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7nrx\" (UniqueName: \"kubernetes.io/projected/b9474dba-cf39-4e3d-b0af-e7efbdfdb495-kube-api-access-t7nrx\") pod \"node-ca-j8lkk\" (UID: \"b9474dba-cf39-4e3d-b0af-e7efbdfdb495\") " pod="openshift-image-registry/node-ca-j8lkk" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694783 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-run-netns\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694806 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-cnibin\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694831 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chm2s\" (UniqueName: \"kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s\") pod \"network-check-target-4qzlg\" (UID: \"c117f41a-3ee9-41f6-a06f-96a3edf042d2\") " pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694853 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-run-multus-certs\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694876 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694900 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-system-cni-dir\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694924 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-cni-binary-copy\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694945 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad532d7f-9846-4831-a19a-ae39b26be8b0-tmp\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694967 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq7ld\" (UniqueName: \"kubernetes.io/projected/c29e5d41-e606-437c-8a87-3b5b002ead5d-kube-api-access-dq7ld\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.694989 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9474dba-cf39-4e3d-b0af-e7efbdfdb495-serviceca\") pod \"node-ca-j8lkk\" (UID: \"b9474dba-cf39-4e3d-b0af-e7efbdfdb495\") " pod="openshift-image-registry/node-ca-j8lkk" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695013 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.695778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695036 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbnf5\" (UniqueName: \"kubernetes.io/projected/d013f410-edd6-4cad-b4df-4009227ca9e4-kube-api-access-sbnf5\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695078 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695103 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-etc-kubernetes\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695126 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64302c11-8b83-4992-bf49-089c75a48e2e-dbus\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695147 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-hostroot\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695511 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695595 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695699 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695869 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695932 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.695987 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.696127 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.696131 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c27c7\"" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.696552 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 18 00:54:40.696573 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.696569 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 18 00:54:40.697330 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.696639 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rqbqs\"" Jul 18 00:54:40.723005 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.722952 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfjt7" Jul 18 00:54:40.732904 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.732881 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfjt7" Jul 18 00:54:40.783268 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.783236 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 18 00:54:40.795367 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795334 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-cnibin\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.795562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795378 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chm2s\" (UniqueName: \"kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s\") pod \"network-check-target-4qzlg\" (UID: \"c117f41a-3ee9-41f6-a06f-96a3edf042d2\") " pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:40.795562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795407 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-run-multus-certs\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.795562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795483 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-run-multus-certs\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.795562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795483 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-cnibin\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.795793 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795567 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-log-socket\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.795793 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795604 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5cjw\" (UniqueName: \"kubernetes.io/projected/9f675299-7395-4d54-8b9b-7bb19ffd11d9-kube-api-access-j5cjw\") pod \"node-resolver-zdrj5\" (UID: \"9f675299-7395-4d54-8b9b-7bb19ffd11d9\") " pod="openshift-dns/node-resolver-zdrj5" Jul 18 00:54:40.795793 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795637 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:40.795793 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795678 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-system-cni-dir\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.795793 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795714 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-cni-binary-copy\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.795793 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795734 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-run-systemd\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.795793 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795751 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/334a91d8-80d6-40f9-9e09-bc6615534f78-ovnkube-config\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.795793 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:40.795754 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:40.795793 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795768 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/334a91d8-80d6-40f9-9e09-bc6615534f78-env-overrides\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.795793 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795775 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-system-cni-dir\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.795793 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795784 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6lfk\" (UniqueName: \"kubernetes.io/projected/334a91d8-80d6-40f9-9e09-bc6615534f78-kube-api-access-c6lfk\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795818 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad532d7f-9846-4831-a19a-ae39b26be8b0-tmp\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:40.795867 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs podName:c29e5d41-e606-437c-8a87-3b5b002ead5d nodeName:}" failed. No retries permitted until 2026-07-18 00:54:41.295842641 +0000 UTC m=+3.034714861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs") pod "network-metrics-daemon-rhg65" (UID: "c29e5d41-e606-437c-8a87-3b5b002ead5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795898 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq7ld\" (UniqueName: \"kubernetes.io/projected/c29e5d41-e606-437c-8a87-3b5b002ead5d-kube-api-access-dq7ld\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795945 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9474dba-cf39-4e3d-b0af-e7efbdfdb495-serviceca\") pod \"node-ca-j8lkk\" (UID: \"b9474dba-cf39-4e3d-b0af-e7efbdfdb495\") " pod="openshift-image-registry/node-ca-j8lkk" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.795962 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796014 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbnf5\" (UniqueName: \"kubernetes.io/projected/d013f410-edd6-4cad-b4df-4009227ca9e4-kube-api-access-sbnf5\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796032 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9a57ffb-4dfa-4d54-be2d-5446746c3380-iptables-alerter-script\") pod \"iptables-alerter-l6plv\" (UID: \"b9a57ffb-4dfa-4d54-be2d-5446746c3380\") " pod="openshift-network-operator/iptables-alerter-l6plv" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796048 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796158 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-etc-kubernetes\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796160 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796182 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-run-netns\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796209 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-run-ovn-kubernetes\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796228 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f675299-7395-4d54-8b9b-7bb19ffd11d9-tmp-dir\") pod \"node-resolver-zdrj5\" (UID: \"9f675299-7395-4d54-8b9b-7bb19ffd11d9\") " pod="openshift-dns/node-resolver-zdrj5" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796223 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-cni-binary-copy\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796302 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-etc-kubernetes\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.796371 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796341 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796397 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64302c11-8b83-4992-bf49-089c75a48e2e-dbus\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796421 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-hostroot\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796443 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9474dba-cf39-4e3d-b0af-e7efbdfdb495-serviceca\") pod \"node-ca-j8lkk\" (UID: \"b9474dba-cf39-4e3d-b0af-e7efbdfdb495\") " pod="openshift-image-registry/node-ca-j8lkk" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796451 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/334a91d8-80d6-40f9-9e09-bc6615534f78-ovnkube-script-lib\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796482 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-kubernetes\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796548 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64302c11-8b83-4992-bf49-089c75a48e2e-kubelet-config\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796557 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-kubernetes\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796559 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-hostroot\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796594 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796682 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64302c11-8b83-4992-bf49-089c75a48e2e-dbus\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796731 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-device-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796758 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-os-release\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:40.796767 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796793 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-socket-dir-parent\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796857 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-socket-dir-parent\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:40.796874 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret podName:64302c11-8b83-4992-bf49-089c75a48e2e nodeName:}" failed. No retries permitted until 2026-07-18 00:54:41.296813414 +0000 UTC m=+3.035685681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret") pod "global-pull-secret-syncer-8nphz" (UID: "64302c11-8b83-4992-bf49-089c75a48e2e") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:40.797213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796900 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-kubelet\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796933 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-var-lib-kubelet\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796979 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-host\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797000 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-var-lib-kubelet\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797031 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797057 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b09f54df-61eb-4b1b-bef8-06f18f9a5944-konnectivity-ca\") pod \"konnectivity-agent-rzpmd\" (UID: \"b09f54df-61eb-4b1b-bef8-06f18f9a5944\") " pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797082 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797095 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-os-release\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797117 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-run-k8s-cni-cncf-io\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.796609 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64302c11-8b83-4992-bf49-089c75a48e2e-kubelet-config\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797142 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-cni-bin\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797156 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-host\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797185 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-run-k8s-cni-cncf-io\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797220 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797243 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-lib-modules\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797271 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797280 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-device-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.798121 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797289 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-os-release\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797291 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-cni-dir\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797291 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797334 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-cni-dir\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797335 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-var-lib-cni-bin\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797379 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-run\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797383 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-os-release\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797403 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-lib-modules\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797411 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-sys\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797394 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797421 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-var-lib-cni-bin\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797443 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-system-cni-dir\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797456 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-run\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797459 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-sys\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797489 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-daemon-config\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797491 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-system-cni-dir\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797513 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/334a91d8-80d6-40f9-9e09-bc6615534f78-ovn-node-metrics-cert\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797539 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-modprobe-d\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.798956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797581 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89xg9\" (UniqueName: \"kubernetes.io/projected/ad532d7f-9846-4831-a19a-ae39b26be8b0-kube-api-access-89xg9\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797612 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-modprobe-d\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797679 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797706 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-cnibin\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797718 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b09f54df-61eb-4b1b-bef8-06f18f9a5944-konnectivity-ca\") pod \"konnectivity-agent-rzpmd\" (UID: \"b09f54df-61eb-4b1b-bef8-06f18f9a5944\") " pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797722 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jl7s\" (UniqueName: \"kubernetes.io/projected/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-kube-api-access-7jl7s\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797777 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9a57ffb-4dfa-4d54-be2d-5446746c3380-host-slash\") pod \"iptables-alerter-l6plv\" (UID: \"b9a57ffb-4dfa-4d54-be2d-5446746c3380\") " pod="openshift-network-operator/iptables-alerter-l6plv" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797801 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-cnibin\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797804 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-slash\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797843 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797872 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-registration-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797901 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b09f54df-61eb-4b1b-bef8-06f18f9a5944-agent-certs\") pod \"konnectivity-agent-rzpmd\" (UID: \"b09f54df-61eb-4b1b-bef8-06f18f9a5944\") " pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797927 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-systemd-units\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797952 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-node-log\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797958 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-registration-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.797978 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-cni-netd\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798004 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f675299-7395-4d54-8b9b-7bb19ffd11d9-hosts-file\") pod \"node-resolver-zdrj5\" (UID: \"9f675299-7395-4d54-8b9b-7bb19ffd11d9\") " pod="openshift-dns/node-resolver-zdrj5" Jul 18 00:54:40.799702 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798030 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-sysconfig\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798055 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-tuned\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798110 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b445\" (UniqueName: \"kubernetes.io/projected/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-kube-api-access-8b445\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798135 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-socket-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798160 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-var-lib-cni-multus\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798164 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798189 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-etc-openvswitch\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798215 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-run-ovn\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798235 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-sysconfig\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798243 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-sysctl-conf\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798294 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-socket-dir\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798313 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-var-lib-cni-multus\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798301 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-systemd\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798350 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-systemd\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798355 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9474dba-cf39-4e3d-b0af-e7efbdfdb495-host\") pod \"node-ca-j8lkk\" (UID: \"b9474dba-cf39-4e3d-b0af-e7efbdfdb495\") " pod="openshift-image-registry/node-ca-j8lkk" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798385 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798392 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9474dba-cf39-4e3d-b0af-e7efbdfdb495-host\") pod \"node-ca-j8lkk\" (UID: \"b9474dba-cf39-4e3d-b0af-e7efbdfdb495\") " pod="openshift-image-registry/node-ca-j8lkk" Jul 18 00:54:40.800441 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798387 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-sys-fs\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798188 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-daemon-config\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798429 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-var-lib-kubelet\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798446 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-conf-dir\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798463 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-run-openvswitch\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798479 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-sysctl-d\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798495 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7nrx\" (UniqueName: \"kubernetes.io/projected/b9474dba-cf39-4e3d-b0af-e7efbdfdb495-kube-api-access-t7nrx\") pod \"node-ca-j8lkk\" (UID: \"b9474dba-cf39-4e3d-b0af-e7efbdfdb495\") " pod="openshift-image-registry/node-ca-j8lkk" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798510 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-run-netns\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798527 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn52j\" (UniqueName: \"kubernetes.io/projected/b9a57ffb-4dfa-4d54-be2d-5446746c3380-kube-api-access-mn52j\") pod \"iptables-alerter-l6plv\" (UID: \"b9a57ffb-4dfa-4d54-be2d-5446746c3380\") " pod="openshift-network-operator/iptables-alerter-l6plv" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798528 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-sysctl-conf\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798559 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-var-lib-openvswitch\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798568 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-var-lib-kubelet\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798428 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d013f410-edd6-4cad-b4df-4009227ca9e4-sys-fs\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798665 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-multus-conf-dir\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798703 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-host-run-netns\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.798796 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-sysctl-d\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.801310 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad532d7f-9846-4831-a19a-ae39b26be8b0-tmp\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.801337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.801331 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad532d7f-9846-4831-a19a-ae39b26be8b0-etc-tuned\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.802255 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.801671 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b09f54df-61eb-4b1b-bef8-06f18f9a5944-agent-certs\") pod \"konnectivity-agent-rzpmd\" (UID: \"b09f54df-61eb-4b1b-bef8-06f18f9a5944\") " pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:54:40.804839 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:40.803727 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:54:40.804839 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:40.803752 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:54:40.804839 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:40.803767 2585 projected.go:196] Error preparing data for projected volume kube-api-access-chm2s for pod openshift-network-diagnostics/network-check-target-4qzlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:40.804839 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:40.803858 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s podName:c117f41a-3ee9-41f6-a06f-96a3edf042d2 nodeName:}" failed. No retries permitted until 2026-07-18 00:54:41.303840292 +0000 UTC m=+3.042712503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-chm2s" (UniqueName: "kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s") pod "network-check-target-4qzlg" (UID: "c117f41a-3ee9-41f6-a06f-96a3edf042d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:40.807111 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.807083 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbnf5\" (UniqueName: \"kubernetes.io/projected/d013f410-edd6-4cad-b4df-4009227ca9e4-kube-api-access-sbnf5\") pod \"aws-ebs-csi-driver-node-6qvxf\" (UID: \"d013f410-edd6-4cad-b4df-4009227ca9e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.808282 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.808254 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq7ld\" (UniqueName: \"kubernetes.io/projected/c29e5d41-e606-437c-8a87-3b5b002ead5d-kube-api-access-dq7ld\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:40.808646 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.808624 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89xg9\" (UniqueName: \"kubernetes.io/projected/ad532d7f-9846-4831-a19a-ae39b26be8b0-kube-api-access-89xg9\") pod \"tuned-85wmf\" (UID: \"ad532d7f-9846-4831-a19a-ae39b26be8b0\") " pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:40.808912 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.808894 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b445\" (UniqueName: \"kubernetes.io/projected/b4af8641-1c51-4e5a-baa5-8c634b2c7b4f-kube-api-access-8b445\") pod \"multus-additional-cni-plugins-2984k\" (UID: \"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f\") " pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:40.809941 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.809915 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7nrx\" (UniqueName: \"kubernetes.io/projected/b9474dba-cf39-4e3d-b0af-e7efbdfdb495-kube-api-access-t7nrx\") pod \"node-ca-j8lkk\" (UID: \"b9474dba-cf39-4e3d-b0af-e7efbdfdb495\") " pod="openshift-image-registry/node-ca-j8lkk" Jul 18 00:54:40.810347 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.810326 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jl7s\" (UniqueName: \"kubernetes.io/projected/6cfa5075-7004-43bd-8c6a-da34cff6a4d2-kube-api-access-7jl7s\") pod \"multus-dvg9j\" (UID: \"6cfa5075-7004-43bd-8c6a-da34cff6a4d2\") " pod="openshift-multus/multus-dvg9j" Jul 18 00:54:40.899001 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.898949 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-cni-bin\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899001 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.898988 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899205 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899038 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/334a91d8-80d6-40f9-9e09-bc6615534f78-ovn-node-metrics-cert\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899205 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899057 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-cni-bin\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899205 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899069 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9a57ffb-4dfa-4d54-be2d-5446746c3380-host-slash\") pod \"iptables-alerter-l6plv\" (UID: \"b9a57ffb-4dfa-4d54-be2d-5446746c3380\") " pod="openshift-network-operator/iptables-alerter-l6plv" Jul 18 00:54:40.899205 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899092 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-slash\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899205 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899115 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899205 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899121 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-systemd-units\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899205 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899145 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-node-log\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899205 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899163 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b9a57ffb-4dfa-4d54-be2d-5446746c3380-host-slash\") pod \"iptables-alerter-l6plv\" (UID: \"b9a57ffb-4dfa-4d54-be2d-5446746c3380\") " pod="openshift-network-operator/iptables-alerter-l6plv" Jul 18 00:54:40.899205 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899170 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-cni-netd\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899208 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-systemd-units\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899220 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-cni-netd\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899234 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f675299-7395-4d54-8b9b-7bb19ffd11d9-hosts-file\") pod \"node-resolver-zdrj5\" (UID: \"9f675299-7395-4d54-8b9b-7bb19ffd11d9\") " pod="openshift-dns/node-resolver-zdrj5" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899265 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-node-log\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899300 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-etc-openvswitch\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899318 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9f675299-7395-4d54-8b9b-7bb19ffd11d9-hosts-file\") pod \"node-resolver-zdrj5\" (UID: \"9f675299-7395-4d54-8b9b-7bb19ffd11d9\") " pod="openshift-dns/node-resolver-zdrj5" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899264 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-etc-openvswitch\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899337 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-slash\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899354 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-run-ovn\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899376 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-run-openvswitch\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899393 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn52j\" (UniqueName: \"kubernetes.io/projected/b9a57ffb-4dfa-4d54-be2d-5446746c3380-kube-api-access-mn52j\") pod \"iptables-alerter-l6plv\" (UID: \"b9a57ffb-4dfa-4d54-be2d-5446746c3380\") " pod="openshift-network-operator/iptables-alerter-l6plv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899409 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-var-lib-openvswitch\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899449 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-log-socket\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899475 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5cjw\" (UniqueName: \"kubernetes.io/projected/9f675299-7395-4d54-8b9b-7bb19ffd11d9-kube-api-access-j5cjw\") pod \"node-resolver-zdrj5\" (UID: \"9f675299-7395-4d54-8b9b-7bb19ffd11d9\") " pod="openshift-dns/node-resolver-zdrj5" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899480 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-run-ovn\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899516 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-run-systemd\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899531 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-log-socket\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.899562 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899450 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-run-openvswitch\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899544 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-var-lib-openvswitch\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899578 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/334a91d8-80d6-40f9-9e09-bc6615534f78-ovnkube-config\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899604 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/334a91d8-80d6-40f9-9e09-bc6615534f78-env-overrides\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899618 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-run-systemd\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899628 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6lfk\" (UniqueName: \"kubernetes.io/projected/334a91d8-80d6-40f9-9e09-bc6615534f78-kube-api-access-c6lfk\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899684 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9a57ffb-4dfa-4d54-be2d-5446746c3380-iptables-alerter-script\") pod \"iptables-alerter-l6plv\" (UID: \"b9a57ffb-4dfa-4d54-be2d-5446746c3380\") " pod="openshift-network-operator/iptables-alerter-l6plv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899710 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-run-netns\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899733 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-run-ovn-kubernetes\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899769 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f675299-7395-4d54-8b9b-7bb19ffd11d9-tmp-dir\") pod \"node-resolver-zdrj5\" (UID: \"9f675299-7395-4d54-8b9b-7bb19ffd11d9\") " pod="openshift-dns/node-resolver-zdrj5" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899804 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/334a91d8-80d6-40f9-9e09-bc6615534f78-ovnkube-script-lib\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899853 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-kubelet\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899926 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-run-ovn-kubernetes\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.899941 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-kubelet\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.900234 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/334a91d8-80d6-40f9-9e09-bc6615534f78-env-overrides\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.900279 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/334a91d8-80d6-40f9-9e09-bc6615534f78-ovnkube-config\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.900296 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/334a91d8-80d6-40f9-9e09-bc6615534f78-host-run-netns\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.900632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.900315 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f675299-7395-4d54-8b9b-7bb19ffd11d9-tmp-dir\") pod \"node-resolver-zdrj5\" (UID: \"9f675299-7395-4d54-8b9b-7bb19ffd11d9\") " pod="openshift-dns/node-resolver-zdrj5" Jul 18 00:54:40.901496 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.900541 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b9a57ffb-4dfa-4d54-be2d-5446746c3380-iptables-alerter-script\") pod \"iptables-alerter-l6plv\" (UID: \"b9a57ffb-4dfa-4d54-be2d-5446746c3380\") " pod="openshift-network-operator/iptables-alerter-l6plv" Jul 18 00:54:40.901496 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.900687 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/334a91d8-80d6-40f9-9e09-bc6615534f78-ovnkube-script-lib\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.902252 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.902230 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/334a91d8-80d6-40f9-9e09-bc6615534f78-ovn-node-metrics-cert\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.911921 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.911893 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6lfk\" (UniqueName: \"kubernetes.io/projected/334a91d8-80d6-40f9-9e09-bc6615534f78-kube-api-access-c6lfk\") pod \"ovnkube-node-2kwdv\" (UID: \"334a91d8-80d6-40f9-9e09-bc6615534f78\") " pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:40.913347 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.913324 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn52j\" (UniqueName: \"kubernetes.io/projected/b9a57ffb-4dfa-4d54-be2d-5446746c3380-kube-api-access-mn52j\") pod \"iptables-alerter-l6plv\" (UID: \"b9a57ffb-4dfa-4d54-be2d-5446746c3380\") " pod="openshift-network-operator/iptables-alerter-l6plv" Jul 18 00:54:40.913741 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.913719 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5cjw\" (UniqueName: \"kubernetes.io/projected/9f675299-7395-4d54-8b9b-7bb19ffd11d9-kube-api-access-j5cjw\") pod \"node-resolver-zdrj5\" (UID: \"9f675299-7395-4d54-8b9b-7bb19ffd11d9\") " pod="openshift-dns/node-resolver-zdrj5" Jul 18 00:54:40.977939 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.977899 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" Jul 18 00:54:40.990906 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:40.990874 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-85wmf" Jul 18 00:54:41.004164 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.004138 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dvg9j" Jul 18 00:54:41.007920 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.007902 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:54:41.015746 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.015725 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j8lkk" Jul 18 00:54:41.023756 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.023729 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2984k" Jul 18 00:54:41.032672 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.032653 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l6plv" Jul 18 00:54:41.040844 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.040824 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:54:41.045796 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.045771 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zdrj5" Jul 18 00:54:41.303952 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.303915 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:41.304114 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.303981 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chm2s\" (UniqueName: \"kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s\") pod \"network-check-target-4qzlg\" (UID: \"c117f41a-3ee9-41f6-a06f-96a3edf042d2\") " pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:41.304114 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.304025 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:41.304222 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:41.304116 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:41.304222 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:41.304126 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:41.304222 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:41.304130 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:54:41.304222 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:41.304193 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs podName:c29e5d41-e606-437c-8a87-3b5b002ead5d nodeName:}" failed. No retries permitted until 2026-07-18 00:54:42.304170593 +0000 UTC m=+4.043042822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs") pod "network-metrics-daemon-rhg65" (UID: "c29e5d41-e606-437c-8a87-3b5b002ead5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:41.304222 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:41.304199 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:54:41.304222 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:41.304213 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret podName:64302c11-8b83-4992-bf49-089c75a48e2e nodeName:}" failed. No retries permitted until 2026-07-18 00:54:42.304202651 +0000 UTC m=+4.043074852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret") pod "global-pull-secret-syncer-8nphz" (UID: "64302c11-8b83-4992-bf49-089c75a48e2e") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:41.304222 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:41.304213 2585 projected.go:196] Error preparing data for projected volume kube-api-access-chm2s for pod openshift-network-diagnostics/network-check-target-4qzlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:41.304521 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:41.304261 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s podName:c117f41a-3ee9-41f6-a06f-96a3edf042d2 nodeName:}" failed. No retries permitted until 2026-07-18 00:54:42.304245418 +0000 UTC m=+4.043117617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-chm2s" (UniqueName: "kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s") pod "network-check-target-4qzlg" (UID: "c117f41a-3ee9-41f6-a06f-96a3edf042d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:41.736273 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.736174 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:49:41 +0000 UTC" deadline="2028-03-10 21:35:36.50578733 +0000 UTC" Jul 18 00:54:41.736273 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.736211 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14444h40m54.76958173s" Jul 18 00:54:41.790761 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:41.790725 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:41.790948 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:41.790873 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:54:41.896107 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:41.896070 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod334a91d8_80d6_40f9_9e09_bc6615534f78.slice/crio-e231e71a0fc971c64ac871e6e7ee18e80fdb6e0f2db0bd9a3818ee582c549c72 WatchSource:0}: Error finding container e231e71a0fc971c64ac871e6e7ee18e80fdb6e0f2db0bd9a3818ee582c549c72: Status 404 returned error can't find the container with id e231e71a0fc971c64ac871e6e7ee18e80fdb6e0f2db0bd9a3818ee582c549c72 Jul 18 00:54:41.897377 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:41.897350 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09f54df_61eb_4b1b_bef8_06f18f9a5944.slice/crio-46b13ca361478fcd365af67823f3847961bb5eb5af762daa96c9e5bf6d79aa53 WatchSource:0}: Error finding container 46b13ca361478fcd365af67823f3847961bb5eb5af762daa96c9e5bf6d79aa53: Status 404 returned error can't find the container with id 46b13ca361478fcd365af67823f3847961bb5eb5af762daa96c9e5bf6d79aa53 Jul 18 00:54:41.898852 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:41.898830 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9474dba_cf39_4e3d_b0af_e7efbdfdb495.slice/crio-9e75575b74cdccd399e8024b8ff18fd4210ef6fac17a85c222a8f34c4d53a11b WatchSource:0}: Error finding container 9e75575b74cdccd399e8024b8ff18fd4210ef6fac17a85c222a8f34c4d53a11b: Status 404 returned error can't find the container with id 9e75575b74cdccd399e8024b8ff18fd4210ef6fac17a85c222a8f34c4d53a11b Jul 18 00:54:41.902501 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:41.902477 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfa5075_7004_43bd_8c6a_da34cff6a4d2.slice/crio-171280573a735a1395f41cb3620c1b12e28f18ce5db7ca92d5e51acaac913224 WatchSource:0}: Error finding container 171280573a735a1395f41cb3620c1b12e28f18ce5db7ca92d5e51acaac913224: Status 404 returned error can't find the container with id 171280573a735a1395f41cb3620c1b12e28f18ce5db7ca92d5e51acaac913224 Jul 18 00:54:41.903358 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:41.903334 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4af8641_1c51_4e5a_baa5_8c634b2c7b4f.slice/crio-57005236e6c53a8bf66d3e82027decc9c3ec3a2a14d0931fcde5ea2ac86b0328 WatchSource:0}: Error finding container 57005236e6c53a8bf66d3e82027decc9c3ec3a2a14d0931fcde5ea2ac86b0328: Status 404 returned error can't find the container with id 57005236e6c53a8bf66d3e82027decc9c3ec3a2a14d0931fcde5ea2ac86b0328 Jul 18 00:54:41.907591 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:54:41.906077 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad532d7f_9846_4831_a19a_ae39b26be8b0.slice/crio-57e610c74ccdaea8d2c9f1e6eccbdcded88262960454bdee5b4d3fb33cfc8345 WatchSource:0}: Error finding container 57e610c74ccdaea8d2c9f1e6eccbdcded88262960454bdee5b4d3fb33cfc8345: Status 404 returned error can't find the container with id 57e610c74ccdaea8d2c9f1e6eccbdcded88262960454bdee5b4d3fb33cfc8345 Jul 18 00:54:42.312711 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.312428 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chm2s\" (UniqueName: \"kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s\") pod \"network-check-target-4qzlg\" (UID: \"c117f41a-3ee9-41f6-a06f-96a3edf042d2\") " pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:42.312711 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.312740 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:42.312976 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:42.312596 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:54:42.312976 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:42.312815 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:54:42.312976 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:42.312832 2585 projected.go:196] Error preparing data for projected volume kube-api-access-chm2s for pod openshift-network-diagnostics/network-check-target-4qzlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:42.312976 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:42.312867 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:42.312976 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.312779 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:42.312976 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:42.312912 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:42.312976 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:42.312932 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret podName:64302c11-8b83-4992-bf49-089c75a48e2e nodeName:}" failed. No retries permitted until 2026-07-18 00:54:44.312913943 +0000 UTC m=+6.051786155 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret") pod "global-pull-secret-syncer-8nphz" (UID: "64302c11-8b83-4992-bf49-089c75a48e2e") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:42.312976 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:42.312957 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s podName:c117f41a-3ee9-41f6-a06f-96a3edf042d2 nodeName:}" failed. No retries permitted until 2026-07-18 00:54:44.312945294 +0000 UTC m=+6.051817497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-chm2s" (UniqueName: "kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s") pod "network-check-target-4qzlg" (UID: "c117f41a-3ee9-41f6-a06f-96a3edf042d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:42.312976 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:42.312974 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs podName:c29e5d41-e606-437c-8a87-3b5b002ead5d nodeName:}" failed. No retries permitted until 2026-07-18 00:54:44.312964007 +0000 UTC m=+6.051836208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs") pod "network-metrics-daemon-rhg65" (UID: "c29e5d41-e606-437c-8a87-3b5b002ead5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:42.737302 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.737177 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:49:41 +0000 UTC" deadline="2028-03-13 20:06:53.643359471 +0000 UTC" Jul 18 00:54:42.737302 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.737247 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14515h12m10.906116557s" Jul 18 00:54:42.792939 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.790882 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:42.792939 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:42.791013 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:54:42.792939 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.792777 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:42.792939 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:42.792883 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:54:42.825736 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.825650 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dvg9j" event={"ID":"6cfa5075-7004-43bd-8c6a-da34cff6a4d2","Type":"ContainerStarted","Data":"171280573a735a1395f41cb3620c1b12e28f18ce5db7ca92d5e51acaac913224"} Jul 18 00:54:42.834713 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.834624 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j8lkk" event={"ID":"b9474dba-cf39-4e3d-b0af-e7efbdfdb495","Type":"ContainerStarted","Data":"9e75575b74cdccd399e8024b8ff18fd4210ef6fac17a85c222a8f34c4d53a11b"} Jul 18 00:54:42.859576 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.859538 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-32.ec2.internal" event={"ID":"c304919a739b1d1733f194b8c3cd0ceb","Type":"ContainerStarted","Data":"89c24546b36666855090c043b2fca904c7135025196352ba38900441f148c234"} Jul 18 00:54:42.865956 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.865881 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" event={"ID":"d013f410-edd6-4cad-b4df-4009227ca9e4","Type":"ContainerStarted","Data":"d7ebbbed789292a00ae6deff419af04b5c6b0a5ac28ec2ab47284e3b68122903"} Jul 18 00:54:42.874897 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.874793 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l6plv" event={"ID":"b9a57ffb-4dfa-4d54-be2d-5446746c3380","Type":"ContainerStarted","Data":"582bcfe8fe54fac76adb6de73083f328d19738d6db4690bc8ab07190e61c2de5"} Jul 18 00:54:42.880164 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.880039 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-32.ec2.internal" podStartSLOduration=2.8800198999999997 podStartE2EDuration="2.8800199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:54:42.879139744 +0000 UTC m=+4.618011965" watchObservedRunningTime="2026-07-18 00:54:42.8800199 +0000 UTC m=+4.618892121" Jul 18 00:54:42.890018 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.889984 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-85wmf" event={"ID":"ad532d7f-9846-4831-a19a-ae39b26be8b0","Type":"ContainerStarted","Data":"57e610c74ccdaea8d2c9f1e6eccbdcded88262960454bdee5b4d3fb33cfc8345"} Jul 18 00:54:42.897391 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.897327 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rzpmd" event={"ID":"b09f54df-61eb-4b1b-bef8-06f18f9a5944","Type":"ContainerStarted","Data":"46b13ca361478fcd365af67823f3847961bb5eb5af762daa96c9e5bf6d79aa53"} Jul 18 00:54:42.901201 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.901064 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" event={"ID":"334a91d8-80d6-40f9-9e09-bc6615534f78","Type":"ContainerStarted","Data":"e231e71a0fc971c64ac871e6e7ee18e80fdb6e0f2db0bd9a3818ee582c549c72"} Jul 18 00:54:42.924091 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.923398 2585 generic.go:356] "Generic (PLEG): container finished" podID="537dd81a17ca652b25fa865e81ce5b47" containerID="089e0f6168e43c1c79e4d7c49e58eeed32a123d675631d27e001828d7e704fd7" exitCode=0 Jul 18 00:54:42.924091 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.923685 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" event={"ID":"537dd81a17ca652b25fa865e81ce5b47","Type":"ContainerDied","Data":"089e0f6168e43c1c79e4d7c49e58eeed32a123d675631d27e001828d7e704fd7"} Jul 18 00:54:42.927337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.927273 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zdrj5" event={"ID":"9f675299-7395-4d54-8b9b-7bb19ffd11d9","Type":"ContainerStarted","Data":"b3de08c83474d5a0979ec7728059878b3ea8109c495873a23c58745df1e37393"} Jul 18 00:54:42.931924 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:42.931724 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2984k" event={"ID":"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f","Type":"ContainerStarted","Data":"57005236e6c53a8bf66d3e82027decc9c3ec3a2a14d0931fcde5ea2ac86b0328"} Jul 18 00:54:43.791417 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:43.790865 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:43.791417 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:43.791036 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:54:43.964814 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:43.964775 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" event={"ID":"537dd81a17ca652b25fa865e81ce5b47","Type":"ContainerStarted","Data":"79ddc37b94388a67201925394a2113f49f71c79dcc801beac670c68c057e6c43"} Jul 18 00:54:43.990300 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:43.990238 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-32.ec2.internal" podStartSLOduration=3.990216756 podStartE2EDuration="3.990216756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:54:43.990001537 +0000 UTC m=+5.728873755" watchObservedRunningTime="2026-07-18 00:54:43.990216756 +0000 UTC m=+5.729088974" Jul 18 00:54:44.338489 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:44.338447 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chm2s\" (UniqueName: \"kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s\") pod \"network-check-target-4qzlg\" (UID: \"c117f41a-3ee9-41f6-a06f-96a3edf042d2\") " pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:44.338694 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:44.338513 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:44.338694 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:44.338600 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:44.338820 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:44.338756 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:44.338873 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:44.338826 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret podName:64302c11-8b83-4992-bf49-089c75a48e2e nodeName:}" failed. No retries permitted until 2026-07-18 00:54:48.338804875 +0000 UTC m=+10.077677096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret") pod "global-pull-secret-syncer-8nphz" (UID: "64302c11-8b83-4992-bf49-089c75a48e2e") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:44.339410 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:44.339389 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:54:44.339502 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:44.339416 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:54:44.339502 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:44.339431 2585 projected.go:196] Error preparing data for projected volume kube-api-access-chm2s for pod openshift-network-diagnostics/network-check-target-4qzlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:44.339502 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:44.339479 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s podName:c117f41a-3ee9-41f6-a06f-96a3edf042d2 nodeName:}" failed. No retries permitted until 2026-07-18 00:54:48.339462659 +0000 UTC m=+10.078334870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-chm2s" (UniqueName: "kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s") pod "network-check-target-4qzlg" (UID: "c117f41a-3ee9-41f6-a06f-96a3edf042d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:44.339673 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:44.339551 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:44.339673 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:44.339594 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs podName:c29e5d41-e606-437c-8a87-3b5b002ead5d nodeName:}" failed. No retries permitted until 2026-07-18 00:54:48.339579711 +0000 UTC m=+10.078451923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs") pod "network-metrics-daemon-rhg65" (UID: "c29e5d41-e606-437c-8a87-3b5b002ead5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:44.792561 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:44.792477 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:44.793144 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:44.792613 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:54:44.793144 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:44.792700 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:44.793144 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:44.792774 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:54:45.790775 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:45.790437 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:45.790775 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:45.790587 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:54:46.792090 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:46.792058 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:46.792566 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:46.792198 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:54:46.792566 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:46.792395 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:46.792566 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:46.792496 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:54:47.790183 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:47.790149 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:47.790373 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:47.790297 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:54:48.372973 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:48.372060 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chm2s\" (UniqueName: \"kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s\") pod \"network-check-target-4qzlg\" (UID: \"c117f41a-3ee9-41f6-a06f-96a3edf042d2\") " pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:48.372973 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:48.372121 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:48.372973 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:48.372156 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:48.372973 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:48.372271 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:48.372973 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:48.372331 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret podName:64302c11-8b83-4992-bf49-089c75a48e2e nodeName:}" failed. No retries permitted until 2026-07-18 00:54:56.37231428 +0000 UTC m=+18.111186480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret") pod "global-pull-secret-syncer-8nphz" (UID: "64302c11-8b83-4992-bf49-089c75a48e2e") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:48.372973 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:48.372762 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:54:48.372973 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:48.372781 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:54:48.372973 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:48.372794 2585 projected.go:196] Error preparing data for projected volume kube-api-access-chm2s for pod openshift-network-diagnostics/network-check-target-4qzlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:48.372973 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:48.372840 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s podName:c117f41a-3ee9-41f6-a06f-96a3edf042d2 nodeName:}" failed. No retries permitted until 2026-07-18 00:54:56.372824569 +0000 UTC m=+18.111696777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-chm2s" (UniqueName: "kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s") pod "network-check-target-4qzlg" (UID: "c117f41a-3ee9-41f6-a06f-96a3edf042d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:48.372973 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:48.372901 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:48.372973 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:48.372934 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs podName:c29e5d41-e606-437c-8a87-3b5b002ead5d nodeName:}" failed. No retries permitted until 2026-07-18 00:54:56.372922977 +0000 UTC m=+18.111795174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs") pod "network-metrics-daemon-rhg65" (UID: "c29e5d41-e606-437c-8a87-3b5b002ead5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:48.791998 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:48.791909 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:48.792151 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:48.792042 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:54:48.792419 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:48.792397 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:48.792503 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:48.792486 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:54:49.790282 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:49.790240 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:49.790743 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:49.790399 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:54:50.790369 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:50.790335 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:50.790888 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:50.790472 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:54:50.790888 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:50.790844 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:50.791032 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:50.790930 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:54:51.790450 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:51.790412 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:51.790872 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:51.790557 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:54:52.790554 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:52.790516 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:52.791023 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:52.790526 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:52.791023 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:52.790645 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:54:52.791023 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:52.790770 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:54:53.790272 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:53.790243 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:53.790430 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:53.790388 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:54:54.790049 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:54.790012 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:54.790049 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:54.790028 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:54.790546 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:54.790149 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:54:54.790546 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:54.790264 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:54:55.789877 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:55.789839 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:55.790086 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:55.789963 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:54:56.434806 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:56.434776 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chm2s\" (UniqueName: \"kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s\") pod \"network-check-target-4qzlg\" (UID: \"c117f41a-3ee9-41f6-a06f-96a3edf042d2\") " pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:56.434806 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:56.434808 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:56.435056 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:56.434841 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:56.435056 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:56.434928 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:56.435056 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:56.434939 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:56.435056 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:56.434969 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret podName:64302c11-8b83-4992-bf49-089c75a48e2e nodeName:}" failed. No retries permitted until 2026-07-18 00:55:12.434956409 +0000 UTC m=+34.173828602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret") pod "global-pull-secret-syncer-8nphz" (UID: "64302c11-8b83-4992-bf49-089c75a48e2e") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:54:56.435056 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:56.435017 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs podName:c29e5d41-e606-437c-8a87-3b5b002ead5d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:12.434997478 +0000 UTC m=+34.173869695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs") pod "network-metrics-daemon-rhg65" (UID: "c29e5d41-e606-437c-8a87-3b5b002ead5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:54:56.435056 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:56.434942 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:54:56.435056 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:56.435045 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:54:56.435056 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:56.435058 2585 projected.go:196] Error preparing data for projected volume kube-api-access-chm2s for pod openshift-network-diagnostics/network-check-target-4qzlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:56.435358 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:56.435101 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s podName:c117f41a-3ee9-41f6-a06f-96a3edf042d2 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:12.435088552 +0000 UTC m=+34.173960751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-chm2s" (UniqueName: "kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s") pod "network-check-target-4qzlg" (UID: "c117f41a-3ee9-41f6-a06f-96a3edf042d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:54:56.791052 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:56.790950 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:56.791052 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:56.790969 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:56.791553 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:56.791090 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:54:56.791553 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:56.791162 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:54:57.790492 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:57.790452 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:57.790682 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:57.790585 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:54:58.791014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:58.790883 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:54:58.791430 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:58.791019 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:54:58.791430 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:58.791137 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:54:58.791430 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:58.791248 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:54:59.789811 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:54:59.789773 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:54:59.790006 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:54:59.789922 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:55:00.790284 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:00.790249 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:00.790667 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:00.790376 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:55:00.790667 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:00.790428 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:00.790667 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:00.790518 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:55:01.791186 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:01.790714 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:01.791968 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:01.791316 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:55:02.005326 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.005292 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zdrj5" event={"ID":"9f675299-7395-4d54-8b9b-7bb19ffd11d9","Type":"ContainerStarted","Data":"105633904ab57bd7fd25243a0f8c1e36c05ff4252956a437dcd97297085d6b2e"} Jul 18 00:55:02.007199 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.007171 2585 generic.go:356] "Generic (PLEG): container finished" podID="b4af8641-1c51-4e5a-baa5-8c634b2c7b4f" containerID="424114dc96ca704daf54b5ca9e4ed8f1aa7330e8cd74f4533a22c8a3d5a287be" exitCode=0 Jul 18 00:55:02.007321 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.007262 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2984k" event={"ID":"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f","Type":"ContainerDied","Data":"424114dc96ca704daf54b5ca9e4ed8f1aa7330e8cd74f4533a22c8a3d5a287be"} Jul 18 00:55:02.008706 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.008676 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dvg9j" event={"ID":"6cfa5075-7004-43bd-8c6a-da34cff6a4d2","Type":"ContainerStarted","Data":"fb11fee5fb28254870732d496a913b526d8f1ab9c989ce377b0c3199068ce59c"} Jul 18 00:55:02.010326 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.010294 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j8lkk" event={"ID":"b9474dba-cf39-4e3d-b0af-e7efbdfdb495","Type":"ContainerStarted","Data":"08468c808a82b3cfb1ea35bdea194609a4905d2c4e742670fcc30d1dbb094069"} Jul 18 00:55:02.011913 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.011894 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" event={"ID":"d013f410-edd6-4cad-b4df-4009227ca9e4","Type":"ContainerStarted","Data":"14019ecba6c0e230933c6faeee0475d6dade1405092140c97aad51593181ec00"} Jul 18 00:55:02.013483 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.013461 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-85wmf" event={"ID":"ad532d7f-9846-4831-a19a-ae39b26be8b0","Type":"ContainerStarted","Data":"110081dbd75e893939fcf4be69306a7e94bab6fee961bc8e161e65561817e652"} Jul 18 00:55:02.014842 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.014821 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rzpmd" event={"ID":"b09f54df-61eb-4b1b-bef8-06f18f9a5944","Type":"ContainerStarted","Data":"d1f11d62315802c07c194b69044ce65161f548388b657cecf88ec6e95940d1e3"} Jul 18 00:55:02.017642 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.017626 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 00:55:02.018054 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.018033 2585 generic.go:356] "Generic (PLEG): container finished" podID="334a91d8-80d6-40f9-9e09-bc6615534f78" containerID="3da537e641e90c52de702cef19286cc1ec69fd2b922656f220b54a5033cd0ea9" exitCode=1 Jul 18 00:55:02.018140 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.018060 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" event={"ID":"334a91d8-80d6-40f9-9e09-bc6615534f78","Type":"ContainerStarted","Data":"55b8a90413c3d8a18b19e709aacb02342261c1b460f25aac79181cc7914266dd"} Jul 18 00:55:02.018140 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.018115 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" event={"ID":"334a91d8-80d6-40f9-9e09-bc6615534f78","Type":"ContainerStarted","Data":"7cdbf0588c7d65f8c6a4a8dacff88d0c7c24e2e148e6efb6fd83262585e33ffc"} Jul 18 00:55:02.018252 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.018148 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" event={"ID":"334a91d8-80d6-40f9-9e09-bc6615534f78","Type":"ContainerStarted","Data":"13faa4c2423bc9f915e7848fd156de4c44cf52fd0b65573c8d2632ee3c439f8b"} Jul 18 00:55:02.018252 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.018183 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" event={"ID":"334a91d8-80d6-40f9-9e09-bc6615534f78","Type":"ContainerStarted","Data":"65357d4c71a05efb0a1840e3399d11bdda433b3f015248619bf8a1bca5752afa"} Jul 18 00:55:02.018347 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.018260 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" event={"ID":"334a91d8-80d6-40f9-9e09-bc6615534f78","Type":"ContainerDied","Data":"3da537e641e90c52de702cef19286cc1ec69fd2b922656f220b54a5033cd0ea9"} Jul 18 00:55:02.018347 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.018304 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" event={"ID":"334a91d8-80d6-40f9-9e09-bc6615534f78","Type":"ContainerStarted","Data":"a698421568076a6e00339f9fbb43d369348e418f56444db92a1da8cb56cda361"} Jul 18 00:55:02.019783 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.019750 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zdrj5" podStartSLOduration=3.959203884 podStartE2EDuration="23.019736882s" totalImagesPullingTime="19.060532998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:02.019383975 +0000 UTC m=+23.758256202" watchObservedRunningTime="2026-07-18 00:55:02.019736882 +0000 UTC m=+23.758609098" Jul 18 00:55:02.058845 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.058779 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-85wmf" podStartSLOduration=3.999069365 podStartE2EDuration="23.05876373s" totalImagesPullingTime="19.059694365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:02.058674699 +0000 UTC m=+23.797546916" watchObservedRunningTime="2026-07-18 00:55:02.05876373 +0000 UTC m=+23.797635945" Jul 18 00:55:02.075226 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.075183 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dvg9j" podStartSLOduration=3.969938098 podStartE2EDuration="23.075169943s" totalImagesPullingTime="19.105231845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:02.074539216 +0000 UTC m=+23.813411432" watchObservedRunningTime="2026-07-18 00:55:02.075169943 +0000 UTC m=+23.814042453" Jul 18 00:55:02.094852 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.094803 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rzpmd" podStartSLOduration=12.350283168 podStartE2EDuration="23.094788239s" totalImagesPullingTime="10.744505071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:02.094481531 +0000 UTC m=+23.833353758" watchObservedRunningTime="2026-07-18 00:55:02.094788239 +0000 UTC m=+23.833660455" Jul 18 00:55:02.307892 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.307863 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 18 00:55:02.772104 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.771952 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T00:55:02.307883425Z","UUID":"51184cb4-445d-4be2-a2ab-f2433ba1cd0a","Handler":null,"Name":"","Endpoint":""} Jul 18 00:55:02.773788 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.773759 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 18 00:55:02.773900 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.773800 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 18 00:55:02.790263 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.790223 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:02.790409 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:02.790346 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:55:02.790481 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:02.790408 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:02.790546 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:02.790498 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:55:03.022739 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:03.022650 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" event={"ID":"d013f410-edd6-4cad-b4df-4009227ca9e4","Type":"ContainerStarted","Data":"93ca48a89c29cb52f261d96ed3386e5f596234d15119a80290d27194752ace5e"} Jul 18 00:55:03.024651 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:03.024268 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l6plv" event={"ID":"b9a57ffb-4dfa-4d54-be2d-5446746c3380","Type":"ContainerStarted","Data":"96d33b8384930e28bb1aa8a2d99589e4589c672b1c7411e86d3b934afc497aaa"} Jul 18 00:55:03.040466 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:03.040421 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l6plv" podStartSLOduration=4.981909327 podStartE2EDuration="24.040407047s" totalImagesPullingTime="19.05849772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:03.040233426 +0000 UTC m=+24.779105683" watchObservedRunningTime="2026-07-18 00:55:03.040407047 +0000 UTC m=+24.779279272" Jul 18 00:55:03.040754 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:03.040726 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j8lkk" podStartSLOduration=4.994473203 podStartE2EDuration="24.040718448s" totalImagesPullingTime="19.046245245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:02.117253312 +0000 UTC m=+23.856125528" watchObservedRunningTime="2026-07-18 00:55:03.040718448 +0000 UTC m=+24.779590664" Jul 18 00:55:03.790514 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:03.790487 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:03.790673 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:03.790591 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:55:04.028786 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:04.028569 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" event={"ID":"d013f410-edd6-4cad-b4df-4009227ca9e4","Type":"ContainerStarted","Data":"bb97994ce8baf5435c641420761a32e5d13a652ad06cd510ff3d3aaa957f872e"} Jul 18 00:55:04.031949 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:04.031928 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 00:55:04.032487 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:04.032460 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" event={"ID":"334a91d8-80d6-40f9-9e09-bc6615534f78","Type":"ContainerStarted","Data":"5172ce97c3265d12c6b20625279713eed1cf8c337f9d0338d9050b66c9eab52f"} Jul 18 00:55:04.045838 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:04.045758 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qvxf" podStartSLOduration=4.1012252 podStartE2EDuration="25.045744276s" totalImagesPullingTime="20.944519076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:04.045243299 +0000 UTC m=+25.784115515" watchObservedRunningTime="2026-07-18 00:55:04.045744276 +0000 UTC m=+25.784616491" Jul 18 00:55:04.767289 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:04.767262 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:55:04.767797 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:04.767772 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:55:04.789901 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:04.789874 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:04.790072 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:04.789874 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:04.790072 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:04.789998 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:55:04.790072 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:04.790060 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:55:05.035635 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:05.035549 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:55:05.036170 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:05.036154 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rzpmd" Jul 18 00:55:05.790778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:05.790748 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:05.790978 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:05.790866 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:55:06.790907 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:06.790657 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:06.791546 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:06.790705 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:06.791546 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:06.791041 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:55:06.791546 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:06.791082 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:55:07.044018 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:07.043935 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 00:55:07.044330 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:07.044295 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" event={"ID":"334a91d8-80d6-40f9-9e09-bc6615534f78","Type":"ContainerStarted","Data":"c0979011e78f2e9723092deefaa930bd46ff51ee1a3923e72a3ab65ed4c2ece5"} Jul 18 00:55:07.044632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:07.044603 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:55:07.047975 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:07.045153 2585 scope.go:117] "RemoveContainer" containerID="3da537e641e90c52de702cef19286cc1ec69fd2b922656f220b54a5033cd0ea9" Jul 18 00:55:07.049908 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:07.049881 2585 generic.go:356] "Generic (PLEG): container finished" podID="b4af8641-1c51-4e5a-baa5-8c634b2c7b4f" containerID="198cfd60b8ec5eaadc0e0d2c5673c10a0659636e25ea1a997ab336ab44abd3f4" exitCode=0 Jul 18 00:55:07.050035 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:07.049935 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2984k" event={"ID":"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f","Type":"ContainerDied","Data":"198cfd60b8ec5eaadc0e0d2c5673c10a0659636e25ea1a997ab336ab44abd3f4"} Jul 18 00:55:07.061866 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:07.061821 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:55:07.790696 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:07.790660 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:07.790886 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:07.790795 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:55:08.055391 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.055353 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2984k" event={"ID":"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f","Type":"ContainerStarted","Data":"39f993c4c43022ec7a0ab642b1eae7e97a301a7600e42c1a2b928c1a2023ede8"} Jul 18 00:55:08.059643 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.059623 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 00:55:08.059941 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.059921 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" event={"ID":"334a91d8-80d6-40f9-9e09-bc6615534f78","Type":"ContainerStarted","Data":"8d2deaff6257935c662804f7b8212c7dc44e8bb805c2e300eab1263dc86d737a"} Jul 18 00:55:08.061001 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.060283 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:55:08.061001 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.060355 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:55:08.075401 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.075377 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:55:08.108940 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.108874 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" podStartSLOduration=9.956141146 podStartE2EDuration="29.108850822s" totalImagesPullingTime="19.152709676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:08.107843808 +0000 UTC m=+29.846716024" watchObservedRunningTime="2026-07-18 00:55:08.108850822 +0000 UTC m=+29.847723039" Jul 18 00:55:08.394788 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.394704 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4qzlg"] Jul 18 00:55:08.394946 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.394845 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:08.394946 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:08.394929 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:55:08.397380 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.397345 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8nphz"] Jul 18 00:55:08.397501 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.397452 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:08.397560 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:08.397540 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:55:08.408125 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.408098 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rhg65"] Jul 18 00:55:08.408223 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:08.408187 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:08.408273 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:08.408258 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:55:09.064611 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:09.064526 2585 generic.go:356] "Generic (PLEG): container finished" podID="b4af8641-1c51-4e5a-baa5-8c634b2c7b4f" containerID="39f993c4c43022ec7a0ab642b1eae7e97a301a7600e42c1a2b928c1a2023ede8" exitCode=0 Jul 18 00:55:09.064611 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:09.064550 2585 generic.go:356] "Generic (PLEG): container finished" podID="b4af8641-1c51-4e5a-baa5-8c634b2c7b4f" containerID="6385c4a9df9f2f64bfe23f76fda5b7f3b431e9b1010df77a736c73513b03e0b3" exitCode=0 Jul 18 00:55:09.065026 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:09.064616 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2984k" event={"ID":"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f","Type":"ContainerDied","Data":"39f993c4c43022ec7a0ab642b1eae7e97a301a7600e42c1a2b928c1a2023ede8"} Jul 18 00:55:09.065026 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:09.064664 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2984k" event={"ID":"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f","Type":"ContainerDied","Data":"6385c4a9df9f2f64bfe23f76fda5b7f3b431e9b1010df77a736c73513b03e0b3"} Jul 18 00:55:09.790146 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:09.790115 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:09.790287 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:09.790223 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:55:10.790081 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:10.789831 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:10.790531 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:10.789871 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:10.790531 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:10.790125 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:55:10.790531 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:10.790193 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:55:11.790518 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:11.790483 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:11.791103 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:11.790606 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:55:12.451199 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:12.451158 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chm2s\" (UniqueName: \"kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s\") pod \"network-check-target-4qzlg\" (UID: \"c117f41a-3ee9-41f6-a06f-96a3edf042d2\") " pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:12.451199 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:12.451208 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:12.451467 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:12.451328 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:12.451467 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:12.451341 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:55:12.451467 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:12.451364 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:55:12.451467 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:12.451377 2585 projected.go:196] Error preparing data for projected volume kube-api-access-chm2s for pod openshift-network-diagnostics/network-check-target-4qzlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:12.451467 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:12.451389 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs podName:c29e5d41-e606-437c-8a87-3b5b002ead5d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:44.451370081 +0000 UTC m=+66.190242280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs") pod "network-metrics-daemon-rhg65" (UID: "c29e5d41-e606-437c-8a87-3b5b002ead5d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:12.451467 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:12.451408 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:12.451467 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:12.451417 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s podName:c117f41a-3ee9-41f6-a06f-96a3edf042d2 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:44.451404297 +0000 UTC m=+66.190276493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-chm2s" (UniqueName: "kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s") pod "network-check-target-4qzlg" (UID: "c117f41a-3ee9-41f6-a06f-96a3edf042d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:12.451467 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:12.451467 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:12.451733 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:12.451500 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret podName:64302c11-8b83-4992-bf49-089c75a48e2e nodeName:}" failed. No retries permitted until 2026-07-18 00:55:44.451489514 +0000 UTC m=+66.190361711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret") pod "global-pull-secret-syncer-8nphz" (UID: "64302c11-8b83-4992-bf49-089c75a48e2e") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:12.790584 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:12.790508 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:12.790584 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:12.790558 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:12.791153 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:12.790631 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4qzlg" podUID="c117f41a-3ee9-41f6-a06f-96a3edf042d2" Jul 18 00:55:12.791153 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:12.790766 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8nphz" podUID="64302c11-8b83-4992-bf49-089c75a48e2e" Jul 18 00:55:13.790670 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:13.790644 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:13.791102 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:13.790737 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rhg65" podUID="c29e5d41-e606-437c-8a87-3b5b002ead5d" Jul 18 00:55:14.092332 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.092311 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-32.ec2.internal" event="NodeReady" Jul 18 00:55:14.092443 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.092406 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 18 00:55:14.126815 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.126785 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55bf795c4d-zdh2z"] Jul 18 00:55:14.161418 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.161389 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92"] Jul 18 00:55:14.161596 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.161534 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.165620 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.165598 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 18 00:55:14.165917 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.165891 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wzpgs\"" Jul 18 00:55:14.166078 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.166034 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 18 00:55:14.166144 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.166117 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 18 00:55:14.172831 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.172750 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 18 00:55:14.191216 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.191190 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf"] Jul 18 00:55:14.191331 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.191316 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" Jul 18 00:55:14.193350 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.193330 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 18 00:55:14.193592 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.193577 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cz7s7\"" Jul 18 00:55:14.193676 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.193575 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 18 00:55:14.193676 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.193629 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 18 00:55:14.193676 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.193645 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:55:14.206109 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.206087 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-c5xzb"] Jul 18 00:55:14.206321 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.206200 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" Jul 18 00:55:14.208530 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.208511 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 18 00:55:14.208630 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.208574 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 18 00:55:14.208855 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.208730 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 18 00:55:14.209182 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.209161 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-66zdg\"" Jul 18 00:55:14.209295 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.209234 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:55:14.223763 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.223746 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p7cxb"] Jul 18 00:55:14.223892 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.223865 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.226020 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.225979 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 18 00:55:14.226206 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.226189 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 18 00:55:14.226337 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.226319 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:55:14.226411 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.226375 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 18 00:55:14.226411 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.226391 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rkfx9\"" Jul 18 00:55:14.232647 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.232620 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 18 00:55:14.245954 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.245934 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-tkb76"] Jul 18 00:55:14.246094 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.246071 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p7cxb" Jul 18 00:55:14.248660 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.248637 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 18 00:55:14.248949 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.248930 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:55:14.249041 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.248976 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tnqjb\"" Jul 18 00:55:14.261934 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.261914 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j"] Jul 18 00:55:14.262080 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.262063 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tkb76" Jul 18 00:55:14.264438 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.264349 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 00:55:14.264438 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.264374 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 00:55:14.264438 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.264419 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4v65f\"" Jul 18 00:55:14.265522 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.265502 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-bound-sa-token\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.265637 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.265526 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr8s7\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-kube-api-access-jr8s7\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.265637 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.265553 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-registry-certificates\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.265637 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.265597 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be34618f-4a94-4229-95e7-e35e986fe882-ca-trust-extracted\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.265783 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.265651 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-installation-pull-secrets\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.265783 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.265686 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-image-registry-private-configuration\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.265783 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.265712 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.265783 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.265731 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-trusted-ca\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.276566 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.276535 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w2rgw"] Jul 18 00:55:14.276670 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.276656 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:14.280911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.279761 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 18 00:55:14.280911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.279823 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:55:14.280911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.279845 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xk8wc\"" Jul 18 00:55:14.280911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.279771 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 18 00:55:14.294843 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.294825 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-tkb76"] Jul 18 00:55:14.294896 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.294856 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92"] Jul 18 00:55:14.294896 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.294869 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j"] Jul 18 00:55:14.294896 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.294885 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf"] Jul 18 00:55:14.294896 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.294897 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-c5xzb"] Jul 18 00:55:14.295028 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.294910 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7n6hg"] Jul 18 00:55:14.295028 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.294953 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.297174 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.297151 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 18 00:55:14.297284 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.297213 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d2qsz\"" Jul 18 00:55:14.297284 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.297231 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 18 00:55:14.308892 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.308873 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w2rgw"] Jul 18 00:55:14.308976 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.308912 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55bf795c4d-zdh2z"] Jul 18 00:55:14.308976 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.308939 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p7cxb"] Jul 18 00:55:14.308976 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.308962 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7n6hg"] Jul 18 00:55:14.309122 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.309026 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7n6hg" Jul 18 00:55:14.311513 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.311444 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 18 00:55:14.311513 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.311455 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 18 00:55:14.311513 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.311491 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 18 00:55:14.311687 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.311516 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gf4wb\"" Jul 18 00:55:14.344776 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.344714 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:14.366669 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.366648 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be34618f-4a94-4229-95e7-e35e986fe882-ca-trust-extracted\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.366776 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.366682 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2r8k\" (UniqueName: \"kubernetes.io/projected/32a7ad20-f52b-4b29-911b-28ec26b6e752-kube-api-access-l2r8k\") pod \"volume-data-source-validator-78cf4c6f6-p7cxb\" (UID: \"32a7ad20-f52b-4b29-911b-28ec26b6e752\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p7cxb" Jul 18 00:55:14.366776 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.366705 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzzpt\" (UniqueName: \"kubernetes.io/projected/4ccd3551-04ec-4cc3-bb2e-44987fe5370f-kube-api-access-tzzpt\") pod \"kube-storage-version-migrator-operator-7658d9b749-c64lf\" (UID: \"4ccd3551-04ec-4cc3-bb2e-44987fe5370f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" Jul 18 00:55:14.366776 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.366750 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-installation-pull-secrets\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.366776 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.366772 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2acdbbb6-f965-408b-a4e1-525354af72c7-trusted-ca\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.366934 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.366791 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6jpb\" (UniqueName: \"kubernetes.io/projected/9cbe7c41-dfa5-4468-a365-12ab53a04abe-kube-api-access-r6jpb\") pod \"cluster-samples-operator-79b7c55f87-h9s8j\" (UID: \"9cbe7c41-dfa5-4468-a365-12ab53a04abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:14.366934 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.366817 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-image-registry-private-configuration\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.366934 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.366891 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.367082 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.366947 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-trusted-ca\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.367082 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.366962 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:55:14.367082 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.366975 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55bf795c4d-zdh2z: secret "image-registry-tls" not found Jul 18 00:55:14.367082 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367003 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2acdbbb6-f965-408b-a4e1-525354af72c7-serving-cert\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.367082 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.367043 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls podName:be34618f-4a94-4229-95e7-e35e986fe882 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:14.867023747 +0000 UTC m=+36.605895958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls") pod "image-registry-55bf795c4d-zdh2z" (UID: "be34618f-4a94-4229-95e7-e35e986fe882") : secret "image-registry-tls" not found Jul 18 00:55:14.367082 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367052 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be34618f-4a94-4229-95e7-e35e986fe882-ca-trust-extracted\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.367082 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367064 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-h9s8j\" (UID: \"9cbe7c41-dfa5-4468-a365-12ab53a04abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:14.367424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367097 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kljpj\" (UniqueName: \"kubernetes.io/projected/2acdbbb6-f965-408b-a4e1-525354af72c7-kube-api-access-kljpj\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.367424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367118 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c-config\") pod \"service-ca-operator-5bcbc94c78-jkt92\" (UID: \"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" Jul 18 00:55:14.367424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367159 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-bound-sa-token\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.367424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367179 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8s7\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-kube-api-access-jr8s7\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.367424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367207 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-registry-certificates\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.367424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367229 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jkt92\" (UID: \"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" Jul 18 00:55:14.367424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367252 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfzb4\" (UniqueName: \"kubernetes.io/projected/2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c-kube-api-access-tfzb4\") pod \"service-ca-operator-5bcbc94c78-jkt92\" (UID: \"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" Jul 18 00:55:14.367424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367276 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ccd3551-04ec-4cc3-bb2e-44987fe5370f-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-c64lf\" (UID: \"4ccd3551-04ec-4cc3-bb2e-44987fe5370f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" Jul 18 00:55:14.367424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367336 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spr5v\" (UniqueName: \"kubernetes.io/projected/f3532f53-ed69-425d-bfca-e74bcce0c08b-kube-api-access-spr5v\") pod \"network-check-source-7bc5b6bf85-tkb76\" (UID: \"f3532f53-ed69-425d-bfca-e74bcce0c08b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tkb76" Jul 18 00:55:14.367424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367362 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ccd3551-04ec-4cc3-bb2e-44987fe5370f-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-c64lf\" (UID: \"4ccd3551-04ec-4cc3-bb2e-44987fe5370f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" Jul 18 00:55:14.367424 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367390 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2acdbbb6-f965-408b-a4e1-525354af72c7-config\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.367945 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367734 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-registry-certificates\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.367945 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.367907 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-trusted-ca\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.370839 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.370811 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-image-registry-private-configuration\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.370934 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.370890 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-installation-pull-secrets\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.377533 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.377514 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-bound-sa-token\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.377622 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.377547 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr8s7\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-kube-api-access-jr8s7\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.434888 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.434853 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:14.467847 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.467818 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfmbq\" (UniqueName: \"kubernetes.io/projected/285d4b11-9773-491e-b59a-cb07038656bb-kube-api-access-lfmbq\") pod \"ingress-canary-7n6hg\" (UID: \"285d4b11-9773-491e-b59a-cb07038656bb\") " pod="openshift-ingress-canary/ingress-canary-7n6hg" Jul 18 00:55:14.467968 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.467853 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spr5v\" (UniqueName: \"kubernetes.io/projected/f3532f53-ed69-425d-bfca-e74bcce0c08b-kube-api-access-spr5v\") pod \"network-check-source-7bc5b6bf85-tkb76\" (UID: \"f3532f53-ed69-425d-bfca-e74bcce0c08b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tkb76" Jul 18 00:55:14.467968 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.467877 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ccd3551-04ec-4cc3-bb2e-44987fe5370f-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-c64lf\" (UID: \"4ccd3551-04ec-4cc3-bb2e-44987fe5370f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" Jul 18 00:55:14.467968 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.467895 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzzpt\" (UniqueName: \"kubernetes.io/projected/4ccd3551-04ec-4cc3-bb2e-44987fe5370f-kube-api-access-tzzpt\") pod \"kube-storage-version-migrator-operator-7658d9b749-c64lf\" (UID: \"4ccd3551-04ec-4cc3-bb2e-44987fe5370f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" Jul 18 00:55:14.468166 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.467951 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2r8k\" (UniqueName: \"kubernetes.io/projected/32a7ad20-f52b-4b29-911b-28ec26b6e752-kube-api-access-l2r8k\") pod \"volume-data-source-validator-78cf4c6f6-p7cxb\" (UID: \"32a7ad20-f52b-4b29-911b-28ec26b6e752\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p7cxb" Jul 18 00:55:14.468166 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468026 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5e186f-bc53-4ddb-820e-78bb5eb24953-tmp-dir\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.468166 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468072 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2acdbbb6-f965-408b-a4e1-525354af72c7-trusted-ca\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.468166 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468098 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6jpb\" (UniqueName: \"kubernetes.io/projected/9cbe7c41-dfa5-4468-a365-12ab53a04abe-kube-api-access-r6jpb\") pod \"cluster-samples-operator-79b7c55f87-h9s8j\" (UID: \"9cbe7c41-dfa5-4468-a365-12ab53a04abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:14.468166 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468128 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c-config\") pod \"service-ca-operator-5bcbc94c78-jkt92\" (UID: \"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" Jul 18 00:55:14.468402 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468165 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2acdbbb6-f965-408b-a4e1-525354af72c7-serving-cert\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.468402 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468202 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-h9s8j\" (UID: \"9cbe7c41-dfa5-4468-a365-12ab53a04abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:14.468402 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468233 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kljpj\" (UniqueName: \"kubernetes.io/projected/2acdbbb6-f965-408b-a4e1-525354af72c7-kube-api-access-kljpj\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.468402 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468312 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxw2k\" (UniqueName: \"kubernetes.io/projected/8e5e186f-bc53-4ddb-820e-78bb5eb24953-kube-api-access-kxw2k\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.468402 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.468326 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 18 00:55:14.468402 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468338 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/285d4b11-9773-491e-b59a-cb07038656bb-cert\") pod \"ingress-canary-7n6hg\" (UID: \"285d4b11-9773-491e-b59a-cb07038656bb\") " pod="openshift-ingress-canary/ingress-canary-7n6hg" Jul 18 00:55:14.468402 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468374 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jkt92\" (UID: \"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" Jul 18 00:55:14.468402 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.468398 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls podName:9cbe7c41-dfa5-4468-a365-12ab53a04abe nodeName:}" failed. No retries permitted until 2026-07-18 00:55:14.96837592 +0000 UTC m=+36.707248119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-h9s8j" (UID: "9cbe7c41-dfa5-4468-a365-12ab53a04abe") : secret "samples-operator-tls" not found Jul 18 00:55:14.468785 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468439 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ccd3551-04ec-4cc3-bb2e-44987fe5370f-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-c64lf\" (UID: \"4ccd3551-04ec-4cc3-bb2e-44987fe5370f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" Jul 18 00:55:14.468785 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468475 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2acdbbb6-f965-408b-a4e1-525354af72c7-config\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.468785 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468498 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.468785 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468532 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e5e186f-bc53-4ddb-820e-78bb5eb24953-config-volume\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.468785 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468592 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzb4\" (UniqueName: \"kubernetes.io/projected/2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c-kube-api-access-tfzb4\") pod \"service-ca-operator-5bcbc94c78-jkt92\" (UID: \"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" Jul 18 00:55:14.468785 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468735 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c-config\") pod \"service-ca-operator-5bcbc94c78-jkt92\" (UID: \"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" Jul 18 00:55:14.469346 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.468970 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ccd3551-04ec-4cc3-bb2e-44987fe5370f-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-c64lf\" (UID: \"4ccd3551-04ec-4cc3-bb2e-44987fe5370f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" Jul 18 00:55:14.469467 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.469441 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2acdbbb6-f965-408b-a4e1-525354af72c7-config\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.469599 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.469582 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2acdbbb6-f965-408b-a4e1-525354af72c7-trusted-ca\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.470446 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.470425 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ccd3551-04ec-4cc3-bb2e-44987fe5370f-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-c64lf\" (UID: \"4ccd3551-04ec-4cc3-bb2e-44987fe5370f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" Jul 18 00:55:14.470637 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.470623 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c-serving-cert\") pod \"service-ca-operator-5bcbc94c78-jkt92\" (UID: \"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" Jul 18 00:55:14.470886 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.470870 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2acdbbb6-f965-408b-a4e1-525354af72c7-serving-cert\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.477173 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.477149 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kljpj\" (UniqueName: \"kubernetes.io/projected/2acdbbb6-f965-408b-a4e1-525354af72c7-kube-api-access-kljpj\") pod \"console-operator-565b7b569d-c5xzb\" (UID: \"2acdbbb6-f965-408b-a4e1-525354af72c7\") " pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.477354 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.477338 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfzb4\" (UniqueName: \"kubernetes.io/projected/2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c-kube-api-access-tfzb4\") pod \"service-ca-operator-5bcbc94c78-jkt92\" (UID: \"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" Jul 18 00:55:14.477453 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.477425 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6jpb\" (UniqueName: \"kubernetes.io/projected/9cbe7c41-dfa5-4468-a365-12ab53a04abe-kube-api-access-r6jpb\") pod \"cluster-samples-operator-79b7c55f87-h9s8j\" (UID: \"9cbe7c41-dfa5-4468-a365-12ab53a04abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:14.477801 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.477786 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2r8k\" (UniqueName: \"kubernetes.io/projected/32a7ad20-f52b-4b29-911b-28ec26b6e752-kube-api-access-l2r8k\") pod \"volume-data-source-validator-78cf4c6f6-p7cxb\" (UID: \"32a7ad20-f52b-4b29-911b-28ec26b6e752\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p7cxb" Jul 18 00:55:14.478199 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.478183 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzzpt\" (UniqueName: \"kubernetes.io/projected/4ccd3551-04ec-4cc3-bb2e-44987fe5370f-kube-api-access-tzzpt\") pod \"kube-storage-version-migrator-operator-7658d9b749-c64lf\" (UID: \"4ccd3551-04ec-4cc3-bb2e-44987fe5370f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" Jul 18 00:55:14.478331 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.478312 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spr5v\" (UniqueName: \"kubernetes.io/projected/f3532f53-ed69-425d-bfca-e74bcce0c08b-kube-api-access-spr5v\") pod \"network-check-source-7bc5b6bf85-tkb76\" (UID: \"f3532f53-ed69-425d-bfca-e74bcce0c08b\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tkb76" Jul 18 00:55:14.499275 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.499253 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" Jul 18 00:55:14.521738 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.521715 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" Jul 18 00:55:14.535089 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.534902 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:14.555142 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.554953 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p7cxb" Jul 18 00:55:14.571350 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.571008 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfmbq\" (UniqueName: \"kubernetes.io/projected/285d4b11-9773-491e-b59a-cb07038656bb-kube-api-access-lfmbq\") pod \"ingress-canary-7n6hg\" (UID: \"285d4b11-9773-491e-b59a-cb07038656bb\") " pod="openshift-ingress-canary/ingress-canary-7n6hg" Jul 18 00:55:14.571350 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.571065 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tkb76" Jul 18 00:55:14.571350 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.571077 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5e186f-bc53-4ddb-820e-78bb5eb24953-tmp-dir\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.571350 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.571165 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxw2k\" (UniqueName: \"kubernetes.io/projected/8e5e186f-bc53-4ddb-820e-78bb5eb24953-kube-api-access-kxw2k\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.571350 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.571189 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/285d4b11-9773-491e-b59a-cb07038656bb-cert\") pod \"ingress-canary-7n6hg\" (UID: \"285d4b11-9773-491e-b59a-cb07038656bb\") " pod="openshift-ingress-canary/ingress-canary-7n6hg" Jul 18 00:55:14.571350 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.571227 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.571350 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.571263 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e5e186f-bc53-4ddb-820e-78bb5eb24953-config-volume\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.574657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.571488 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5e186f-bc53-4ddb-820e-78bb5eb24953-tmp-dir\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.574657 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.572152 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8e5e186f-bc53-4ddb-820e-78bb5eb24953-config-volume\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.574657 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.574531 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:55:14.574657 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.574616 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls podName:8e5e186f-bc53-4ddb-820e-78bb5eb24953 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:15.074595237 +0000 UTC m=+36.813467436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls") pod "dns-default-w2rgw" (UID: "8e5e186f-bc53-4ddb-820e-78bb5eb24953") : secret "dns-default-metrics-tls" not found Jul 18 00:55:14.576724 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.576677 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/285d4b11-9773-491e-b59a-cb07038656bb-cert\") pod \"ingress-canary-7n6hg\" (UID: \"285d4b11-9773-491e-b59a-cb07038656bb\") " pod="openshift-ingress-canary/ingress-canary-7n6hg" Jul 18 00:55:14.583653 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.583624 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxw2k\" (UniqueName: \"kubernetes.io/projected/8e5e186f-bc53-4ddb-820e-78bb5eb24953-kube-api-access-kxw2k\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:14.585853 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.585824 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfmbq\" (UniqueName: \"kubernetes.io/projected/285d4b11-9773-491e-b59a-cb07038656bb-kube-api-access-lfmbq\") pod \"ingress-canary-7n6hg\" (UID: \"285d4b11-9773-491e-b59a-cb07038656bb\") " pod="openshift-ingress-canary/ingress-canary-7n6hg" Jul 18 00:55:14.667929 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.667708 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7n6hg" Jul 18 00:55:14.691031 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.687505 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92"] Jul 18 00:55:14.695452 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:14.695288 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d615eb4_913c_4eaa_b1cc_cdfb3a08f06c.slice/crio-9d4950139f27ccc24761538e2a7f24994ca66359f9afffabf7abb9db81416a28 WatchSource:0}: Error finding container 9d4950139f27ccc24761538e2a7f24994ca66359f9afffabf7abb9db81416a28: Status 404 returned error can't find the container with id 9d4950139f27ccc24761538e2a7f24994ca66359f9afffabf7abb9db81416a28 Jul 18 00:55:14.696848 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.696736 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf"] Jul 18 00:55:14.702865 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:14.702763 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccd3551_04ec_4cc3_bb2e_44987fe5370f.slice/crio-d33729cb05b330b5d5fb1f6fc34c5d430b422df3599c52720bbdbfc577525209 WatchSource:0}: Error finding container d33729cb05b330b5d5fb1f6fc34c5d430b422df3599c52720bbdbfc577525209: Status 404 returned error can't find the container with id d33729cb05b330b5d5fb1f6fc34c5d430b422df3599c52720bbdbfc577525209 Jul 18 00:55:14.739737 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.739620 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-c5xzb"] Jul 18 00:55:14.744390 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:14.744365 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2acdbbb6_f965_408b_a4e1_525354af72c7.slice/crio-029ab0a5ac0d1eac58c858d53ac44ab34e75759bb56d13ead560750f75f7fccb WatchSource:0}: Error finding container 029ab0a5ac0d1eac58c858d53ac44ab34e75759bb56d13ead560750f75f7fccb: Status 404 returned error can't find the container with id 029ab0a5ac0d1eac58c858d53ac44ab34e75759bb56d13ead560750f75f7fccb Jul 18 00:55:14.752003 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.751655 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p7cxb"] Jul 18 00:55:14.756166 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:14.756134 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a7ad20_f52b_4b29_911b_28ec26b6e752.slice/crio-486a58e0884dfda87b74e1939bf17ef0d0fbc248c959422a7376c1c2a7466791 WatchSource:0}: Error finding container 486a58e0884dfda87b74e1939bf17ef0d0fbc248c959422a7376c1c2a7466791: Status 404 returned error can't find the container with id 486a58e0884dfda87b74e1939bf17ef0d0fbc248c959422a7376c1c2a7466791 Jul 18 00:55:14.763679 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.763651 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-tkb76"] Jul 18 00:55:14.766845 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:14.766805 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3532f53_ed69_425d_bfca_e74bcce0c08b.slice/crio-10bc0f3fe9d21bff70991a4786db9521c6b5c0d234bad5aac2a65cf57604a125 WatchSource:0}: Error finding container 10bc0f3fe9d21bff70991a4786db9521c6b5c0d234bad5aac2a65cf57604a125: Status 404 returned error can't find the container with id 10bc0f3fe9d21bff70991a4786db9521c6b5c0d234bad5aac2a65cf57604a125 Jul 18 00:55:14.790716 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.790690 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:14.791240 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.790877 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:14.795908 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.795889 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 00:55:14.796037 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.795905 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4tv4\"" Jul 18 00:55:14.830896 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.830866 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7n6hg"] Jul 18 00:55:14.834168 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:14.834145 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285d4b11_9773_491e_b59a_cb07038656bb.slice/crio-c236a65964420984e9be056c263d7f25dfcac3abb92608c0ebaf85dccb760363 WatchSource:0}: Error finding container c236a65964420984e9be056c263d7f25dfcac3abb92608c0ebaf85dccb760363: Status 404 returned error can't find the container with id c236a65964420984e9be056c263d7f25dfcac3abb92608c0ebaf85dccb760363 Jul 18 00:55:14.874535 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.874448 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:14.874672 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.874620 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:55:14.874672 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.874638 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55bf795c4d-zdh2z: secret "image-registry-tls" not found Jul 18 00:55:14.874734 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.874694 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls podName:be34618f-4a94-4229-95e7-e35e986fe882 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:15.874675501 +0000 UTC m=+37.613547695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls") pod "image-registry-55bf795c4d-zdh2z" (UID: "be34618f-4a94-4229-95e7-e35e986fe882") : secret "image-registry-tls" not found Jul 18 00:55:14.975165 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:14.975133 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-h9s8j\" (UID: \"9cbe7c41-dfa5-4468-a365-12ab53a04abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:14.975321 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.975294 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 18 00:55:14.975380 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:14.975370 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls podName:9cbe7c41-dfa5-4468-a365-12ab53a04abe nodeName:}" failed. No retries permitted until 2026-07-18 00:55:15.975353533 +0000 UTC m=+37.714225726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-h9s8j" (UID: "9cbe7c41-dfa5-4468-a365-12ab53a04abe") : secret "samples-operator-tls" not found Jul 18 00:55:15.076005 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.075946 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:15.076170 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:15.076082 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:55:15.076170 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:15.076141 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls podName:8e5e186f-bc53-4ddb-820e-78bb5eb24953 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:16.07612489 +0000 UTC m=+37.814997084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls") pod "dns-default-w2rgw" (UID: "8e5e186f-bc53-4ddb-820e-78bb5eb24953") : secret "dns-default-metrics-tls" not found Jul 18 00:55:15.080293 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.080261 2585 generic.go:356] "Generic (PLEG): container finished" podID="b4af8641-1c51-4e5a-baa5-8c634b2c7b4f" containerID="ebf2bca8b5f016a479e8ab1d49eef02ea998be7ba828ca6b225c17467e74a148" exitCode=0 Jul 18 00:55:15.080403 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.080358 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2984k" event={"ID":"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f","Type":"ContainerDied","Data":"ebf2bca8b5f016a479e8ab1d49eef02ea998be7ba828ca6b225c17467e74a148"} Jul 18 00:55:15.081488 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.081459 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7n6hg" event={"ID":"285d4b11-9773-491e-b59a-cb07038656bb","Type":"ContainerStarted","Data":"c236a65964420984e9be056c263d7f25dfcac3abb92608c0ebaf85dccb760363"} Jul 18 00:55:15.082561 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.082540 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" event={"ID":"2acdbbb6-f965-408b-a4e1-525354af72c7","Type":"ContainerStarted","Data":"029ab0a5ac0d1eac58c858d53ac44ab34e75759bb56d13ead560750f75f7fccb"} Jul 18 00:55:15.083712 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.083693 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" event={"ID":"4ccd3551-04ec-4cc3-bb2e-44987fe5370f","Type":"ContainerStarted","Data":"d33729cb05b330b5d5fb1f6fc34c5d430b422df3599c52720bbdbfc577525209"} Jul 18 00:55:15.084846 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.084824 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p7cxb" event={"ID":"32a7ad20-f52b-4b29-911b-28ec26b6e752","Type":"ContainerStarted","Data":"486a58e0884dfda87b74e1939bf17ef0d0fbc248c959422a7376c1c2a7466791"} Jul 18 00:55:15.086401 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.086380 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tkb76" event={"ID":"f3532f53-ed69-425d-bfca-e74bcce0c08b","Type":"ContainerStarted","Data":"10bc0f3fe9d21bff70991a4786db9521c6b5c0d234bad5aac2a65cf57604a125"} Jul 18 00:55:15.087446 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.087427 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" event={"ID":"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c","Type":"ContainerStarted","Data":"9d4950139f27ccc24761538e2a7f24994ca66359f9afffabf7abb9db81416a28"} Jul 18 00:55:15.791474 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.790421 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:15.793685 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.793435 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 00:55:15.793685 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.793460 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9d8vg\"" Jul 18 00:55:15.889097 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.889062 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:15.889278 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:15.889264 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:55:15.889338 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:15.889282 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55bf795c4d-zdh2z: secret "image-registry-tls" not found Jul 18 00:55:15.889394 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:15.889351 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls podName:be34618f-4a94-4229-95e7-e35e986fe882 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:17.889321547 +0000 UTC m=+39.628193747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls") pod "image-registry-55bf795c4d-zdh2z" (UID: "be34618f-4a94-4229-95e7-e35e986fe882") : secret "image-registry-tls" not found Jul 18 00:55:15.991853 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:15.990365 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-h9s8j\" (UID: \"9cbe7c41-dfa5-4468-a365-12ab53a04abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:15.991853 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:15.990657 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 18 00:55:15.991853 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:15.990725 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls podName:9cbe7c41-dfa5-4468-a365-12ab53a04abe nodeName:}" failed. No retries permitted until 2026-07-18 00:55:17.990705534 +0000 UTC m=+39.729577731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-h9s8j" (UID: "9cbe7c41-dfa5-4468-a365-12ab53a04abe") : secret "samples-operator-tls" not found Jul 18 00:55:16.091721 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:16.091070 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:16.092496 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:16.092054 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:55:16.092496 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:16.092126 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls podName:8e5e186f-bc53-4ddb-820e-78bb5eb24953 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:18.092106729 +0000 UTC m=+39.830978925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls") pod "dns-default-w2rgw" (UID: "8e5e186f-bc53-4ddb-820e-78bb5eb24953") : secret "dns-default-metrics-tls" not found Jul 18 00:55:16.102014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:16.101792 2585 generic.go:356] "Generic (PLEG): container finished" podID="b4af8641-1c51-4e5a-baa5-8c634b2c7b4f" containerID="5db4f9d8673eb206b84d700a740a19e89142bc467e5a7e3d50f880052d1c10af" exitCode=0 Jul 18 00:55:16.102014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:16.101856 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2984k" event={"ID":"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f","Type":"ContainerDied","Data":"5db4f9d8673eb206b84d700a740a19e89142bc467e5a7e3d50f880052d1c10af"} Jul 18 00:55:16.202173 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:16.202116 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:16.255764 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:16.255734 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:17.110787 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:17.110749 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2984k" event={"ID":"b4af8641-1c51-4e5a-baa5-8c634b2c7b4f","Type":"ContainerStarted","Data":"062f0310d23360d133ae686b1e733783b0509069287d3cc2567ea0636af11bcb"} Jul 18 00:55:17.132660 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:17.132595 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2984k" podStartSLOduration=7.9500965919999995 podStartE2EDuration="38.132576641s" totalImagesPullingTime="30.182480049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:17.131028384 +0000 UTC m=+38.869900601" watchObservedRunningTime="2026-07-18 00:55:17.132576641 +0000 UTC m=+38.871448858" Jul 18 00:55:17.254764 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:17.254707 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:17.351634 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:17.351566 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:17.910309 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:17.910273 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:17.910473 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:17.910430 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:55:17.910473 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:17.910453 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55bf795c4d-zdh2z: secret "image-registry-tls" not found Jul 18 00:55:17.910574 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:17.910526 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls podName:be34618f-4a94-4229-95e7-e35e986fe882 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:21.910505068 +0000 UTC m=+43.649377289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls") pod "image-registry-55bf795c4d-zdh2z" (UID: "be34618f-4a94-4229-95e7-e35e986fe882") : secret "image-registry-tls" not found Jul 18 00:55:18.011253 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:18.011213 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-h9s8j\" (UID: \"9cbe7c41-dfa5-4468-a365-12ab53a04abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:18.011430 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:18.011373 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 18 00:55:18.011482 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:18.011447 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls podName:9cbe7c41-dfa5-4468-a365-12ab53a04abe nodeName:}" failed. No retries permitted until 2026-07-18 00:55:22.011426775 +0000 UTC m=+43.750298996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-h9s8j" (UID: "9cbe7c41-dfa5-4468-a365-12ab53a04abe") : secret "samples-operator-tls" not found Jul 18 00:55:18.111759 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:18.111719 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:18.112283 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:18.111877 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:55:18.112283 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:18.111952 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls podName:8e5e186f-bc53-4ddb-820e-78bb5eb24953 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:22.111930778 +0000 UTC m=+43.850802986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls") pod "dns-default-w2rgw" (UID: "8e5e186f-bc53-4ddb-820e-78bb5eb24953") : secret "dns-default-metrics-tls" not found Jul 18 00:55:19.057122 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:19.057089 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:19.157543 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:19.157497 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:21.876091 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:21.876051 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr"] Jul 18 00:55:21.893329 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:21.892957 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr"] Jul 18 00:55:21.893329 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:21.893075 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:21.896462 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:21.895623 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 18 00:55:21.896462 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:21.895892 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 18 00:55:21.896462 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:21.896150 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jrfmj\"" Jul 18 00:55:21.944594 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:21.944552 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:21.944781 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:21.944625 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-pqgqr\" (UID: \"39c30f4c-bde7-4bae-8d45-fb53dc458a0d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:21.944781 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:21.944656 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pqgqr\" (UID: \"39c30f4c-bde7-4bae-8d45-fb53dc458a0d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:21.944781 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:21.944728 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:55:21.944781 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:21.944750 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55bf795c4d-zdh2z: secret "image-registry-tls" not found Jul 18 00:55:21.945005 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:21.944811 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls podName:be34618f-4a94-4229-95e7-e35e986fe882 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:29.944788959 +0000 UTC m=+51.683661165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls") pod "image-registry-55bf795c4d-zdh2z" (UID: "be34618f-4a94-4229-95e7-e35e986fe882") : secret "image-registry-tls" not found Jul 18 00:55:22.017259 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.017222 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:22.050235 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.046422 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-pqgqr\" (UID: \"39c30f4c-bde7-4bae-8d45-fb53dc458a0d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:22.050235 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.045634 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-pqgqr\" (UID: \"39c30f4c-bde7-4bae-8d45-fb53dc458a0d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:22.050235 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.046578 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pqgqr\" (UID: \"39c30f4c-bde7-4bae-8d45-fb53dc458a0d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:22.050235 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.046758 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-h9s8j\" (UID: \"9cbe7c41-dfa5-4468-a365-12ab53a04abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:22.050235 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:22.046889 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 18 00:55:22.050235 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:22.046950 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls podName:9cbe7c41-dfa5-4468-a365-12ab53a04abe nodeName:}" failed. No retries permitted until 2026-07-18 00:55:30.046934614 +0000 UTC m=+51.785806809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-h9s8j" (UID: "9cbe7c41-dfa5-4468-a365-12ab53a04abe") : secret "samples-operator-tls" not found Jul 18 00:55:22.050235 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:22.047457 2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:55:22.050235 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:22.047514 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert podName:39c30f4c-bde7-4bae-8d45-fb53dc458a0d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:22.547497086 +0000 UTC m=+44.286369283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-pqgqr" (UID: "39c30f4c-bde7-4bae-8d45-fb53dc458a0d") : secret "networking-console-plugin-cert" not found Jul 18 00:55:22.117275 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.117239 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:22.126281 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.126244 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tkb76" event={"ID":"f3532f53-ed69-425d-bfca-e74bcce0c08b","Type":"ContainerStarted","Data":"72339ca9bed2d4abc2d78009f18d935fc9d47a87b6a5625d80dc213db967618a"} Jul 18 00:55:22.127812 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.127788 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" event={"ID":"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c","Type":"ContainerStarted","Data":"f27cb2cdf2a11b6068689715e7a78f1cc44dd4a5292768f089983d25c91b25c6"} Jul 18 00:55:22.129400 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.129376 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7n6hg" event={"ID":"285d4b11-9773-491e-b59a-cb07038656bb","Type":"ContainerStarted","Data":"529b3fffee8ed076e5309261d24b2d3de3e02738cec95671efec6cdb213bb6e4"} Jul 18 00:55:22.131070 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.131050 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/0.log" Jul 18 00:55:22.131172 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.131137 2585 generic.go:356] "Generic (PLEG): container finished" podID="2acdbbb6-f965-408b-a4e1-525354af72c7" containerID="e0dba53943323ba54b825861fea18d9679542055aad56e7962ffc60cc6a3b9f7" exitCode=255 Jul 18 00:55:22.131235 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.131177 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" event={"ID":"2acdbbb6-f965-408b-a4e1-525354af72c7","Type":"ContainerDied","Data":"e0dba53943323ba54b825861fea18d9679542055aad56e7962ffc60cc6a3b9f7"} Jul 18 00:55:22.131332 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.131313 2585 scope.go:117] "RemoveContainer" containerID="e0dba53943323ba54b825861fea18d9679542055aad56e7962ffc60cc6a3b9f7" Jul 18 00:55:22.133146 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.133122 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" event={"ID":"4ccd3551-04ec-4cc3-bb2e-44987fe5370f","Type":"ContainerStarted","Data":"2bbe661b806a5379dd5d5d016165f58760cc858bad2f23ad3abc53a1b4a2eedd"} Jul 18 00:55:22.134732 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.134711 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p7cxb" event={"ID":"32a7ad20-f52b-4b29-911b-28ec26b6e752","Type":"ContainerStarted","Data":"05d64c8ff23f7d106d7b85da5012e50b16647436ad5869bbf3606c5b1ddc976d"} Jul 18 00:55:22.147506 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.147486 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:22.147634 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:22.147617 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:55:22.147707 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:22.147673 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls podName:8e5e186f-bc53-4ddb-820e-78bb5eb24953 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:30.147656136 +0000 UTC m=+51.886528342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls") pod "dns-default-w2rgw" (UID: "8e5e186f-bc53-4ddb-820e-78bb5eb24953") : secret "dns-default-metrics-tls" not found Jul 18 00:55:22.149298 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.149245 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tkb76" podStartSLOduration=20.138173789 podStartE2EDuration="27.149229451s" totalImagesPullingTime="7.011055662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:22.14913646 +0000 UTC m=+43.888008677" watchObservedRunningTime="2026-07-18 00:55:22.149229451 +0000 UTC m=+43.888101670" Jul 18 00:55:22.166051 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.166010 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" podStartSLOduration=33.486615183 podStartE2EDuration="40.165968064s" totalImagesPullingTime="6.679352881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:22.165507726 +0000 UTC m=+43.904379944" watchObservedRunningTime="2026-07-18 00:55:22.165968064 +0000 UTC m=+43.904840320" Jul 18 00:55:22.184534 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.184484 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7n6hg" podStartSLOduration=1.6298845370000001 podStartE2EDuration="8.184464558s" totalImagesPullingTime="6.554580021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:22.184205425 +0000 UTC m=+43.923077643" watchObservedRunningTime="2026-07-18 00:55:22.184464558 +0000 UTC m=+43.923336775" Jul 18 00:55:22.203174 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.203123 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" podStartSLOduration=33.51711681 podStartE2EDuration="40.203103977s" totalImagesPullingTime="6.685987167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:22.202351689 +0000 UTC m=+43.941223906" watchObservedRunningTime="2026-07-18 00:55:22.203103977 +0000 UTC m=+43.941976194" Jul 18 00:55:22.217486 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.217458 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:22.243064 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.243011 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-p7cxb" podStartSLOduration=33.639490807 podStartE2EDuration="40.242963495s" totalImagesPullingTime="6.603472688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:22.242421124 +0000 UTC m=+43.981293338" watchObservedRunningTime="2026-07-18 00:55:22.242963495 +0000 UTC m=+43.981835710" Jul 18 00:55:22.317792 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.317761 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:22.376277 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.376202 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:22.551803 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.551769 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pqgqr\" (UID: \"39c30f4c-bde7-4bae-8d45-fb53dc458a0d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:22.551971 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:22.551941 2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:55:22.552073 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:22.552044 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert podName:39c30f4c-bde7-4bae-8d45-fb53dc458a0d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:23.552022364 +0000 UTC m=+45.290894569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-pqgqr" (UID: "39c30f4c-bde7-4bae-8d45-fb53dc458a0d") : secret "networking-console-plugin-cert" not found Jul 18 00:55:22.741213 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.741128 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:22.778348 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.778310 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7"] Jul 18 00:55:22.803921 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.803887 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7" Jul 18 00:55:22.806171 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.806148 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 18 00:55:22.806777 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.806750 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xjngb\"" Jul 18 00:55:22.806877 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.806774 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 18 00:55:22.808458 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.808439 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7"] Jul 18 00:55:22.822113 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.822088 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:22.855309 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.855281 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bljwg\" (UniqueName: \"kubernetes.io/projected/b778939c-7796-4f3e-8f54-5b4676b0d8df-kube-api-access-bljwg\") pod \"migrator-7cc9c7ffd7-ttnt7\" (UID: \"b778939c-7796-4f3e-8f54-5b4676b0d8df\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7" Jul 18 00:55:22.877342 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.877310 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:22.955719 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.955682 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bljwg\" (UniqueName: \"kubernetes.io/projected/b778939c-7796-4f3e-8f54-5b4676b0d8df-kube-api-access-bljwg\") pod \"migrator-7cc9c7ffd7-ttnt7\" (UID: \"b778939c-7796-4f3e-8f54-5b4676b0d8df\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7" Jul 18 00:55:22.965601 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:22.965571 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bljwg\" (UniqueName: \"kubernetes.io/projected/b778939c-7796-4f3e-8f54-5b4676b0d8df-kube-api-access-bljwg\") pod \"migrator-7cc9c7ffd7-ttnt7\" (UID: \"b778939c-7796-4f3e-8f54-5b4676b0d8df\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7" Jul 18 00:55:23.114045 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.114017 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7" Jul 18 00:55:23.139979 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.139957 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 00:55:23.140479 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.140460 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/0.log" Jul 18 00:55:23.140579 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.140504 2585 generic.go:356] "Generic (PLEG): container finished" podID="2acdbbb6-f965-408b-a4e1-525354af72c7" containerID="4121344be116ac38295a9460ad8b4b802594329e9097d33419022ab0154160a0" exitCode=255 Jul 18 00:55:23.140648 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.140623 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" event={"ID":"2acdbbb6-f965-408b-a4e1-525354af72c7","Type":"ContainerDied","Data":"4121344be116ac38295a9460ad8b4b802594329e9097d33419022ab0154160a0"} Jul 18 00:55:23.140708 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.140686 2585 scope.go:117] "RemoveContainer" containerID="e0dba53943323ba54b825861fea18d9679542055aad56e7962ffc60cc6a3b9f7" Jul 18 00:55:23.141438 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.140829 2585 scope.go:117] "RemoveContainer" containerID="4121344be116ac38295a9460ad8b4b802594329e9097d33419022ab0154160a0" Jul 18 00:55:23.141438 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:23.141061 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-c5xzb_openshift-console-operator(2acdbbb6-f965-408b-a4e1-525354af72c7)\"" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" podUID="2acdbbb6-f965-408b-a4e1-525354af72c7" Jul 18 00:55:23.195253 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.195207 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:23.262771 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.262735 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7"] Jul 18 00:55:23.266394 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:23.266367 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb778939c_7796_4f3e_8f54_5b4676b0d8df.slice/crio-7ba65d263f58580a5c37e68897df5360c918e9a038f36fbc1996919e9fc69e37 WatchSource:0}: Error finding container 7ba65d263f58580a5c37e68897df5360c918e9a038f36fbc1996919e9fc69e37: Status 404 returned error can't find the container with id 7ba65d263f58580a5c37e68897df5360c918e9a038f36fbc1996919e9fc69e37 Jul 18 00:55:23.462075 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.461960 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:23.562574 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.562534 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pqgqr\" (UID: \"39c30f4c-bde7-4bae-8d45-fb53dc458a0d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:23.562778 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:23.562703 2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:55:23.562843 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:23.562786 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert podName:39c30f4c-bde7-4bae-8d45-fb53dc458a0d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:25.562764839 +0000 UTC m=+47.301637052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-pqgqr" (UID: "39c30f4c-bde7-4bae-8d45-fb53dc458a0d") : secret "networking-console-plugin-cert" not found Jul 18 00:55:23.565414 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:23.565389 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:24.145556 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:24.145526 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 00:55:24.146020 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:24.145893 2585 scope.go:117] "RemoveContainer" containerID="4121344be116ac38295a9460ad8b4b802594329e9097d33419022ab0154160a0" Jul 18 00:55:24.146137 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:24.146108 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-c5xzb_openshift-console-operator(2acdbbb6-f965-408b-a4e1-525354af72c7)\"" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" podUID="2acdbbb6-f965-408b-a4e1-525354af72c7" Jul 18 00:55:24.146776 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:24.146760 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7" event={"ID":"b778939c-7796-4f3e-8f54-5b4676b0d8df","Type":"ContainerStarted","Data":"7ba65d263f58580a5c37e68897df5360c918e9a038f36fbc1996919e9fc69e37"} Jul 18 00:55:24.341134 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:24.341099 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:24.436780 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:24.436694 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:24.487962 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:24.487925 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:24.536050 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:24.536015 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:24.536210 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:24.536088 2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:25.066742 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.066709 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gpgvl"] Jul 18 00:55:25.080464 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.080431 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gpgvl"] Jul 18 00:55:25.080578 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.080561 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gpgvl" Jul 18 00:55:25.083136 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.083119 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 18 00:55:25.083232 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.083119 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 18 00:55:25.083888 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.083871 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6pfhp\"" Jul 18 00:55:25.084298 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.084213 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 18 00:55:25.084298 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.084240 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 18 00:55:25.103205 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.103177 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:25.154618 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.154579 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7" event={"ID":"b778939c-7796-4f3e-8f54-5b4676b0d8df","Type":"ContainerStarted","Data":"3df28abe7dc3ca588eddbfad4afca599ef9d07efe9370eefd83ed97adcbe40c3"} Jul 18 00:55:25.155027 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.154808 2585 scope.go:117] "RemoveContainer" containerID="4121344be116ac38295a9460ad8b4b802594329e9097d33419022ab0154160a0" Jul 18 00:55:25.155027 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:25.154948 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-c5xzb_openshift-console-operator(2acdbbb6-f965-408b-a4e1-525354af72c7)\"" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" podUID="2acdbbb6-f965-408b-a4e1-525354af72c7" Jul 18 00:55:25.158776 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.158753 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:25.177469 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.177400 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/863cb545-7d18-4162-9dc4-19a72b362ab4-signing-cabundle\") pod \"service-ca-58598695f7-gpgvl\" (UID: \"863cb545-7d18-4162-9dc4-19a72b362ab4\") " pod="openshift-service-ca/service-ca-58598695f7-gpgvl" Jul 18 00:55:25.177591 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.177512 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/863cb545-7d18-4162-9dc4-19a72b362ab4-signing-key\") pod \"service-ca-58598695f7-gpgvl\" (UID: \"863cb545-7d18-4162-9dc4-19a72b362ab4\") " pod="openshift-service-ca/service-ca-58598695f7-gpgvl" Jul 18 00:55:25.177591 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.177560 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dckn8\" (UniqueName: \"kubernetes.io/projected/863cb545-7d18-4162-9dc4-19a72b362ab4-kube-api-access-dckn8\") pod \"service-ca-58598695f7-gpgvl\" (UID: \"863cb545-7d18-4162-9dc4-19a72b362ab4\") " pod="openshift-service-ca/service-ca-58598695f7-gpgvl" Jul 18 00:55:25.278697 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.278661 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/863cb545-7d18-4162-9dc4-19a72b362ab4-signing-key\") pod \"service-ca-58598695f7-gpgvl\" (UID: \"863cb545-7d18-4162-9dc4-19a72b362ab4\") " pod="openshift-service-ca/service-ca-58598695f7-gpgvl" Jul 18 00:55:25.278873 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.278722 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dckn8\" (UniqueName: \"kubernetes.io/projected/863cb545-7d18-4162-9dc4-19a72b362ab4-kube-api-access-dckn8\") pod \"service-ca-58598695f7-gpgvl\" (UID: \"863cb545-7d18-4162-9dc4-19a72b362ab4\") " pod="openshift-service-ca/service-ca-58598695f7-gpgvl" Jul 18 00:55:25.278873 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.278755 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/863cb545-7d18-4162-9dc4-19a72b362ab4-signing-cabundle\") pod \"service-ca-58598695f7-gpgvl\" (UID: \"863cb545-7d18-4162-9dc4-19a72b362ab4\") " pod="openshift-service-ca/service-ca-58598695f7-gpgvl" Jul 18 00:55:25.279405 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.279388 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/863cb545-7d18-4162-9dc4-19a72b362ab4-signing-cabundle\") pod \"service-ca-58598695f7-gpgvl\" (UID: \"863cb545-7d18-4162-9dc4-19a72b362ab4\") " pod="openshift-service-ca/service-ca-58598695f7-gpgvl" Jul 18 00:55:25.281235 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.281220 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/863cb545-7d18-4162-9dc4-19a72b362ab4-signing-key\") pod \"service-ca-58598695f7-gpgvl\" (UID: \"863cb545-7d18-4162-9dc4-19a72b362ab4\") " pod="openshift-service-ca/service-ca-58598695f7-gpgvl" Jul 18 00:55:25.286701 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.286682 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dckn8\" (UniqueName: \"kubernetes.io/projected/863cb545-7d18-4162-9dc4-19a72b362ab4-kube-api-access-dckn8\") pod \"service-ca-58598695f7-gpgvl\" (UID: \"863cb545-7d18-4162-9dc4-19a72b362ab4\") " pod="openshift-service-ca/service-ca-58598695f7-gpgvl" Jul 18 00:55:25.368147 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.368118 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:25.409367 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.409343 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gpgvl" Jul 18 00:55:25.420471 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.420438 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:25.547389 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.547364 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gpgvl"] Jul 18 00:55:25.549909 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:25.549886 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863cb545_7d18_4162_9dc4_19a72b362ab4.slice/crio-07c430236226aed3e269ebd463febf8f84a384a1333cafae84fd61c1d5059db3 WatchSource:0}: Error finding container 07c430236226aed3e269ebd463febf8f84a384a1333cafae84fd61c1d5059db3: Status 404 returned error can't find the container with id 07c430236226aed3e269ebd463febf8f84a384a1333cafae84fd61c1d5059db3 Jul 18 00:55:25.581778 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:25.581755 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pqgqr\" (UID: \"39c30f4c-bde7-4bae-8d45-fb53dc458a0d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:25.581924 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:25.581908 2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:55:25.582003 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:25.581967 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert podName:39c30f4c-bde7-4bae-8d45-fb53dc458a0d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:29.581952301 +0000 UTC m=+51.320824495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-pqgqr" (UID: "39c30f4c-bde7-4bae-8d45-fb53dc458a0d") : secret "networking-console-plugin-cert" not found Jul 18 00:55:26.004056 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:26.004019 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:26.160397 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:26.160359 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7" event={"ID":"b778939c-7796-4f3e-8f54-5b4676b0d8df","Type":"ContainerStarted","Data":"3ae213df9adf5b1548eb49712dc2ea66b4ee16413057e86fbaf9c65f726bd306"} Jul 18 00:55:26.161852 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:26.161834 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gpgvl" event={"ID":"863cb545-7d18-4162-9dc4-19a72b362ab4","Type":"ContainerStarted","Data":"e5e04925e058d0ed763649d11f8d0aaaa83573bda5cb825e93b87e09f293a578"} Jul 18 00:55:26.161937 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:26.161870 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gpgvl" event={"ID":"863cb545-7d18-4162-9dc4-19a72b362ab4","Type":"ContainerStarted","Data":"07c430236226aed3e269ebd463febf8f84a384a1333cafae84fd61c1d5059db3"} Jul 18 00:55:26.182696 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:26.182644 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ttnt7" podStartSLOduration=2.535058714 podStartE2EDuration="4.182629481s" totalImagesPullingTime="1.647570767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:26.182020824 +0000 UTC m=+47.920893041" watchObservedRunningTime="2026-07-18 00:55:26.182629481 +0000 UTC m=+47.921501696" Jul 18 00:55:26.202968 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:26.202919 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-gpgvl" podStartSLOduration=1.202905769 podStartE2EDuration="1.202905769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:26.202325299 +0000 UTC m=+47.941197517" watchObservedRunningTime="2026-07-18 00:55:26.202905769 +0000 UTC m=+47.941777985" Jul 18 00:55:26.579720 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:26.579686 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:26.712462 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:26.712413 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:26.850456 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:26.850421 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:26.981515 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:26.981484 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:27.058754 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:27.058670 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:27.159517 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:27.159433 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:27.265602 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:27.265562 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:28.273396 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:28.273364 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:28.430114 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:28.430065 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:28.661289 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:28.661260 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:28.857590 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:28.857550 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:29.059558 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:29.059470 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:29.275266 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:29.275228 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:29.463205 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:29.463172 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:29.613266 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:29.613231 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pqgqr\" (UID: \"39c30f4c-bde7-4bae-8d45-fb53dc458a0d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:29.613415 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:29.613376 2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:55:29.613449 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:29.613443 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert podName:39c30f4c-bde7-4bae-8d45-fb53dc458a0d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:37.613427141 +0000 UTC m=+59.352299336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-pqgqr" (UID: "39c30f4c-bde7-4bae-8d45-fb53dc458a0d") : secret "networking-console-plugin-cert" not found Jul 18 00:55:30.016576 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.016540 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:30.016759 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:30.016690 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:55:30.016759 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:30.016707 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55bf795c4d-zdh2z: secret "image-registry-tls" not found Jul 18 00:55:30.016838 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:30.016761 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls podName:be34618f-4a94-4229-95e7-e35e986fe882 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:46.016745147 +0000 UTC m=+67.755617341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls") pod "image-registry-55bf795c4d-zdh2z" (UID: "be34618f-4a94-4229-95e7-e35e986fe882") : secret "image-registry-tls" not found Jul 18 00:55:30.064890 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.064855 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:30.117501 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.117463 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-h9s8j\" (UID: \"9cbe7c41-dfa5-4468-a365-12ab53a04abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:30.120185 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.120152 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cbe7c41-dfa5-4468-a365-12ab53a04abe-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-h9s8j\" (UID: \"9cbe7c41-dfa5-4468-a365-12ab53a04abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:30.188864 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.188836 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" Jul 18 00:55:30.218390 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.218360 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:30.221037 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.221010 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e5e186f-bc53-4ddb-820e-78bb5eb24953-metrics-tls\") pod \"dns-default-w2rgw\" (UID: \"8e5e186f-bc53-4ddb-820e-78bb5eb24953\") " pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:30.262045 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.262014 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:30.266447 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.266423 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:30.347879 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.347852 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j"] Jul 18 00:55:30.417491 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.417469 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w2rgw"] Jul 18 00:55:30.420775 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:30.420750 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5e186f_bc53_4ddb_820e_78bb5eb24953.slice/crio-c0be2276084e62eb09eb78d20d992069e986d930d4f00d02c4265c0c184fb38e WatchSource:0}: Error finding container c0be2276084e62eb09eb78d20d992069e986d930d4f00d02c4265c0c184fb38e: Status 404 returned error can't find the container with id c0be2276084e62eb09eb78d20d992069e986d930d4f00d02c4265c0c184fb38e Jul 18 00:55:30.468890 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.468860 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:30.535996 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.535890 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:30.863394 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:30.863358 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:31.060673 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:31.060588 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:31.162287 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:31.162167 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:31.183344 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:31.183306 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2rgw" event={"ID":"8e5e186f-bc53-4ddb-820e-78bb5eb24953","Type":"ContainerStarted","Data":"c0be2276084e62eb09eb78d20d992069e986d930d4f00d02c4265c0c184fb38e"} Jul 18 00:55:31.184714 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:31.184688 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" event={"ID":"9cbe7c41-dfa5-4468-a365-12ab53a04abe","Type":"ContainerStarted","Data":"a3a30abd3c798879d3e742a68765e5f6050d66b4a339343be19e48f4c469530d"} Jul 18 00:55:31.659451 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:31.659331 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:32.060880 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:32.060798 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:32.459880 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:32.459850 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:32.658513 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:32.658484 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:32.917431 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:32.917402 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:33.058274 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:33.058184 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:33.193090 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:33.193052 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2rgw" event={"ID":"8e5e186f-bc53-4ddb-820e-78bb5eb24953","Type":"ContainerStarted","Data":"a7cd5fa1b94a03886a5a88355356d6a117ed918191a9743fb95d47e1aab72848"} Jul 18 00:55:33.193257 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:33.193107 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2rgw" event={"ID":"8e5e186f-bc53-4ddb-820e-78bb5eb24953","Type":"ContainerStarted","Data":"1f73c932adda0cede3a83df4ba7a1837b59ee2f4dc94562945a26b4a3a02efed"} Jul 18 00:55:33.193257 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:33.193169 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:33.194748 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:33.194723 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" event={"ID":"9cbe7c41-dfa5-4468-a365-12ab53a04abe","Type":"ContainerStarted","Data":"352b6150601d8951c7054faeeacc65c26300d9122c111133130e29a453b33aaa"} Jul 18 00:55:33.194836 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:33.194770 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" event={"ID":"9cbe7c41-dfa5-4468-a365-12ab53a04abe","Type":"ContainerStarted","Data":"45edbf0f1f7b63647c940fe247b2e1faad8b22616929588998087a0b7efc39ce"} Jul 18 00:55:33.209251 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:33.209214 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w2rgw" podStartSLOduration=17.026189232 podStartE2EDuration="19.20920106s" totalImagesPullingTime="2.183011828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:33.208713946 +0000 UTC m=+54.947586162" watchObservedRunningTime="2026-07-18 00:55:33.20920106 +0000 UTC m=+54.948073275" Jul 18 00:55:33.223709 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:33.223666 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-h9s8j" podStartSLOduration=49.033852124 podStartE2EDuration="51.223648186s" totalImagesPullingTime="2.189796062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:33.223385753 +0000 UTC m=+54.962257972" watchObservedRunningTime="2026-07-18 00:55:33.223648186 +0000 UTC m=+54.962520404" Jul 18 00:55:33.860823 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:33.860786 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:34.256978 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:34.256898 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:34.460413 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:34.460377 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:34.656306 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:34.656271 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:34.886471 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:34.886437 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" limit=1024 Jul 18 00:55:37.679293 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:37.679251 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pqgqr\" (UID: \"39c30f4c-bde7-4bae-8d45-fb53dc458a0d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:37.681719 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:37.681700 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39c30f4c-bde7-4bae-8d45-fb53dc458a0d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-pqgqr\" (UID: \"39c30f4c-bde7-4bae-8d45-fb53dc458a0d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:37.806472 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:37.806438 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" Jul 18 00:55:37.982397 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:37.982319 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr"] Jul 18 00:55:37.985115 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:37.985086 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c30f4c_bde7_4bae_8d45_fb53dc458a0d.slice/crio-7e53aa192ae9c597835ba2b1519cf910f7b24e68a3fdb4dc9d011c66b6aca731 WatchSource:0}: Error finding container 7e53aa192ae9c597835ba2b1519cf910f7b24e68a3fdb4dc9d011c66b6aca731: Status 404 returned error can't find the container with id 7e53aa192ae9c597835ba2b1519cf910f7b24e68a3fdb4dc9d011c66b6aca731 Jul 18 00:55:38.217359 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:38.217326 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" event={"ID":"39c30f4c-bde7-4bae-8d45-fb53dc458a0d","Type":"ContainerStarted","Data":"7e53aa192ae9c597835ba2b1519cf910f7b24e68a3fdb4dc9d011c66b6aca731"} Jul 18 00:55:39.223140 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:39.223091 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" event={"ID":"39c30f4c-bde7-4bae-8d45-fb53dc458a0d","Type":"ContainerStarted","Data":"aacbe9e2e35f132490bcd8a18152f924dfcd7ef69202c9b9f72c058be9aae5e4"} Jul 18 00:55:39.238533 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:39.238491 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-pqgqr" podStartSLOduration=17.218558167 podStartE2EDuration="18.238477716s" totalImagesPullingTime="1.019919549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:39.237588063 +0000 UTC m=+60.976460280" watchObservedRunningTime="2026-07-18 00:55:39.238477716 +0000 UTC m=+60.977349935" Jul 18 00:55:39.791054 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:39.791023 2585 scope.go:117] "RemoveContainer" containerID="4121344be116ac38295a9460ad8b4b802594329e9097d33419022ab0154160a0" Jul 18 00:55:40.078679 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:40.078606 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2kwdv" Jul 18 00:55:40.228604 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:40.228576 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 00:55:40.229095 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:40.228703 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" event={"ID":"2acdbbb6-f965-408b-a4e1-525354af72c7","Type":"ContainerStarted","Data":"f7a16739bd68c5279adfaea5cc184fe198ce2ed03be3a1b37143779dfda5477b"} Jul 18 00:55:40.229165 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:40.229114 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:40.244024 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:40.243960 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" podStartSLOduration=51.606650178 podStartE2EDuration="58.243947094s" totalImagesPullingTime="6.637296916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:40.243358497 +0000 UTC m=+61.982230715" watchObservedRunningTime="2026-07-18 00:55:40.243947094 +0000 UTC m=+61.982819289" Jul 18 00:55:40.575417 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:40.575389 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-c5xzb" Jul 18 00:55:43.200427 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.200396 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w2rgw" Jul 18 00:55:43.934339 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.934309 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-h75lr"] Jul 18 00:55:43.938551 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.938529 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b"] Jul 18 00:55:43.938713 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.938689 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:43.941917 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.941896 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 18 00:55:43.941917 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.941914 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 18 00:55:43.942149 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.941904 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 18 00:55:43.942149 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.941941 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6v6cz\"" Jul 18 00:55:43.942423 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.942404 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg"] Jul 18 00:55:43.942531 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.942518 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:43.942670 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.942653 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 18 00:55:43.945874 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.945855 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:43.946599 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.946570 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 18 00:55:43.949177 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.949154 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-h75lr"] Jul 18 00:55:43.949720 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.949703 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 18 00:55:43.949851 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.949823 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 18 00:55:43.949922 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.949894 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 18 00:55:43.950017 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.949950 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 18 00:55:43.950017 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.949894 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 18 00:55:43.950200 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.950185 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 18 00:55:43.950270 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.950250 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 18 00:55:43.950506 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.950490 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 18 00:55:43.960484 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.960460 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b"] Jul 18 00:55:43.961663 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.961628 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg"] Jul 18 00:55:43.962641 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.962621 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh"] Jul 18 00:55:43.967613 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.967598 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh" Jul 18 00:55:43.970694 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.970673 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 18 00:55:43.970897 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.970881 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-zbwfz\"" Jul 18 00:55:43.977802 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:43.977781 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh"] Jul 18 00:55:44.030290 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030261 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-ca\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.030432 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030316 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-hub\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.030432 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030342 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68a39f6b-0e28-4a7a-9073-43193d511ec6-tmp\") pod \"klusterlet-addon-workmgr-59dcbf9994-zs5dg\" (UID: \"68a39f6b-0e28-4a7a-9073-43193d511ec6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:44.030432 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030386 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c10beb1-5448-44d2-ade8-c67b60764c62-service-ca-bundle\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.030432 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030419 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0fdf902e-5662-41db-80ca-09e314578438-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5875fcc7c8-lplxh\" (UID: \"0fdf902e-5662-41db-80ca-09e314578438\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh" Jul 18 00:55:44.030574 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030449 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.030574 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030475 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68a39f6b-0e28-4a7a-9073-43193d511ec6-klusterlet-config\") pod \"klusterlet-addon-workmgr-59dcbf9994-zs5dg\" (UID: \"68a39f6b-0e28-4a7a-9073-43193d511ec6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:44.030574 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030544 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.030574 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030568 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.030704 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030604 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfmdl\" (UniqueName: \"kubernetes.io/projected/68a39f6b-0e28-4a7a-9073-43193d511ec6-kube-api-access-dfmdl\") pod \"klusterlet-addon-workmgr-59dcbf9994-zs5dg\" (UID: \"68a39f6b-0e28-4a7a-9073-43193d511ec6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:44.030704 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030626 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts77x\" (UniqueName: \"kubernetes.io/projected/9c10beb1-5448-44d2-ade8-c67b60764c62-kube-api-access-ts77x\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.030704 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030642 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c10beb1-5448-44d2-ade8-c67b60764c62-tmp\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.030704 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030657 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7kdc\" (UniqueName: \"kubernetes.io/projected/0fdf902e-5662-41db-80ca-09e314578438-kube-api-access-n7kdc\") pod \"managed-serviceaccount-addon-agent-5875fcc7c8-lplxh\" (UID: \"0fdf902e-5662-41db-80ca-09e314578438\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh" Jul 18 00:55:44.030832 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030759 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbtkd\" (UniqueName: \"kubernetes.io/projected/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-kube-api-access-nbtkd\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.030832 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030789 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9c10beb1-5448-44d2-ade8-c67b60764c62-snapshots\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.030832 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030804 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c10beb1-5448-44d2-ade8-c67b60764c62-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.030832 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.030824 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c10beb1-5448-44d2-ade8-c67b60764c62-serving-cert\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.072048 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.072016 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k"] Jul 18 00:55:44.075323 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.075303 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bc696d8b6-hwmrm"] Jul 18 00:55:44.075452 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.075435 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" Jul 18 00:55:44.080070 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.080052 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-9phgq"] Jul 18 00:55:44.080155 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.080135 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.081730 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.081706 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 18 00:55:44.082184 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.082168 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 18 00:55:44.083008 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.082970 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sgf7r\"" Jul 18 00:55:44.083312 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.083297 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-9phgq" Jul 18 00:55:44.083519 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.083501 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 18 00:55:44.083664 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.083528 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 18 00:55:44.083664 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.083544 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 18 00:55:44.083664 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.083612 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 18 00:55:44.083853 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.083682 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 18 00:55:44.083977 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.083956 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 18 00:55:44.083977 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.083970 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 18 00:55:44.084140 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.083997 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 18 00:55:44.086348 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.084954 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2l6t2\"" Jul 18 00:55:44.087829 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.087813 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 18 00:55:44.088059 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.088046 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pw9gj\"" Jul 18 00:55:44.088251 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.088233 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 18 00:55:44.089099 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.089079 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k"] Jul 18 00:55:44.097716 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.097698 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-9phgq"] Jul 18 00:55:44.112416 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.112396 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bc696d8b6-hwmrm"] Jul 18 00:55:44.131865 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.131816 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6lcg\" (UniqueName: \"kubernetes.io/projected/f3333e0b-8a2c-460a-a8da-081382fdc27a-kube-api-access-h6lcg\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.131865 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.131863 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-hub\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.132142 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.131895 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68a39f6b-0e28-4a7a-9073-43193d511ec6-tmp\") pod \"klusterlet-addon-workmgr-59dcbf9994-zs5dg\" (UID: \"68a39f6b-0e28-4a7a-9073-43193d511ec6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:44.132142 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.131921 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c10beb1-5448-44d2-ade8-c67b60764c62-service-ca-bundle\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.132452 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132431 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68a39f6b-0e28-4a7a-9073-43193d511ec6-tmp\") pod \"klusterlet-addon-workmgr-59dcbf9994-zs5dg\" (UID: \"68a39f6b-0e28-4a7a-9073-43193d511ec6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:44.132534 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132482 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0fdf902e-5662-41db-80ca-09e314578438-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5875fcc7c8-lplxh\" (UID: \"0fdf902e-5662-41db-80ca-09e314578438\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh" Jul 18 00:55:44.132534 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132511 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f3333e0b-8a2c-460a-a8da-081382fdc27a-stats-auth\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.132641 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132538 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3333e0b-8a2c-460a-a8da-081382fdc27a-metrics-certs\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.132641 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132568 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.132641 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132606 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68a39f6b-0e28-4a7a-9073-43193d511ec6-klusterlet-config\") pod \"klusterlet-addon-workmgr-59dcbf9994-zs5dg\" (UID: \"68a39f6b-0e28-4a7a-9073-43193d511ec6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:44.132641 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132624 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f3333e0b-8a2c-460a-a8da-081382fdc27a-default-certificate\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.132832 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132638 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c10beb1-5448-44d2-ade8-c67b60764c62-service-ca-bundle\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.132832 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132643 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c69592-b833-4669-99a0-1926e6421f08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wvx2k\" (UID: \"64c69592-b833-4669-99a0-1926e6421f08\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" Jul 18 00:55:44.132832 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132722 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.132832 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132749 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.132832 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132789 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfmdl\" (UniqueName: \"kubernetes.io/projected/68a39f6b-0e28-4a7a-9073-43193d511ec6-kube-api-access-dfmdl\") pod \"klusterlet-addon-workmgr-59dcbf9994-zs5dg\" (UID: \"68a39f6b-0e28-4a7a-9073-43193d511ec6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:44.132832 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132813 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts77x\" (UniqueName: \"kubernetes.io/projected/9c10beb1-5448-44d2-ade8-c67b60764c62-kube-api-access-ts77x\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.133154 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132838 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c10beb1-5448-44d2-ade8-c67b60764c62-tmp\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.133154 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132862 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7kdc\" (UniqueName: \"kubernetes.io/projected/0fdf902e-5662-41db-80ca-09e314578438-kube-api-access-n7kdc\") pod \"managed-serviceaccount-addon-agent-5875fcc7c8-lplxh\" (UID: \"0fdf902e-5662-41db-80ca-09e314578438\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh" Jul 18 00:55:44.133154 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132903 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64c69592-b833-4669-99a0-1926e6421f08-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-wvx2k\" (UID: \"64c69592-b833-4669-99a0-1926e6421f08\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" Jul 18 00:55:44.133154 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132937 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtkd\" (UniqueName: \"kubernetes.io/projected/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-kube-api-access-nbtkd\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.133154 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.132967 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3333e0b-8a2c-460a-a8da-081382fdc27a-service-ca-bundle\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.133154 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.133019 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxfft\" (UniqueName: \"kubernetes.io/projected/522e9581-bd77-498e-adfd-b78048c17673-kube-api-access-hxfft\") pod \"downloads-5bc67dcd46-9phgq\" (UID: \"522e9581-bd77-498e-adfd-b78048c17673\") " pod="openshift-console/downloads-5bc67dcd46-9phgq" Jul 18 00:55:44.133154 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.133044 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m84wb\" (UniqueName: \"kubernetes.io/projected/64c69592-b833-4669-99a0-1926e6421f08-kube-api-access-m84wb\") pod \"cluster-monitoring-operator-76cf8966f8-wvx2k\" (UID: \"64c69592-b833-4669-99a0-1926e6421f08\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" Jul 18 00:55:44.133154 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.133072 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9c10beb1-5448-44d2-ade8-c67b60764c62-snapshots\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.133154 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.133096 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c10beb1-5448-44d2-ade8-c67b60764c62-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.133154 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.133130 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c10beb1-5448-44d2-ade8-c67b60764c62-serving-cert\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.133595 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.133159 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-ca\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.135181 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.134325 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.135181 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.135135 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9c10beb1-5448-44d2-ade8-c67b60764c62-snapshots\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.135361 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.135216 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c10beb1-5448-44d2-ade8-c67b60764c62-tmp\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.135696 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.135538 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c10beb1-5448-44d2-ade8-c67b60764c62-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.136086 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.136067 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-hub\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.136311 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.136288 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/68a39f6b-0e28-4a7a-9073-43193d511ec6-klusterlet-config\") pod \"klusterlet-addon-workmgr-59dcbf9994-zs5dg\" (UID: \"68a39f6b-0e28-4a7a-9073-43193d511ec6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:44.136632 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.136613 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-ca\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.138612 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.138542 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.139097 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.139077 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.139239 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.139224 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0fdf902e-5662-41db-80ca-09e314578438-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5875fcc7c8-lplxh\" (UID: \"0fdf902e-5662-41db-80ca-09e314578438\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh" Jul 18 00:55:44.139549 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.139530 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c10beb1-5448-44d2-ade8-c67b60764c62-serving-cert\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.147875 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.147849 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfmdl\" (UniqueName: \"kubernetes.io/projected/68a39f6b-0e28-4a7a-9073-43193d511ec6-kube-api-access-dfmdl\") pod \"klusterlet-addon-workmgr-59dcbf9994-zs5dg\" (UID: \"68a39f6b-0e28-4a7a-9073-43193d511ec6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:44.148610 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.148582 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts77x\" (UniqueName: \"kubernetes.io/projected/9c10beb1-5448-44d2-ade8-c67b60764c62-kube-api-access-ts77x\") pod \"insights-operator-555d9d7885-h75lr\" (UID: \"9c10beb1-5448-44d2-ade8-c67b60764c62\") " pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.149100 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.149081 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtkd\" (UniqueName: \"kubernetes.io/projected/e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e-kube-api-access-nbtkd\") pod \"cluster-proxy-proxy-agent-6b65f59976-j4d8b\" (UID: \"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.149100 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.149092 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7kdc\" (UniqueName: \"kubernetes.io/projected/0fdf902e-5662-41db-80ca-09e314578438-kube-api-access-n7kdc\") pod \"managed-serviceaccount-addon-agent-5875fcc7c8-lplxh\" (UID: \"0fdf902e-5662-41db-80ca-09e314578438\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh" Jul 18 00:55:44.234357 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.234269 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6lcg\" (UniqueName: \"kubernetes.io/projected/f3333e0b-8a2c-460a-a8da-081382fdc27a-kube-api-access-h6lcg\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.234357 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.234320 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f3333e0b-8a2c-460a-a8da-081382fdc27a-stats-auth\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.234357 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.234339 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3333e0b-8a2c-460a-a8da-081382fdc27a-metrics-certs\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.234918 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.234382 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f3333e0b-8a2c-460a-a8da-081382fdc27a-default-certificate\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.234918 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.234417 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c69592-b833-4669-99a0-1926e6421f08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wvx2k\" (UID: \"64c69592-b833-4669-99a0-1926e6421f08\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" Jul 18 00:55:44.234918 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.234647 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64c69592-b833-4669-99a0-1926e6421f08-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-wvx2k\" (UID: \"64c69592-b833-4669-99a0-1926e6421f08\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" Jul 18 00:55:44.234918 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.234694 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3333e0b-8a2c-460a-a8da-081382fdc27a-service-ca-bundle\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.234918 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.234723 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxfft\" (UniqueName: \"kubernetes.io/projected/522e9581-bd77-498e-adfd-b78048c17673-kube-api-access-hxfft\") pod \"downloads-5bc67dcd46-9phgq\" (UID: \"522e9581-bd77-498e-adfd-b78048c17673\") " pod="openshift-console/downloads-5bc67dcd46-9phgq" Jul 18 00:55:44.234918 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.234750 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m84wb\" (UniqueName: \"kubernetes.io/projected/64c69592-b833-4669-99a0-1926e6421f08-kube-api-access-m84wb\") pod \"cluster-monitoring-operator-76cf8966f8-wvx2k\" (UID: \"64c69592-b833-4669-99a0-1926e6421f08\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" Jul 18 00:55:44.235910 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.235886 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3333e0b-8a2c-460a-a8da-081382fdc27a-service-ca-bundle\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.236098 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.236073 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64c69592-b833-4669-99a0-1926e6421f08-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-wvx2k\" (UID: \"64c69592-b833-4669-99a0-1926e6421f08\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" Jul 18 00:55:44.237212 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.237185 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f3333e0b-8a2c-460a-a8da-081382fdc27a-default-certificate\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.237212 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.237202 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64c69592-b833-4669-99a0-1926e6421f08-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wvx2k\" (UID: \"64c69592-b833-4669-99a0-1926e6421f08\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" Jul 18 00:55:44.237366 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.237202 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f3333e0b-8a2c-460a-a8da-081382fdc27a-stats-auth\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.237366 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.237229 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3333e0b-8a2c-460a-a8da-081382fdc27a-metrics-certs\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.242546 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.242527 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6lcg\" (UniqueName: \"kubernetes.io/projected/f3333e0b-8a2c-460a-a8da-081382fdc27a-kube-api-access-h6lcg\") pod \"router-default-bc696d8b6-hwmrm\" (UID: \"f3333e0b-8a2c-460a-a8da-081382fdc27a\") " pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.244030 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.244008 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m84wb\" (UniqueName: \"kubernetes.io/projected/64c69592-b833-4669-99a0-1926e6421f08-kube-api-access-m84wb\") pod \"cluster-monitoring-operator-76cf8966f8-wvx2k\" (UID: \"64c69592-b833-4669-99a0-1926e6421f08\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" Jul 18 00:55:44.244171 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.244155 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxfft\" (UniqueName: \"kubernetes.io/projected/522e9581-bd77-498e-adfd-b78048c17673-kube-api-access-hxfft\") pod \"downloads-5bc67dcd46-9phgq\" (UID: \"522e9581-bd77-498e-adfd-b78048c17673\") " pod="openshift-console/downloads-5bc67dcd46-9phgq" Jul 18 00:55:44.251399 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.251380 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-h75lr" Jul 18 00:55:44.273134 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.273108 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" Jul 18 00:55:44.279158 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.279138 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:44.284747 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.284725 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh" Jul 18 00:55:44.400705 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.400679 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" Jul 18 00:55:44.410622 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.407860 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:44.413301 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.413271 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-9phgq" Jul 18 00:55:44.436366 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.435861 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-h75lr"] Jul 18 00:55:44.475808 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.475739 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b"] Jul 18 00:55:44.505159 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.505040 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh"] Jul 18 00:55:44.513173 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:44.513134 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fdf902e_5662_41db_80ca_09e314578438.slice/crio-2a8bf851cc5b2bd5b5ea5e9ae99fcb7066e97ba4aa00bef830ca7b07418f8dec WatchSource:0}: Error finding container 2a8bf851cc5b2bd5b5ea5e9ae99fcb7066e97ba4aa00bef830ca7b07418f8dec: Status 404 returned error can't find the container with id 2a8bf851cc5b2bd5b5ea5e9ae99fcb7066e97ba4aa00bef830ca7b07418f8dec Jul 18 00:55:44.537698 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.536809 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:44.537698 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.536907 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chm2s\" (UniqueName: \"kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s\") pod \"network-check-target-4qzlg\" (UID: \"c117f41a-3ee9-41f6-a06f-96a3edf042d2\") " pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:44.537698 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.536963 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:44.544416 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.542103 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg"] Jul 18 00:55:44.544416 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.542139 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chm2s\" (UniqueName: \"kubernetes.io/projected/c117f41a-3ee9-41f6-a06f-96a3edf042d2-kube-api-access-chm2s\") pod \"network-check-target-4qzlg\" (UID: \"c117f41a-3ee9-41f6-a06f-96a3edf042d2\") " pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:44.544416 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.543686 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 00:55:44.544416 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.543806 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 00:55:44.555804 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.555778 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c29e5d41-e606-437c-8a87-3b5b002ead5d-metrics-certs\") pod \"network-metrics-daemon-rhg65\" (UID: \"c29e5d41-e606-437c-8a87-3b5b002ead5d\") " pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:44.556388 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.556330 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64302c11-8b83-4992-bf49-089c75a48e2e-original-pull-secret\") pod \"global-pull-secret-syncer-8nphz\" (UID: \"64302c11-8b83-4992-bf49-089c75a48e2e\") " pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:44.601795 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.601767 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k"] Jul 18 00:55:44.605759 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:44.605729 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c69592_b833_4669_99a0_1926e6421f08.slice/crio-aa767b9eee5e33c437b5566054d886e5598ea4668f6ba512a9da00b5255466a8 WatchSource:0}: Error finding container aa767b9eee5e33c437b5566054d886e5598ea4668f6ba512a9da00b5255466a8: Status 404 returned error can't find the container with id aa767b9eee5e33c437b5566054d886e5598ea4668f6ba512a9da00b5255466a8 Jul 18 00:55:44.607375 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.607355 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9d8vg\"" Jul 18 00:55:44.615679 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.615659 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rhg65" Jul 18 00:55:44.620510 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.620490 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bc696d8b6-hwmrm"] Jul 18 00:55:44.622557 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:44.622529 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3333e0b_8a2c_460a_a8da_081382fdc27a.slice/crio-7f7d92b0a6ff6532a21e25f059b2daa339f23176973b1353a890d297a0a3c4a0 WatchSource:0}: Error finding container 7f7d92b0a6ff6532a21e25f059b2daa339f23176973b1353a890d297a0a3c4a0: Status 404 returned error can't find the container with id 7f7d92b0a6ff6532a21e25f059b2daa339f23176973b1353a890d297a0a3c4a0 Jul 18 00:55:44.639691 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.639666 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-9phgq"] Jul 18 00:55:44.643788 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:44.643765 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522e9581_bd77_498e_adfd_b78048c17673.slice/crio-1ec0863b91547c5cac1d4e4a64e66fae20b836cc9f27585f8816a1e63e6afcb6 WatchSource:0}: Error finding container 1ec0863b91547c5cac1d4e4a64e66fae20b836cc9f27585f8816a1e63e6afcb6: Status 404 returned error can't find the container with id 1ec0863b91547c5cac1d4e4a64e66fae20b836cc9f27585f8816a1e63e6afcb6 Jul 18 00:55:44.771099 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.771020 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rhg65"] Jul 18 00:55:44.774603 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:44.774573 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29e5d41_e606_437c_8a87_3b5b002ead5d.slice/crio-6958c70084352864c52c30f70857c60fa56484c3b832e94ef2f939c0218c1f05 WatchSource:0}: Error finding container 6958c70084352864c52c30f70857c60fa56484c3b832e94ef2f939c0218c1f05: Status 404 returned error can't find the container with id 6958c70084352864c52c30f70857c60fa56484c3b832e94ef2f939c0218c1f05 Jul 18 00:55:44.805615 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.805584 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8nphz" Jul 18 00:55:44.812596 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.812570 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4tv4\"" Jul 18 00:55:44.821431 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:44.821413 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:45.204287 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.204217 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8nphz"] Jul 18 00:55:45.209663 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:45.209626 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64302c11_8b83_4992_bf49_089c75a48e2e.slice/crio-4f10a4fee78ae995e74a97aa7e39a036e2ffca9fd97958f66a53f1010d12ee17 WatchSource:0}: Error finding container 4f10a4fee78ae995e74a97aa7e39a036e2ffca9fd97958f66a53f1010d12ee17: Status 404 returned error can't find the container with id 4f10a4fee78ae995e74a97aa7e39a036e2ffca9fd97958f66a53f1010d12ee17 Jul 18 00:55:45.212962 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.211857 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4qzlg"] Jul 18 00:55:45.251922 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.251822 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8nphz" event={"ID":"64302c11-8b83-4992-bf49-089c75a48e2e","Type":"ContainerStarted","Data":"4f10a4fee78ae995e74a97aa7e39a036e2ffca9fd97958f66a53f1010d12ee17"} Jul 18 00:55:45.253414 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.253353 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh" event={"ID":"0fdf902e-5662-41db-80ca-09e314578438","Type":"ContainerStarted","Data":"2a8bf851cc5b2bd5b5ea5e9ae99fcb7066e97ba4aa00bef830ca7b07418f8dec"} Jul 18 00:55:45.256141 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.256109 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" event={"ID":"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e","Type":"ContainerStarted","Data":"41158179e86f16c4d2bcea304bf869f80de3844c96fb8b90243f84a31b7426fc"} Jul 18 00:55:45.258295 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.258267 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bc696d8b6-hwmrm" event={"ID":"f3333e0b-8a2c-460a-a8da-081382fdc27a","Type":"ContainerStarted","Data":"0c46eff12b80fe3d5472bba88b67116675f387b880350129374568c14758f7eb"} Jul 18 00:55:45.258396 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.258317 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bc696d8b6-hwmrm" event={"ID":"f3333e0b-8a2c-460a-a8da-081382fdc27a","Type":"ContainerStarted","Data":"7f7d92b0a6ff6532a21e25f059b2daa339f23176973b1353a890d297a0a3c4a0"} Jul 18 00:55:45.262268 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.262193 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" event={"ID":"64c69592-b833-4669-99a0-1926e6421f08","Type":"ContainerStarted","Data":"aa767b9eee5e33c437b5566054d886e5598ea4668f6ba512a9da00b5255466a8"} Jul 18 00:55:45.264209 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.264182 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" event={"ID":"68a39f6b-0e28-4a7a-9073-43193d511ec6","Type":"ContainerStarted","Data":"2067b97f86b67d5e6914d5016c83223f48acdcb2bc8f4bfbe9aa288409bf710a"} Jul 18 00:55:45.267930 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.267831 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4qzlg" event={"ID":"c117f41a-3ee9-41f6-a06f-96a3edf042d2","Type":"ContainerStarted","Data":"273f2039010b287c3fcae191ed8bde5704db351105fdb77c0f0c4c14bdbb5187"} Jul 18 00:55:45.270069 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.269995 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rhg65" event={"ID":"c29e5d41-e606-437c-8a87-3b5b002ead5d","Type":"ContainerStarted","Data":"6958c70084352864c52c30f70857c60fa56484c3b832e94ef2f939c0218c1f05"} Jul 18 00:55:45.271478 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.271392 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-9phgq" event={"ID":"522e9581-bd77-498e-adfd-b78048c17673","Type":"ContainerStarted","Data":"1ec0863b91547c5cac1d4e4a64e66fae20b836cc9f27585f8816a1e63e6afcb6"} Jul 18 00:55:45.275867 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.275836 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-h75lr" event={"ID":"9c10beb1-5448-44d2-ade8-c67b60764c62","Type":"ContainerStarted","Data":"113167f326ca9fc9b224a6c1fc10e500b4f7bfc7be801318e0268229970af3ab"} Jul 18 00:55:45.279396 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.279007 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bc696d8b6-hwmrm" podStartSLOduration=1.27896966 podStartE2EDuration="1.27896966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:45.278560496 +0000 UTC m=+67.017432712" watchObservedRunningTime="2026-07-18 00:55:45.27896966 +0000 UTC m=+67.017841877" Jul 18 00:55:45.408172 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.408139 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:45.414412 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:45.414221 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:46.051279 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:46.051240 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:46.068866 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:46.068744 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls\") pod \"image-registry-55bf795c4d-zdh2z\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:46.294842 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:46.294632 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wzpgs\"" Jul 18 00:55:46.303208 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:46.302872 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:46.305624 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:46.305595 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4qzlg" event={"ID":"c117f41a-3ee9-41f6-a06f-96a3edf042d2","Type":"ContainerStarted","Data":"dcf7273d2fe265f01b012ad037739f440b44156061232f4fc4227777036167da"} Jul 18 00:55:46.305750 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:46.305681 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:55:46.305836 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:46.305820 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:46.307716 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:46.307676 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bc696d8b6-hwmrm" Jul 18 00:55:46.340021 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:46.339954 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4qzlg" podStartSLOduration=67.339931811 podStartE2EDuration="1m7.339931811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:46.321654154 +0000 UTC m=+68.060526371" watchObservedRunningTime="2026-07-18 00:55:46.339931811 +0000 UTC m=+68.078804028" Jul 18 00:55:46.545429 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:46.545331 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55bf795c4d-zdh2z"] Jul 18 00:55:48.995351 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:55:48.995306 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe34618f_4a94_4229_95e7_e35e986fe882.slice/crio-4ee980246c74ec5780979a867b8301106833b0edcf65b8f0e4f4aa974d84e6c8 WatchSource:0}: Error finding container 4ee980246c74ec5780979a867b8301106833b0edcf65b8f0e4f4aa974d84e6c8: Status 404 returned error can't find the container with id 4ee980246c74ec5780979a867b8301106833b0edcf65b8f0e4f4aa974d84e6c8 Jul 18 00:55:49.324241 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:49.324137 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" event={"ID":"be34618f-4a94-4229-95e7-e35e986fe882","Type":"ContainerStarted","Data":"4ee980246c74ec5780979a867b8301106833b0edcf65b8f0e4f4aa974d84e6c8"} Jul 18 00:55:57.363591 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.363554 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" event={"ID":"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e","Type":"ContainerStarted","Data":"7d38a4f89aeaffbaba0627010da4dddd97ef0954da58e3c7f6ddf5259cb69a66"} Jul 18 00:55:57.364130 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.363612 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" event={"ID":"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e","Type":"ContainerStarted","Data":"de82eb749c7d580d28e0e5160814e64de0be08f6c9863b46ebba9277a233eac1"} Jul 18 00:55:57.364130 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.363634 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" event={"ID":"e3a66eb4-f8a0-4a85-bbc8-3aeb20eb005e","Type":"ContainerStarted","Data":"e612afb939b2fe447045a68e147a8a2672f97b597efb53b4eabacbe0385b8169"} Jul 18 00:55:57.368077 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.367445 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" event={"ID":"be34618f-4a94-4229-95e7-e35e986fe882","Type":"ContainerStarted","Data":"417b416bcb257e3d6c5a3ac64c5a60676acfffa17a55b04a51474b5ebc08d2af"} Jul 18 00:55:57.368077 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.368027 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:55:57.371145 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.371118 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" event={"ID":"64c69592-b833-4669-99a0-1926e6421f08","Type":"ContainerStarted","Data":"92c477a967df17bd76658c380ac038b3908d6f1bfea76f38c8fc9a00f52791a4"} Jul 18 00:55:57.372871 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.372838 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" event={"ID":"68a39f6b-0e28-4a7a-9073-43193d511ec6","Type":"ContainerStarted","Data":"039df98c56b9c996603cc850d9cf5e8839b50d361170a20102c9a1149ce5aec1"} Jul 18 00:55:57.373762 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.373300 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:57.374829 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.374809 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" Jul 18 00:55:57.375828 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.375804 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rhg65" event={"ID":"c29e5d41-e606-437c-8a87-3b5b002ead5d","Type":"ContainerStarted","Data":"aab9876f43c30ffcaa316c56670016ca0e2d528288676df579111c3147de01e2"} Jul 18 00:55:57.375928 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.375852 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rhg65" event={"ID":"c29e5d41-e606-437c-8a87-3b5b002ead5d","Type":"ContainerStarted","Data":"0c4653178a4df8b1d946f80a70884bb1c6d24176f926d2a189ee50e9a5622b26"} Jul 18 00:55:57.377679 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.377402 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-h75lr" event={"ID":"9c10beb1-5448-44d2-ade8-c67b60764c62","Type":"ContainerStarted","Data":"6db20800f49cdd1e4b86bbc826ba91f67676eb2cf1885fb1944773b3e195dbb7"} Jul 18 00:55:57.380059 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.379475 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8nphz" event={"ID":"64302c11-8b83-4992-bf49-089c75a48e2e","Type":"ContainerStarted","Data":"c3126c17491be7f1ee76658473fd28210077b87ee6222bd8ad5b04ae66ae2b42"} Jul 18 00:55:57.382015 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.381496 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b65f59976-j4d8b" podStartSLOduration=2.116908241 podStartE2EDuration="14.38147781s" totalImagesPullingTime="12.264569569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:57.381063015 +0000 UTC m=+79.119935233" watchObservedRunningTime="2026-07-18 00:55:57.38147781 +0000 UTC m=+79.120350029" Jul 18 00:55:57.383122 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.382707 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh" event={"ID":"0fdf902e-5662-41db-80ca-09e314578438","Type":"ContainerStarted","Data":"088650fbcbc4c5caa8fcecf56f8354d28736d21d3f332698b11d0c6f9501fb5f"} Jul 18 00:55:57.398973 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.398925 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-h75lr" podStartSLOduration=2.102274869 podStartE2EDuration="14.398906482s" totalImagesPullingTime="12.296631613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:57.397669483 +0000 UTC m=+79.136541698" watchObservedRunningTime="2026-07-18 00:55:57.398906482 +0000 UTC m=+79.137778698" Jul 18 00:55:57.416217 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.416168 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59dcbf9994-zs5dg" podStartSLOduration=2.213095375 podStartE2EDuration="14.416151139s" totalImagesPullingTime="12.203055764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:57.415614322 +0000 UTC m=+79.154486542" watchObservedRunningTime="2026-07-18 00:55:57.416151139 +0000 UTC m=+79.155023356" Jul 18 00:55:57.437934 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.437881 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wvx2k" podStartSLOduration=1.340895008 podStartE2EDuration="13.437861768s" totalImagesPullingTime="12.09696676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:57.436268141 +0000 UTC m=+79.175140359" watchObservedRunningTime="2026-07-18 00:55:57.437861768 +0000 UTC m=+79.176733987" Jul 18 00:55:57.459451 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.459180 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8nphz" podStartSLOduration=66.914301829 podStartE2EDuration="1m18.459160465s" totalImagesPullingTime="11.544858636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:57.457867899 +0000 UTC m=+79.196740115" watchObservedRunningTime="2026-07-18 00:55:57.459160465 +0000 UTC m=+79.198032683" Jul 18 00:55:57.481426 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.481382 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" podStartSLOduration=78.481365584 podStartE2EDuration="1m18.481365584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:57.479231711 +0000 UTC m=+79.218103929" watchObservedRunningTime="2026-07-18 00:55:57.481365584 +0000 UTC m=+79.220237802" Jul 18 00:55:57.496673 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.496631 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rhg65" podStartSLOduration=66.56777408 podStartE2EDuration="1m18.496618674s" totalImagesPullingTime="11.928844594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:57.495154412 +0000 UTC m=+79.234026629" watchObservedRunningTime="2026-07-18 00:55:57.496618674 +0000 UTC m=+79.235490891" Jul 18 00:55:57.518118 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.518061 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5875fcc7c8-lplxh" podStartSLOduration=2.285750191 podStartE2EDuration="14.5180449s" totalImagesPullingTime="12.232294709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:57.517804434 +0000 UTC m=+79.256676651" watchObservedRunningTime="2026-07-18 00:55:57.5180449 +0000 UTC m=+79.256917099" Jul 18 00:55:57.950300 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.950268 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r2vxp"] Jul 18 00:55:57.955479 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.954140 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:57.958833 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.958160 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xm8x4\"" Jul 18 00:55:57.958833 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.958452 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 18 00:55:57.958833 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.958683 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 18 00:55:57.970204 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:57.969784 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r2vxp"] Jul 18 00:55:58.067281 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.067248 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.067458 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.067305 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.067458 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.067377 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n989v\" (UniqueName: \"kubernetes.io/projected/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-api-access-n989v\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.067576 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.067511 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-crio-socket\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.067576 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.067541 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-data-volume\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.170184 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.168752 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-data-volume\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.170184 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.168847 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.170184 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.168885 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.170184 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.168915 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n989v\" (UniqueName: \"kubernetes.io/projected/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-api-access-n989v\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.170184 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.168963 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-crio-socket\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.170184 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.169086 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-crio-socket\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.170184 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.169442 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-data-volume\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.170184 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:58.169519 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:55:58.170184 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:58.169586 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm podName:38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:58.669564977 +0000 UTC m=+80.408437193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r2vxp" (UID: "38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8") : configmap "kube-rbac-proxy" not found Jul 18 00:55:58.170184 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:58.169877 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:55:58.170184 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:58.169924 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls podName:38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:58.669907957 +0000 UTC m=+80.408780159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r2vxp" (UID: "38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8") : secret "insights-runtime-extractor-tls" not found Jul 18 00:55:58.186583 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.186271 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n989v\" (UniqueName: \"kubernetes.io/projected/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-api-access-n989v\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.675590 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.675553 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.675590 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:58.675598 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:58.676062 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:58.675691 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:55:58.676062 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:58.675702 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:55:58.676062 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:58.675754 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls podName:38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:59.675741041 +0000 UTC m=+81.414613235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r2vxp" (UID: "38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8") : secret "insights-runtime-extractor-tls" not found Jul 18 00:55:58.676062 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:58.675767 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm podName:38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:59.675759849 +0000 UTC m=+81.414632043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r2vxp" (UID: "38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8") : configmap "kube-rbac-proxy" not found Jul 18 00:55:59.685843 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:59.685710 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:59.685843 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:59.685753 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:55:59.686309 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:59.685849 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:55:59.686309 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:59.685860 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:55:59.686309 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:59.685925 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls podName:38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8 nodeName:}" failed. No retries permitted until 2026-07-18 00:56:01.685907903 +0000 UTC m=+83.424780096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r2vxp" (UID: "38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8") : secret "insights-runtime-extractor-tls" not found Jul 18 00:55:59.686309 ip-10-0-132-32 kubenswrapper[2585]: E0718 00:55:59.685942 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm podName:38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8 nodeName:}" failed. No retries permitted until 2026-07-18 00:56:01.685933099 +0000 UTC m=+83.424805293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r2vxp" (UID: "38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8") : configmap "kube-rbac-proxy" not found Jul 18 00:55:59.772277 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:59.772247 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2rgw_8e5e186f-bc53-4ddb-820e-78bb5eb24953/dns/0.log" Jul 18 00:55:59.971224 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:55:59.971140 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2rgw_8e5e186f-bc53-4ddb-820e-78bb5eb24953/kube-rbac-proxy/0.log" Jul 18 00:56:00.570675 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:00.570649 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zdrj5_9f675299-7395-4d54-8b9b-7bb19ffd11d9/dns-node-resolver/0.log" Jul 18 00:56:00.771091 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:00.771062 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55bf795c4d-zdh2z_be34618f-4a94-4229-95e7-e35e986fe882/registry/0.log" Jul 18 00:56:01.371061 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:01.371031 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j8lkk_b9474dba-cf39-4e3d-b0af-e7efbdfdb495/node-ca/0.log" Jul 18 00:56:01.703918 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:01.703835 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:56:01.703918 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:01.703878 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:56:01.704530 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:01.704508 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:56:01.706696 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:01.706671 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r2vxp\" (UID: \"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8\") " pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:56:01.772073 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:01.772032 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc696d8b6-hwmrm_f3333e0b-8a2c-460a-a8da-081382fdc27a/router/0.log" Jul 18 00:56:01.876513 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:01.876482 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r2vxp" Jul 18 00:56:01.970867 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:01.970784 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7n6hg_285d4b11-9773-491e-b59a-cb07038656bb/serve-healthcheck-canary/0.log" Jul 18 00:56:02.574858 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:02.574828 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-h9s8j_9cbe7c41-dfa5-4468-a365-12ab53a04abe/cluster-samples-operator/0.log" Jul 18 00:56:02.772096 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:02.772063 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-h9s8j_9cbe7c41-dfa5-4468-a365-12ab53a04abe/cluster-samples-operator-watch/0.log" Jul 18 00:56:05.138645 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:05.138622 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r2vxp"] Jul 18 00:56:05.141545 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:56:05.141518 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38493889_3fa5_4ab7_8e5c_6ebdf98f4ac8.slice/crio-dedbbce86a3e7b20950ec5bdbad07c9dc3de0f86dd46521e6f9df28826e8d559 WatchSource:0}: Error finding container dedbbce86a3e7b20950ec5bdbad07c9dc3de0f86dd46521e6f9df28826e8d559: Status 404 returned error can't find the container with id dedbbce86a3e7b20950ec5bdbad07c9dc3de0f86dd46521e6f9df28826e8d559 Jul 18 00:56:05.420828 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:05.420799 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r2vxp" event={"ID":"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8","Type":"ContainerStarted","Data":"dedbbce86a3e7b20950ec5bdbad07c9dc3de0f86dd46521e6f9df28826e8d559"} Jul 18 00:56:06.429634 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:06.429587 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-9phgq" event={"ID":"522e9581-bd77-498e-adfd-b78048c17673","Type":"ContainerStarted","Data":"e8227b28fc90feae7e539bb6a2e2a2d05e07a859cc9beb7d8938edd418b21a6f"} Jul 18 00:56:06.430868 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:06.430803 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-9phgq" Jul 18 00:56:06.445720 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:06.445691 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-9phgq" Jul 18 00:56:06.471916 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:06.471842 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-9phgq" podStartSLOduration=1.699396957 podStartE2EDuration="22.471818019s" totalImagesPullingTime="20.772421062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:06.450571355 +0000 UTC m=+88.189443574" watchObservedRunningTime="2026-07-18 00:56:06.471818019 +0000 UTC m=+88.210690235" Jul 18 00:56:09.936216 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:09.933334 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pncfp"] Jul 18 00:56:10.115055 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.115023 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.118392 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.118185 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 18 00:56:10.119686 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.118976 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cwzpn\"" Jul 18 00:56:10.119686 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.119195 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 18 00:56:10.119686 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.119400 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 18 00:56:10.119686 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.119583 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 18 00:56:10.185014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.184175 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-textfile\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.185014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.184223 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-accelerators-collector-config\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.185014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.184253 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-wtmp\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.185014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.184279 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.185014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.184321 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51f09d04-e9f8-4cd0-a52f-fa27356f0268-metrics-client-ca\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.185014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.184348 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51f09d04-e9f8-4cd0-a52f-fa27356f0268-sys\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.185014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.184379 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq7qv\" (UniqueName: \"kubernetes.io/projected/51f09d04-e9f8-4cd0-a52f-fa27356f0268-kube-api-access-hq7qv\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.185014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.184400 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51f09d04-e9f8-4cd0-a52f-fa27356f0268-root\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.185014 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.184432 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-tls\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.285381 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-textfile\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.285430 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-accelerators-collector-config\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.285468 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-wtmp\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.285496 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.285543 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51f09d04-e9f8-4cd0-a52f-fa27356f0268-metrics-client-ca\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.285565 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51f09d04-e9f8-4cd0-a52f-fa27356f0268-sys\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.285599 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq7qv\" (UniqueName: \"kubernetes.io/projected/51f09d04-e9f8-4cd0-a52f-fa27356f0268-kube-api-access-hq7qv\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.285621 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51f09d04-e9f8-4cd0-a52f-fa27356f0268-root\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.285659 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-tls\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.286216 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51f09d04-e9f8-4cd0-a52f-fa27356f0268-sys\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.286689 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51f09d04-e9f8-4cd0-a52f-fa27356f0268-metrics-client-ca\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.287426 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-accelerators-collector-config\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.287658 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-textfile\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.287717 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51f09d04-e9f8-4cd0-a52f-fa27356f0268-root\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.287911 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.287834 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-wtmp\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.295807 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.295746 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-tls\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.303032 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.302939 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq7qv\" (UniqueName: \"kubernetes.io/projected/51f09d04-e9f8-4cd0-a52f-fa27356f0268-kube-api-access-hq7qv\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.304496 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.304452 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51f09d04-e9f8-4cd0-a52f-fa27356f0268-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pncfp\" (UID: \"51f09d04-e9f8-4cd0-a52f-fa27356f0268\") " pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:10.431687 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:10.431368 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pncfp" Jul 18 00:56:12.362549 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:12.362513 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55bf795c4d-zdh2z"] Jul 18 00:56:12.367543 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:12.367514 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:56:12.393950 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:56:12.393918 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f09d04_e9f8_4cd0_a52f_fa27356f0268.slice/crio-331d5f4939b9ce30a624cc60860629442ec4ed6a6c615d33e82376ca4e2fcf59 WatchSource:0}: Error finding container 331d5f4939b9ce30a624cc60860629442ec4ed6a6c615d33e82376ca4e2fcf59: Status 404 returned error can't find the container with id 331d5f4939b9ce30a624cc60860629442ec4ed6a6c615d33e82376ca4e2fcf59 Jul 18 00:56:12.462721 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:12.462686 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pncfp" event={"ID":"51f09d04-e9f8-4cd0-a52f-fa27356f0268","Type":"ContainerStarted","Data":"331d5f4939b9ce30a624cc60860629442ec4ed6a6c615d33e82376ca4e2fcf59"} Jul 18 00:56:13.472944 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:13.472812 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r2vxp" event={"ID":"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8","Type":"ContainerStarted","Data":"a6aa372ece4277b1c792fa9ad53d466eaf78854c63d6fd82bf8441fdf284b0e2"} Jul 18 00:56:15.485894 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:15.485865 2585 generic.go:356] "Generic (PLEG): container finished" podID="51f09d04-e9f8-4cd0-a52f-fa27356f0268" containerID="e6766f95860c6d0fa02ce90aa0c044eb338be48c02d3e24b3ff0fd463bd91041" exitCode=0 Jul 18 00:56:15.486380 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:15.485937 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pncfp" event={"ID":"51f09d04-e9f8-4cd0-a52f-fa27356f0268","Type":"ContainerDied","Data":"e6766f95860c6d0fa02ce90aa0c044eb338be48c02d3e24b3ff0fd463bd91041"} Jul 18 00:56:17.315132 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:17.315098 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4qzlg" Jul 18 00:56:18.502881 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:18.502842 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pncfp" event={"ID":"51f09d04-e9f8-4cd0-a52f-fa27356f0268","Type":"ContainerStarted","Data":"534915a9b337ca0a7181248ad4add2a341848387155454304edeeff300329b77"} Jul 18 00:56:18.503479 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:18.502894 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pncfp" event={"ID":"51f09d04-e9f8-4cd0-a52f-fa27356f0268","Type":"ContainerStarted","Data":"fdbe2df63754bbe56f79427f1c902db3827d30e8e78dcd41618dda0340e7fba6"} Jul 18 00:56:18.504568 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:18.504545 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r2vxp" event={"ID":"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8","Type":"ContainerStarted","Data":"a72c3b2a6a22aa73bb99fbafba04ef88bfc44bb96625a1c4671cb7efa3ad226a"} Jul 18 00:56:18.524323 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:18.524276 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pncfp" podStartSLOduration=7.265759341 podStartE2EDuration="9.524262459s" totalImagesPullingTime="2.141558342s" totalInitContainerRuntime="116.944776ms" isStatefulPod=true podCreationTimestamp="2026-07-18 00:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:18.522712462 +0000 UTC m=+100.261584678" watchObservedRunningTime="2026-07-18 00:56:18.524262459 +0000 UTC m=+100.263134675" Jul 18 00:56:23.529303 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:23.529265 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r2vxp" event={"ID":"38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8","Type":"ContainerStarted","Data":"4b295c175460b89b7b47cbc7f537a8e259b1c36cb1687540056135e1b27b3e17"} Jul 18 00:56:23.547405 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:23.547354 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r2vxp" podStartSLOduration=9.47660855 podStartE2EDuration="26.547336698s" totalImagesPullingTime="17.070728148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:23.545633439 +0000 UTC m=+105.284505653" watchObservedRunningTime="2026-07-18 00:56:23.547336698 +0000 UTC m=+105.286208914" Jul 18 00:56:37.388836 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.388733 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" podUID="be34618f-4a94-4229-95e7-e35e986fe882" containerName="registry" containerID="cri-o://417b416bcb257e3d6c5a3ac64c5a60676acfffa17a55b04a51474b5ebc08d2af" gracePeriod=30 Jul 18 00:56:37.584298 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.584267 2585 generic.go:356] "Generic (PLEG): container finished" podID="be34618f-4a94-4229-95e7-e35e986fe882" containerID="417b416bcb257e3d6c5a3ac64c5a60676acfffa17a55b04a51474b5ebc08d2af" exitCode=0 Jul 18 00:56:37.584444 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.584342 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" event={"ID":"be34618f-4a94-4229-95e7-e35e986fe882","Type":"ContainerDied","Data":"417b416bcb257e3d6c5a3ac64c5a60676acfffa17a55b04a51474b5ebc08d2af"} Jul 18 00:56:37.585953 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.585929 2585 generic.go:356] "Generic (PLEG): container finished" podID="2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c" containerID="f27cb2cdf2a11b6068689715e7a78f1cc44dd4a5292768f089983d25c91b25c6" exitCode=0 Jul 18 00:56:37.586081 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.586029 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" event={"ID":"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c","Type":"ContainerDied","Data":"f27cb2cdf2a11b6068689715e7a78f1cc44dd4a5292768f089983d25c91b25c6"} Jul 18 00:56:37.586448 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.586425 2585 scope.go:117] "RemoveContainer" containerID="f27cb2cdf2a11b6068689715e7a78f1cc44dd4a5292768f089983d25c91b25c6" Jul 18 00:56:37.673034 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.673000 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:56:37.837965 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.837926 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-trusted-ca\") pod \"be34618f-4a94-4229-95e7-e35e986fe882\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " Jul 18 00:56:37.838257 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.838000 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-image-registry-private-configuration\") pod \"be34618f-4a94-4229-95e7-e35e986fe882\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " Jul 18 00:56:37.838257 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.838039 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr8s7\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-kube-api-access-jr8s7\") pod \"be34618f-4a94-4229-95e7-e35e986fe882\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " Jul 18 00:56:37.838257 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.838067 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-bound-sa-token\") pod \"be34618f-4a94-4229-95e7-e35e986fe882\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " Jul 18 00:56:37.838257 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.838092 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls\") pod \"be34618f-4a94-4229-95e7-e35e986fe882\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " Jul 18 00:56:37.838257 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.838139 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-registry-certificates\") pod \"be34618f-4a94-4229-95e7-e35e986fe882\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " Jul 18 00:56:37.838257 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.838199 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be34618f-4a94-4229-95e7-e35e986fe882-ca-trust-extracted\") pod \"be34618f-4a94-4229-95e7-e35e986fe882\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " Jul 18 00:56:37.838257 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.838233 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-installation-pull-secrets\") pod \"be34618f-4a94-4229-95e7-e35e986fe882\" (UID: \"be34618f-4a94-4229-95e7-e35e986fe882\") " Jul 18 00:56:37.838606 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.838369 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "be34618f-4a94-4229-95e7-e35e986fe882" (UID: "be34618f-4a94-4229-95e7-e35e986fe882"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:56:37.838606 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.838518 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-trusted-ca\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 00:56:37.838840 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.838744 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "be34618f-4a94-4229-95e7-e35e986fe882" (UID: "be34618f-4a94-4229-95e7-e35e986fe882"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:56:37.840942 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.840917 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "be34618f-4a94-4229-95e7-e35e986fe882" (UID: "be34618f-4a94-4229-95e7-e35e986fe882"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:56:37.841066 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.841037 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "be34618f-4a94-4229-95e7-e35e986fe882" (UID: "be34618f-4a94-4229-95e7-e35e986fe882"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:56:37.841148 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.841120 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "be34618f-4a94-4229-95e7-e35e986fe882" (UID: "be34618f-4a94-4229-95e7-e35e986fe882"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:56:37.841148 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.841133 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-kube-api-access-jr8s7" (OuterVolumeSpecName: "kube-api-access-jr8s7") pod "be34618f-4a94-4229-95e7-e35e986fe882" (UID: "be34618f-4a94-4229-95e7-e35e986fe882"). InnerVolumeSpecName "kube-api-access-jr8s7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:56:37.841248 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.841206 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "be34618f-4a94-4229-95e7-e35e986fe882" (UID: "be34618f-4a94-4229-95e7-e35e986fe882"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:56:37.846652 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.846624 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be34618f-4a94-4229-95e7-e35e986fe882-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "be34618f-4a94-4229-95e7-e35e986fe882" (UID: "be34618f-4a94-4229-95e7-e35e986fe882"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:56:37.939470 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.939391 2585 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-bound-sa-token\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 00:56:37.939470 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.939415 2585 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-registry-tls\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 00:56:37.939470 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.939424 2585 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/be34618f-4a94-4229-95e7-e35e986fe882-registry-certificates\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 00:56:37.939470 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.939433 2585 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/be34618f-4a94-4229-95e7-e35e986fe882-ca-trust-extracted\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 00:56:37.939470 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.939443 2585 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-installation-pull-secrets\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 00:56:37.939470 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.939452 2585 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/be34618f-4a94-4229-95e7-e35e986fe882-image-registry-private-configuration\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 00:56:37.939470 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:37.939461 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr8s7\" (UniqueName: \"kubernetes.io/projected/be34618f-4a94-4229-95e7-e35e986fe882-kube-api-access-jr8s7\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 00:56:38.593800 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:38.593718 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" Jul 18 00:56:38.593800 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:38.593730 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55bf795c4d-zdh2z" event={"ID":"be34618f-4a94-4229-95e7-e35e986fe882","Type":"ContainerDied","Data":"4ee980246c74ec5780979a867b8301106833b0edcf65b8f0e4f4aa974d84e6c8"} Jul 18 00:56:38.594388 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:38.593801 2585 scope.go:117] "RemoveContainer" containerID="417b416bcb257e3d6c5a3ac64c5a60676acfffa17a55b04a51474b5ebc08d2af" Jul 18 00:56:38.595812 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:38.595788 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-jkt92" event={"ID":"2d615eb4-913c-4eaa-b1cc-cdfb3a08f06c","Type":"ContainerStarted","Data":"36484841083e66c7d71e20fe0e52fa455b524694002788c764f1bda90c2ce0ee"} Jul 18 00:56:38.628857 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:38.628830 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55bf795c4d-zdh2z"] Jul 18 00:56:38.637401 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:38.637377 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55bf795c4d-zdh2z"] Jul 18 00:56:38.795754 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:38.795721 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be34618f-4a94-4229-95e7-e35e986fe882" path="/var/lib/kubelet/pods/be34618f-4a94-4229-95e7-e35e986fe882/volumes" Jul 18 00:56:47.631557 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:47.631521 2585 generic.go:356] "Generic (PLEG): container finished" podID="4ccd3551-04ec-4cc3-bb2e-44987fe5370f" containerID="2bbe661b806a5379dd5d5d016165f58760cc858bad2f23ad3abc53a1b4a2eedd" exitCode=0 Jul 18 00:56:47.632049 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:47.631606 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" event={"ID":"4ccd3551-04ec-4cc3-bb2e-44987fe5370f","Type":"ContainerDied","Data":"2bbe661b806a5379dd5d5d016165f58760cc858bad2f23ad3abc53a1b4a2eedd"} Jul 18 00:56:47.632049 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:47.632020 2585 scope.go:117] "RemoveContainer" containerID="2bbe661b806a5379dd5d5d016165f58760cc858bad2f23ad3abc53a1b4a2eedd" Jul 18 00:56:48.637045 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:56:48.637011 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-c64lf" event={"ID":"4ccd3551-04ec-4cc3-bb2e-44987fe5370f","Type":"ContainerStarted","Data":"a2ddf3401b3a7356bd22ea530f7c6d98f70ea8f5a58872a2574de0ddc1b45efa"} Jul 18 00:59:38.686705 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:38.686663 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 00:59:38.694035 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:38.694012 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 00:59:38.695963 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:38.695943 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 00:59:38.697368 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:38.697352 2585 kubelet.go:1648] "Image garbage collection succeeded" Jul 18 00:59:38.704082 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:38.704066 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 00:59:46.533443 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.533404 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65"] Jul 18 00:59:46.535737 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.533684 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be34618f-4a94-4229-95e7-e35e986fe882" containerName="registry" Jul 18 00:59:46.535737 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.533695 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="be34618f-4a94-4229-95e7-e35e986fe882" containerName="registry" Jul 18 00:59:46.535737 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.533756 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="be34618f-4a94-4229-95e7-e35e986fe882" containerName="registry" Jul 18 00:59:46.536636 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.536621 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.540119 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.540096 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 18 00:59:46.540258 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.540121 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 18 00:59:46.540258 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.540105 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 18 00:59:46.540258 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.540104 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 18 00:59:46.543313 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.542962 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r2kg7\"" Jul 18 00:59:46.549380 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.549361 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65"] Jul 18 00:59:46.627126 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.627093 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cab29cdb-6f02-4621-9a55-45b20a596059-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.627303 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.627138 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv2dx\" (UniqueName: \"kubernetes.io/projected/cab29cdb-6f02-4621-9a55-45b20a596059-kube-api-access-jv2dx\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.627303 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.627159 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cab29cdb-6f02-4621-9a55-45b20a596059-manifests\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.627303 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.627240 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cab29cdb-6f02-4621-9a55-45b20a596059-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.627303 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.627287 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cab29cdb-6f02-4621-9a55-45b20a596059-tmp\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.727846 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.727809 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cab29cdb-6f02-4621-9a55-45b20a596059-tmp\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.728061 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.727863 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cab29cdb-6f02-4621-9a55-45b20a596059-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.728061 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.727903 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv2dx\" (UniqueName: \"kubernetes.io/projected/cab29cdb-6f02-4621-9a55-45b20a596059-kube-api-access-jv2dx\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.728061 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.727931 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cab29cdb-6f02-4621-9a55-45b20a596059-manifests\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.728061 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.727977 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cab29cdb-6f02-4621-9a55-45b20a596059-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.728363 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.728341 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cab29cdb-6f02-4621-9a55-45b20a596059-manifests\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.730449 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.730420 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cab29cdb-6f02-4621-9a55-45b20a596059-tmp\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.730625 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.730568 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cab29cdb-6f02-4621-9a55-45b20a596059-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.730688 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.730627 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cab29cdb-6f02-4621-9a55-45b20a596059-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.737862 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.737837 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv2dx\" (UniqueName: \"kubernetes.io/projected/cab29cdb-6f02-4621-9a55-45b20a596059-kube-api-access-jv2dx\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-k7z65\" (UID: \"cab29cdb-6f02-4621-9a55-45b20a596059\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.846834 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.846803 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:46.986796 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.986773 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65"] Jul 18 00:59:46.989697 ip-10-0-132-32 kubenswrapper[2585]: W0718 00:59:46.989670 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab29cdb_6f02_4621_9a55_45b20a596059.slice/crio-5ae81cd722b136e2cd94e0f416324d1a875054779709cc235421ca2740204d31 WatchSource:0}: Error finding container 5ae81cd722b136e2cd94e0f416324d1a875054779709cc235421ca2740204d31: Status 404 returned error can't find the container with id 5ae81cd722b136e2cd94e0f416324d1a875054779709cc235421ca2740204d31 Jul 18 00:59:46.991559 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:46.991538 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 00:59:47.338347 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:47.338260 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" event={"ID":"cab29cdb-6f02-4621-9a55-45b20a596059","Type":"ContainerStarted","Data":"5ae81cd722b136e2cd94e0f416324d1a875054779709cc235421ca2740204d31"} Jul 18 00:59:50.357577 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:50.357545 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" event={"ID":"cab29cdb-6f02-4621-9a55-45b20a596059","Type":"ContainerStarted","Data":"83fc577c214799cc523142147e884f8bf78d1ec9faed24a8d8ed52815825910d"} Jul 18 00:59:51.363541 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:51.363503 2585 generic.go:356] "Generic (PLEG): container finished" podID="cab29cdb-6f02-4621-9a55-45b20a596059" containerID="83fc577c214799cc523142147e884f8bf78d1ec9faed24a8d8ed52815825910d" exitCode=0 Jul 18 00:59:51.363903 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:51.363593 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" event={"ID":"cab29cdb-6f02-4621-9a55-45b20a596059","Type":"ContainerDied","Data":"83fc577c214799cc523142147e884f8bf78d1ec9faed24a8d8ed52815825910d"} Jul 18 00:59:52.369891 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:52.369857 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" event={"ID":"cab29cdb-6f02-4621-9a55-45b20a596059","Type":"ContainerStarted","Data":"98e8779854130f1a7f3de86dfbaa781c41c2b84e01be19c932633b729ead8016"} Jul 18 00:59:52.370287 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:52.369952 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 00:59:52.390392 ip-10-0-132-32 kubenswrapper[2585]: I0718 00:59:52.390347 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" podStartSLOduration=1.989044078 podStartE2EDuration="6.390330251s" totalImagesPullingTime="3.318908645s" totalInitContainerRuntime="1.082377528s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:59:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:59:52.388240287 +0000 UTC m=+314.127112503" watchObservedRunningTime="2026-07-18 00:59:52.390330251 +0000 UTC m=+314.129202466" Jul 18 01:00:03.377043 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:03.377006 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-k7z65" Jul 18 01:00:06.494930 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:06.494892 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tpbq9"] Jul 18 01:00:06.502219 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:06.502196 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" Jul 18 01:00:06.506464 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:06.506439 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 18 01:00:06.506781 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:06.506762 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zrjgh\"" Jul 18 01:00:06.513466 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:06.512371 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tpbq9"] Jul 18 01:00:06.597279 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:06.597243 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spb96\" (UniqueName: \"kubernetes.io/projected/a7db99db-c28d-41ee-b7f5-b97da7663858-kube-api-access-spb96\") pod \"odh-model-controller-7998c67dc4-tpbq9\" (UID: \"a7db99db-c28d-41ee-b7f5-b97da7663858\") " pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" Jul 18 01:00:06.597451 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:06.597362 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7db99db-c28d-41ee-b7f5-b97da7663858-cert\") pod \"odh-model-controller-7998c67dc4-tpbq9\" (UID: \"a7db99db-c28d-41ee-b7f5-b97da7663858\") " pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" Jul 18 01:00:06.698605 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:06.698568 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7db99db-c28d-41ee-b7f5-b97da7663858-cert\") pod \"odh-model-controller-7998c67dc4-tpbq9\" (UID: \"a7db99db-c28d-41ee-b7f5-b97da7663858\") " pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" Jul 18 01:00:06.698783 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:06.698623 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spb96\" (UniqueName: \"kubernetes.io/projected/a7db99db-c28d-41ee-b7f5-b97da7663858-kube-api-access-spb96\") pod \"odh-model-controller-7998c67dc4-tpbq9\" (UID: \"a7db99db-c28d-41ee-b7f5-b97da7663858\") " pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" Jul 18 01:00:06.698783 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:00:06.698728 2585 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 18 01:00:06.698871 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:00:06.698792 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7db99db-c28d-41ee-b7f5-b97da7663858-cert podName:a7db99db-c28d-41ee-b7f5-b97da7663858 nodeName:}" failed. No retries permitted until 2026-07-18 01:00:07.198775251 +0000 UTC m=+328.937647444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a7db99db-c28d-41ee-b7f5-b97da7663858-cert") pod "odh-model-controller-7998c67dc4-tpbq9" (UID: "a7db99db-c28d-41ee-b7f5-b97da7663858") : secret "odh-model-controller-webhook-cert" not found Jul 18 01:00:06.711325 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:06.711301 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spb96\" (UniqueName: \"kubernetes.io/projected/a7db99db-c28d-41ee-b7f5-b97da7663858-kube-api-access-spb96\") pod \"odh-model-controller-7998c67dc4-tpbq9\" (UID: \"a7db99db-c28d-41ee-b7f5-b97da7663858\") " pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" Jul 18 01:00:07.065055 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.065024 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-h8k6g"] Jul 18 01:00:07.068245 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.068230 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" Jul 18 01:00:07.071429 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.071408 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-gkrqp\"" Jul 18 01:00:07.071601 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.071582 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 18 01:00:07.080825 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.080802 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-h8k6g"] Jul 18 01:00:07.203720 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.203691 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7db99db-c28d-41ee-b7f5-b97da7663858-cert\") pod \"odh-model-controller-7998c67dc4-tpbq9\" (UID: \"a7db99db-c28d-41ee-b7f5-b97da7663858\") " pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" Jul 18 01:00:07.203894 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.203749 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htwqc\" (UniqueName: \"kubernetes.io/projected/18226653-4f58-4fe4-81d7-de0d74914dfc-kube-api-access-htwqc\") pod \"model-serving-api-54d89bd5fc-h8k6g\" (UID: \"18226653-4f58-4fe4-81d7-de0d74914dfc\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" Jul 18 01:00:07.203894 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.203781 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18226653-4f58-4fe4-81d7-de0d74914dfc-tls-certs\") pod \"model-serving-api-54d89bd5fc-h8k6g\" (UID: \"18226653-4f58-4fe4-81d7-de0d74914dfc\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" Jul 18 01:00:07.206333 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.206310 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7db99db-c28d-41ee-b7f5-b97da7663858-cert\") pod \"odh-model-controller-7998c67dc4-tpbq9\" (UID: \"a7db99db-c28d-41ee-b7f5-b97da7663858\") " pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" Jul 18 01:00:07.304811 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.304765 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htwqc\" (UniqueName: \"kubernetes.io/projected/18226653-4f58-4fe4-81d7-de0d74914dfc-kube-api-access-htwqc\") pod \"model-serving-api-54d89bd5fc-h8k6g\" (UID: \"18226653-4f58-4fe4-81d7-de0d74914dfc\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" Jul 18 01:00:07.304811 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.304822 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18226653-4f58-4fe4-81d7-de0d74914dfc-tls-certs\") pod \"model-serving-api-54d89bd5fc-h8k6g\" (UID: \"18226653-4f58-4fe4-81d7-de0d74914dfc\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" Jul 18 01:00:07.307868 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.307845 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18226653-4f58-4fe4-81d7-de0d74914dfc-tls-certs\") pod \"model-serving-api-54d89bd5fc-h8k6g\" (UID: \"18226653-4f58-4fe4-81d7-de0d74914dfc\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" Jul 18 01:00:07.312512 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.312482 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htwqc\" (UniqueName: \"kubernetes.io/projected/18226653-4f58-4fe4-81d7-de0d74914dfc-kube-api-access-htwqc\") pod \"model-serving-api-54d89bd5fc-h8k6g\" (UID: \"18226653-4f58-4fe4-81d7-de0d74914dfc\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" Jul 18 01:00:07.379108 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.379090 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" Jul 18 01:00:07.414198 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.414174 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" Jul 18 01:00:07.522326 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.522283 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-h8k6g"] Jul 18 01:00:07.526216 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:00:07.526183 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18226653_4f58_4fe4_81d7_de0d74914dfc.slice/crio-c997c4c3c2f966fc6fc09bec37ced62cc8521120c39d9ab418e1442d3147603e WatchSource:0}: Error finding container c997c4c3c2f966fc6fc09bec37ced62cc8521120c39d9ab418e1442d3147603e: Status 404 returned error can't find the container with id c997c4c3c2f966fc6fc09bec37ced62cc8521120c39d9ab418e1442d3147603e Jul 18 01:00:07.562216 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:07.562196 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tpbq9"] Jul 18 01:00:07.564302 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:00:07.564276 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7db99db_c28d_41ee_b7f5_b97da7663858.slice/crio-459a4850bb8d8826a3ef5ec60f8aef124d92558423bd488722a652f5ed64cff9 WatchSource:0}: Error finding container 459a4850bb8d8826a3ef5ec60f8aef124d92558423bd488722a652f5ed64cff9: Status 404 returned error can't find the container with id 459a4850bb8d8826a3ef5ec60f8aef124d92558423bd488722a652f5ed64cff9 Jul 18 01:00:08.449055 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:08.449017 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" event={"ID":"18226653-4f58-4fe4-81d7-de0d74914dfc","Type":"ContainerStarted","Data":"c997c4c3c2f966fc6fc09bec37ced62cc8521120c39d9ab418e1442d3147603e"} Jul 18 01:00:08.450465 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:08.450434 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" event={"ID":"a7db99db-c28d-41ee-b7f5-b97da7663858","Type":"ContainerStarted","Data":"459a4850bb8d8826a3ef5ec60f8aef124d92558423bd488722a652f5ed64cff9"} Jul 18 01:00:11.466253 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.466081 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" event={"ID":"18226653-4f58-4fe4-81d7-de0d74914dfc","Type":"ContainerStarted","Data":"559d839eb78af9d328a72e4009b3f5930d87a120657a8ba5a4baeb7d3ec6aaa8"} Jul 18 01:00:11.466811 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.466366 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" Jul 18 01:00:11.467770 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.467743 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" event={"ID":"a7db99db-c28d-41ee-b7f5-b97da7663858","Type":"ContainerStarted","Data":"a24cea0e8aa662e317237cc4cca4b1ad868b7ffffa3f2b4ce72f2109d13534c4"} Jul 18 01:00:11.467890 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.467804 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" Jul 18 01:00:11.499146 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.499097 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" podStartSLOduration=1.197269586 podStartE2EDuration="4.499082721s" totalImagesPullingTime="3.301813135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:00:11.497842068 +0000 UTC m=+333.236714297" watchObservedRunningTime="2026-07-18 01:00:11.499082721 +0000 UTC m=+333.237954945" Jul 18 01:00:11.553414 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.553366 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" podStartSLOduration=2.233908291 podStartE2EDuration="5.553350228s" totalImagesPullingTime="3.319441937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:00:11.550603444 +0000 UTC m=+333.289475658" watchObservedRunningTime="2026-07-18 01:00:11.553350228 +0000 UTC m=+333.292222443" Jul 18 01:00:11.676743 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.676705 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4"] Jul 18 01:00:11.680059 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.680035 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" Jul 18 01:00:11.682288 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.682270 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4l2sm\"" Jul 18 01:00:11.682365 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.682269 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 18 01:00:11.682365 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.682272 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 18 01:00:11.689468 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.689447 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4"] Jul 18 01:00:11.847578 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.847552 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ab382bd-bf1b-4275-aebb-fc0d1514b3e6-tmp\") pod \"kube-auth-proxy-5dc9c468c9-ftwd4\" (UID: \"6ab382bd-bf1b-4275-aebb-fc0d1514b3e6\") " pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" Jul 18 01:00:11.847578 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.847583 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tndzr\" (UniqueName: \"kubernetes.io/projected/6ab382bd-bf1b-4275-aebb-fc0d1514b3e6-kube-api-access-tndzr\") pod \"kube-auth-proxy-5dc9c468c9-ftwd4\" (UID: \"6ab382bd-bf1b-4275-aebb-fc0d1514b3e6\") " pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" Jul 18 01:00:11.847806 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.847662 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ab382bd-bf1b-4275-aebb-fc0d1514b3e6-tls-certs\") pod \"kube-auth-proxy-5dc9c468c9-ftwd4\" (UID: \"6ab382bd-bf1b-4275-aebb-fc0d1514b3e6\") " pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" Jul 18 01:00:11.948152 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.948121 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ab382bd-bf1b-4275-aebb-fc0d1514b3e6-tls-certs\") pod \"kube-auth-proxy-5dc9c468c9-ftwd4\" (UID: \"6ab382bd-bf1b-4275-aebb-fc0d1514b3e6\") " pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" Jul 18 01:00:11.948309 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.948173 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ab382bd-bf1b-4275-aebb-fc0d1514b3e6-tmp\") pod \"kube-auth-proxy-5dc9c468c9-ftwd4\" (UID: \"6ab382bd-bf1b-4275-aebb-fc0d1514b3e6\") " pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" Jul 18 01:00:11.948309 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.948193 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tndzr\" (UniqueName: \"kubernetes.io/projected/6ab382bd-bf1b-4275-aebb-fc0d1514b3e6-kube-api-access-tndzr\") pod \"kube-auth-proxy-5dc9c468c9-ftwd4\" (UID: \"6ab382bd-bf1b-4275-aebb-fc0d1514b3e6\") " pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" Jul 18 01:00:11.950495 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.950463 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ab382bd-bf1b-4275-aebb-fc0d1514b3e6-tmp\") pod \"kube-auth-proxy-5dc9c468c9-ftwd4\" (UID: \"6ab382bd-bf1b-4275-aebb-fc0d1514b3e6\") " pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" Jul 18 01:00:11.950711 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.950691 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ab382bd-bf1b-4275-aebb-fc0d1514b3e6-tls-certs\") pod \"kube-auth-proxy-5dc9c468c9-ftwd4\" (UID: \"6ab382bd-bf1b-4275-aebb-fc0d1514b3e6\") " pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" Jul 18 01:00:11.955119 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.955101 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tndzr\" (UniqueName: \"kubernetes.io/projected/6ab382bd-bf1b-4275-aebb-fc0d1514b3e6-kube-api-access-tndzr\") pod \"kube-auth-proxy-5dc9c468c9-ftwd4\" (UID: \"6ab382bd-bf1b-4275-aebb-fc0d1514b3e6\") " pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" Jul 18 01:00:11.990107 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:11.990075 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" Jul 18 01:00:12.131293 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.131220 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4"] Jul 18 01:00:12.134873 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:00:12.134846 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab382bd_bf1b_4275_aebb_fc0d1514b3e6.slice/crio-4236d461eadb1beff2fceb73d3d60bcbd4d092956328a05c1dbe390f9fabedd4 WatchSource:0}: Error finding container 4236d461eadb1beff2fceb73d3d60bcbd4d092956328a05c1dbe390f9fabedd4: Status 404 returned error can't find the container with id 4236d461eadb1beff2fceb73d3d60bcbd4d092956328a05c1dbe390f9fabedd4 Jul 18 01:00:12.473529 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.473436 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" event={"ID":"6ab382bd-bf1b-4275-aebb-fc0d1514b3e6","Type":"ContainerStarted","Data":"4236d461eadb1beff2fceb73d3d60bcbd4d092956328a05c1dbe390f9fabedd4"} Jul 18 01:00:12.829498 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.829425 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb"] Jul 18 01:00:12.833924 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.833905 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:12.836661 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.836630 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 18 01:00:12.836786 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.836643 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 18 01:00:12.836786 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.836721 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vg7kb\"" Jul 18 01:00:12.836964 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.836947 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 18 01:00:12.837063 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.836971 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 01:00:12.847502 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.847481 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb"] Jul 18 01:00:12.960204 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.960164 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b40b3d2-18bd-4885-ba6f-6f45cb257593-local-certs\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:12.960398 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.960219 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:12.960398 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.960279 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8psnz\" (UniqueName: \"kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-kube-api-access-8psnz\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:12.960398 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.960316 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:12.960398 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.960349 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-token\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:12.960398 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.960366 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:12.960652 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:12.960467 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-cacerts\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.061697 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.061661 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b40b3d2-18bd-4885-ba6f-6f45cb257593-local-certs\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.061882 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.061703 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.061882 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.061722 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8psnz\" (UniqueName: \"kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-kube-api-access-8psnz\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.061882 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.061751 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.061882 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.061783 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-token\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.061882 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.061805 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.061882 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.061856 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-cacerts\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.062722 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.062695 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.064499 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.064472 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b40b3d2-18bd-4885-ba6f-6f45cb257593-local-certs\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.064807 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.064784 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-cacerts\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.064898 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.064828 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.065141 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.065121 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.076403 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.076356 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8psnz\" (UniqueName: \"kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-kube-api-access-8psnz\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.078773 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.078753 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-token\") pod \"istiod-openshift-gateway-7574459656-mdbqb\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.143690 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.143662 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:13.298757 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:00:13.298722 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b40b3d2_18bd_4885_ba6f_6f45cb257593.slice/crio-d9b5b2298c507c7ae77e47e8b12b7e8fc2b7b811ba4e54597b35741626995737 WatchSource:0}: Error finding container d9b5b2298c507c7ae77e47e8b12b7e8fc2b7b811ba4e54597b35741626995737: Status 404 returned error can't find the container with id d9b5b2298c507c7ae77e47e8b12b7e8fc2b7b811ba4e54597b35741626995737 Jul 18 01:00:13.301263 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.301158 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb"] Jul 18 01:00:13.479890 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:13.479812 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" event={"ID":"1b40b3d2-18bd-4885-ba6f-6f45cb257593","Type":"ContainerStarted","Data":"d9b5b2298c507c7ae77e47e8b12b7e8fc2b7b811ba4e54597b35741626995737"} Jul 18 01:00:16.510519 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.510487 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-krwwt"] Jul 18 01:00:16.519655 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.519625 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" Jul 18 01:00:16.523143 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.523093 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 18 01:00:16.524347 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.524145 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hbtjb\"" Jul 18 01:00:16.535896 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.535869 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-krwwt"] Jul 18 01:00:16.588311 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.588061 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slz5w\" (UniqueName: \"kubernetes.io/projected/abd76acf-a921-44f9-a9e5-23f678e38861-kube-api-access-slz5w\") pod \"kserve-controller-manager-d6f4b65b8-krwwt\" (UID: \"abd76acf-a921-44f9-a9e5-23f678e38861\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" Jul 18 01:00:16.588311 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.588132 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd76acf-a921-44f9-a9e5-23f678e38861-cert\") pod \"kserve-controller-manager-d6f4b65b8-krwwt\" (UID: \"abd76acf-a921-44f9-a9e5-23f678e38861\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" Jul 18 01:00:16.688516 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.688492 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slz5w\" (UniqueName: \"kubernetes.io/projected/abd76acf-a921-44f9-a9e5-23f678e38861-kube-api-access-slz5w\") pod \"kserve-controller-manager-d6f4b65b8-krwwt\" (UID: \"abd76acf-a921-44f9-a9e5-23f678e38861\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" Jul 18 01:00:16.688621 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.688548 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd76acf-a921-44f9-a9e5-23f678e38861-cert\") pod \"kserve-controller-manager-d6f4b65b8-krwwt\" (UID: \"abd76acf-a921-44f9-a9e5-23f678e38861\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" Jul 18 01:00:16.688725 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:00:16.688708 2585 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 18 01:00:16.688789 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:00:16.688778 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abd76acf-a921-44f9-a9e5-23f678e38861-cert podName:abd76acf-a921-44f9-a9e5-23f678e38861 nodeName:}" failed. No retries permitted until 2026-07-18 01:00:17.188756776 +0000 UTC m=+338.927628972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/abd76acf-a921-44f9-a9e5-23f678e38861-cert") pod "kserve-controller-manager-d6f4b65b8-krwwt" (UID: "abd76acf-a921-44f9-a9e5-23f678e38861") : secret "kserve-webhook-server-cert" not found Jul 18 01:00:16.710629 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.710587 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slz5w\" (UniqueName: \"kubernetes.io/projected/abd76acf-a921-44f9-a9e5-23f678e38861-kube-api-access-slz5w\") pod \"kserve-controller-manager-d6f4b65b8-krwwt\" (UID: \"abd76acf-a921-44f9-a9e5-23f678e38861\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" Jul 18 01:00:16.746674 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.746635 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:00:16.746792 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:16.746720 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:00:17.191403 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.191363 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd76acf-a921-44f9-a9e5-23f678e38861-cert\") pod \"kserve-controller-manager-d6f4b65b8-krwwt\" (UID: \"abd76acf-a921-44f9-a9e5-23f678e38861\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" Jul 18 01:00:17.194040 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.194014 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd76acf-a921-44f9-a9e5-23f678e38861-cert\") pod \"kserve-controller-manager-d6f4b65b8-krwwt\" (UID: \"abd76acf-a921-44f9-a9e5-23f678e38861\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" Jul 18 01:00:17.434213 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.434173 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" Jul 18 01:00:17.504502 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.504466 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" event={"ID":"6ab382bd-bf1b-4275-aebb-fc0d1514b3e6","Type":"ContainerStarted","Data":"4998220e80db2225fd4dd535bdc1e5a03a6c05730d47fffdd7d3c258719e5208"} Jul 18 01:00:17.506934 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.506810 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" event={"ID":"1b40b3d2-18bd-4885-ba6f-6f45cb257593","Type":"ContainerStarted","Data":"c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b"} Jul 18 01:00:17.507861 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.507233 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:17.509184 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.509159 2585 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-mdbqb container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 18 01:00:17.509293 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.509211 2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" podUID="1b40b3d2-18bd-4885-ba6f-6f45cb257593" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 01:00:17.524174 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.524098 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dc9c468c9-ftwd4" podStartSLOduration=1.988370115 podStartE2EDuration="6.524076217s" totalImagesPullingTime="4.535706102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:00:17.522060865 +0000 UTC m=+339.260933081" watchObservedRunningTime="2026-07-18 01:00:17.524076217 +0000 UTC m=+339.262948434" Jul 18 01:00:17.548793 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.548514 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" podStartSLOduration=2.103146738 podStartE2EDuration="5.548493221s" totalImagesPullingTime="3.445346483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:00:17.547957334 +0000 UTC m=+339.286829552" watchObservedRunningTime="2026-07-18 01:00:17.548493221 +0000 UTC m=+339.287365437" Jul 18 01:00:17.606188 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.606008 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-krwwt"] Jul 18 01:00:17.608208 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:00:17.608173 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd76acf_a921_44f9_a9e5_23f678e38861.slice/crio-06535550334d869d02d4ac871993a31a45f8c54145c08eb87f3320b55cab2ad7 WatchSource:0}: Error finding container 06535550334d869d02d4ac871993a31a45f8c54145c08eb87f3320b55cab2ad7: Status 404 returned error can't find the container with id 06535550334d869d02d4ac871993a31a45f8c54145c08eb87f3320b55cab2ad7 Jul 18 01:00:17.728007 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.727924 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg"] Jul 18 01:00:17.732743 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.732725 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.735045 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.735021 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9tgfd\"" Jul 18 01:00:17.745221 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.745197 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg"] Jul 18 01:00:17.797182 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.797152 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.797346 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.797189 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.797346 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.797219 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.797346 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.797292 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqgwg\" (UniqueName: \"kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-kube-api-access-xqgwg\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.797451 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.797369 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.797451 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.797387 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.797451 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.797415 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.797451 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.797429 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.797566 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.797476 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.898712 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.898677 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.898712 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.898715 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.898934 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.898738 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.898934 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.898753 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.898934 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.898776 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.899124 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.899009 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.899124 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.899046 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.899124 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.899074 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.899456 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.899278 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.899456 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.899276 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqgwg\" (UniqueName: \"kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-kube-api-access-xqgwg\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.899456 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.899355 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.899456 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.899402 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.899456 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.899424 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.899694 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.899679 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.901315 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.901290 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.901550 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.901533 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.920969 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.920938 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:17.924662 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:17.924629 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqgwg\" (UniqueName: \"kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-kube-api-access-xqgwg\") pod \"data-science-gateway-data-science-gateway-class-548557588-2zpfg\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:18.045275 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:18.045174 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:18.193431 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:18.193405 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg"] Jul 18 01:00:18.195374 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:00:18.195351 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bdc1d59_53b7_41f5_80d9_a6eca68c09f4.slice/crio-b84c8198d797b00d4c6b1d4cda55c565f99ae71a91659db018b185e95cfcf7f6 WatchSource:0}: Error finding container b84c8198d797b00d4c6b1d4cda55c565f99ae71a91659db018b185e95cfcf7f6: Status 404 returned error can't find the container with id b84c8198d797b00d4c6b1d4cda55c565f99ae71a91659db018b185e95cfcf7f6 Jul 18 01:00:18.514291 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:18.514251 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" event={"ID":"abd76acf-a921-44f9-a9e5-23f678e38861","Type":"ContainerStarted","Data":"06535550334d869d02d4ac871993a31a45f8c54145c08eb87f3320b55cab2ad7"} Jul 18 01:00:18.515690 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:18.515653 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" event={"ID":"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4","Type":"ContainerStarted","Data":"b84c8198d797b00d4c6b1d4cda55c565f99ae71a91659db018b185e95cfcf7f6"} Jul 18 01:00:18.516499 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:18.516478 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:19.575334 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:19.575238 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb"] Jul 18 01:00:20.529997 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:20.529842 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" event={"ID":"abd76acf-a921-44f9-a9e5-23f678e38861","Type":"ContainerStarted","Data":"d1cf442c9d253d487cd707b3411a76c601e1b6a7e1e41864569f632e41beb0e1"} Jul 18 01:00:20.530184 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:20.530041 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" Jul 18 01:00:20.530184 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:20.530110 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" podUID="1b40b3d2-18bd-4885-ba6f-6f45cb257593" containerName="discovery" containerID="cri-o://c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b" gracePeriod=30 Jul 18 01:00:20.564491 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:20.564441 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" podStartSLOduration=2.049825349 podStartE2EDuration="4.564420171s" totalImagesPullingTime="2.514594822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:00:20.563755739 +0000 UTC m=+342.302627970" watchObservedRunningTime="2026-07-18 01:00:20.564420171 +0000 UTC m=+342.303292407" Jul 18 01:00:21.245997 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.245949 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:00:21.246313 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.246052 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:00:21.246313 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.246091 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:00:21.341362 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.341333 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:21.432794 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.432763 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-cacerts\") pod \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " Jul 18 01:00:21.432975 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.432805 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-kubeconfig\") pod \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " Jul 18 01:00:21.432975 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.432868 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-token\") pod \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " Jul 18 01:00:21.432975 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.432897 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-dns-cert\") pod \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " Jul 18 01:00:21.432975 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.432924 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-ca-configmap\") pod \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " Jul 18 01:00:21.433141 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.433000 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8psnz\" (UniqueName: \"kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-kube-api-access-8psnz\") pod \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " Jul 18 01:00:21.433141 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.433024 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b40b3d2-18bd-4885-ba6f-6f45cb257593-local-certs\") pod \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\" (UID: \"1b40b3d2-18bd-4885-ba6f-6f45cb257593\") " Jul 18 01:00:21.437519 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.437428 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-cacerts" (OuterVolumeSpecName: "cacerts") pod "1b40b3d2-18bd-4885-ba6f-6f45cb257593" (UID: "1b40b3d2-18bd-4885-ba6f-6f45cb257593"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:00:21.437644 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.437569 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1b40b3d2-18bd-4885-ba6f-6f45cb257593" (UID: "1b40b3d2-18bd-4885-ba6f-6f45cb257593"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:00:21.439439 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.439402 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1b40b3d2-18bd-4885-ba6f-6f45cb257593" (UID: "1b40b3d2-18bd-4885-ba6f-6f45cb257593"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:00:21.439637 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.439615 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b40b3d2-18bd-4885-ba6f-6f45cb257593" (UID: "1b40b3d2-18bd-4885-ba6f-6f45cb257593"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:00:21.439707 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.439682 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b40b3d2-18bd-4885-ba6f-6f45cb257593-local-certs" (OuterVolumeSpecName: "local-certs") pod "1b40b3d2-18bd-4885-ba6f-6f45cb257593" (UID: "1b40b3d2-18bd-4885-ba6f-6f45cb257593"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:00:21.439949 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.439923 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1b40b3d2-18bd-4885-ba6f-6f45cb257593" (UID: "1b40b3d2-18bd-4885-ba6f-6f45cb257593"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:00:21.440075 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.440009 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-kube-api-access-8psnz" (OuterVolumeSpecName: "kube-api-access-8psnz") pod "1b40b3d2-18bd-4885-ba6f-6f45cb257593" (UID: "1b40b3d2-18bd-4885-ba6f-6f45cb257593"). InnerVolumeSpecName "kube-api-access-8psnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:00:21.533738 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.533700 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8psnz\" (UniqueName: \"kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-kube-api-access-8psnz\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:21.533738 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.533731 2585 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b40b3d2-18bd-4885-ba6f-6f45cb257593-local-certs\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:21.533738 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.533743 2585 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-cacerts\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:21.533738 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.533750 2585 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-kubeconfig\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:21.534125 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.533758 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-token\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:21.534125 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.533765 2585 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-dns-cert\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:21.534125 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.533773 2585 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1b40b3d2-18bd-4885-ba6f-6f45cb257593-istio-csr-ca-configmap\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:21.536855 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.536805 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" event={"ID":"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4","Type":"ContainerStarted","Data":"8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4"} Jul 18 01:00:21.538162 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.538125 2585 generic.go:356] "Generic (PLEG): container finished" podID="1b40b3d2-18bd-4885-ba6f-6f45cb257593" containerID="c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b" exitCode=0 Jul 18 01:00:21.538264 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.538181 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" Jul 18 01:00:21.538264 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.538211 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" event={"ID":"1b40b3d2-18bd-4885-ba6f-6f45cb257593","Type":"ContainerDied","Data":"c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b"} Jul 18 01:00:21.538377 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.538264 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb" event={"ID":"1b40b3d2-18bd-4885-ba6f-6f45cb257593","Type":"ContainerDied","Data":"d9b5b2298c507c7ae77e47e8b12b7e8fc2b7b811ba4e54597b35741626995737"} Jul 18 01:00:21.538377 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.538290 2585 scope.go:117] "RemoveContainer" containerID="c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b" Jul 18 01:00:21.547671 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.547655 2585 scope.go:117] "RemoveContainer" containerID="c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b" Jul 18 01:00:21.547925 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:00:21.547908 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b\": container with ID starting with c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b not found: ID does not exist" containerID="c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b" Jul 18 01:00:21.548013 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.547934 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b"} err="failed to get container status \"c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b\": rpc error: code = NotFound desc = could not find container \"c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b\": container with ID starting with c8544bf9d34245cf6e3b88e3765bf91093221a2c539e9ac6fdbba427624e058b not found: ID does not exist" Jul 18 01:00:21.557879 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.557836 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" podStartSLOduration=1.509693164 podStartE2EDuration="4.557822813s" totalImagesPullingTime="3.048129649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:00:21.555648677 +0000 UTC m=+343.294520893" watchObservedRunningTime="2026-07-18 01:00:21.557822813 +0000 UTC m=+343.296695029" Jul 18 01:00:21.570486 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.570461 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb"] Jul 18 01:00:21.575121 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:21.575100 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mdbqb"] Jul 18 01:00:22.045914 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:22.045883 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:22.047431 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:22.047408 2585 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-2zpfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jul 18 01:00:22.047499 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:22.047459 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" podUID="1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jul 18 01:00:22.475654 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:22.475628 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-tpbq9" Jul 18 01:00:22.480044 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:22.480024 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-h8k6g" Jul 18 01:00:22.500321 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:22.500075 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg"] Jul 18 01:00:22.796208 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:22.796131 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b40b3d2-18bd-4885-ba6f-6f45cb257593" path="/var/lib/kubelet/pods/1b40b3d2-18bd-4885-ba6f-6f45cb257593/volumes" Jul 18 01:00:23.046100 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:23.046068 2585 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-2zpfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Jul 18 01:00:23.046286 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:23.046122 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" podUID="1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Jul 18 01:00:23.548747 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:23.548709 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" podUID="1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" containerName="istio-proxy" containerID="cri-o://8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4" gracePeriod=30 Jul 18 01:00:28.808529 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.808504 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:28.900096 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900064 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-podinfo\") pod \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " Jul 18 01:00:28.900295 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900107 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-credential-socket\") pod \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " Jul 18 01:00:28.900295 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900125 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-token\") pod \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " Jul 18 01:00:28.900295 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900157 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-certs\") pod \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " Jul 18 01:00:28.900295 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900267 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-socket\") pod \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " Jul 18 01:00:28.900594 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900324 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istiod-ca-cert\") pod \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " Jul 18 01:00:28.900594 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900349 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-envoy\") pod \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " Jul 18 01:00:28.900594 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900391 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqgwg\" (UniqueName: \"kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-kube-api-access-xqgwg\") pod \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " Jul 18 01:00:28.900594 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900424 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-data\") pod \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\" (UID: \"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4\") " Jul 18 01:00:28.900594 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900414 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" (UID: "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:00:28.900594 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900484 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" (UID: "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:00:28.900885 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900686 2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-credential-socket\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:28.900885 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900706 2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-certs\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:28.900885 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900672 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" (UID: "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:00:28.900885 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900750 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" (UID: "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:00:28.900885 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.900775 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" (UID: "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:00:28.902756 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.902731 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-kube-api-access-xqgwg" (OuterVolumeSpecName: "kube-api-access-xqgwg") pod "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" (UID: "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4"). InnerVolumeSpecName "kube-api-access-xqgwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:00:28.902868 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.902789 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" (UID: "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:00:28.902953 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.902938 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" (UID: "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:00:28.903258 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:28.902951 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" (UID: "1bdc1d59-53b7-41f5-80d9-a6eca68c09f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:00:29.001344 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.001307 2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-token\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:29.001344 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.001337 2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-workload-socket\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:29.001344 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.001346 2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istiod-ca-cert\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:29.001344 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.001355 2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-envoy\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:29.001592 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.001363 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqgwg\" (UniqueName: \"kubernetes.io/projected/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-kube-api-access-xqgwg\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:29.001592 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.001372 2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-data\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:29.001592 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.001380 2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4-istio-podinfo\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:00:29.577280 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.577206 2585 generic.go:356] "Generic (PLEG): container finished" podID="1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" containerID="8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4" exitCode=0 Jul 18 01:00:29.577280 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.577251 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" event={"ID":"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4","Type":"ContainerDied","Data":"8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4"} Jul 18 01:00:29.577280 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.577257 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" Jul 18 01:00:29.577485 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.577294 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg" event={"ID":"1bdc1d59-53b7-41f5-80d9-a6eca68c09f4","Type":"ContainerDied","Data":"b84c8198d797b00d4c6b1d4cda55c565f99ae71a91659db018b185e95cfcf7f6"} Jul 18 01:00:29.577485 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.577315 2585 scope.go:117] "RemoveContainer" containerID="8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4" Jul 18 01:00:29.586880 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.586863 2585 scope.go:117] "RemoveContainer" containerID="8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4" Jul 18 01:00:29.587150 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:00:29.587133 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4\": container with ID starting with 8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4 not found: ID does not exist" containerID="8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4" Jul 18 01:00:29.587247 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.587158 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4"} err="failed to get container status \"8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4\": rpc error: code = NotFound desc = could not find container \"8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4\": container with ID starting with 8fcc9b2a6d31a24634dccf1cd7c224a29a81aa956cf9f6ebc063a2c461978aa4 not found: ID does not exist" Jul 18 01:00:29.598125 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.598101 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg"] Jul 18 01:00:29.604229 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:29.604208 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-2zpfg"] Jul 18 01:00:30.796444 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:30.796408 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" path="/var/lib/kubelet/pods/1bdc1d59-53b7-41f5-80d9-a6eca68c09f4/volumes" Jul 18 01:00:51.543841 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:00:51.543809 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-krwwt" Jul 18 01:01:07.351440 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.351409 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd5nk"] Jul 18 01:01:07.351823 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.351745 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" containerName="istio-proxy" Jul 18 01:01:07.351823 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.351757 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" containerName="istio-proxy" Jul 18 01:01:07.351823 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.351784 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b40b3d2-18bd-4885-ba6f-6f45cb257593" containerName="discovery" Jul 18 01:01:07.351823 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.351789 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b40b3d2-18bd-4885-ba6f-6f45cb257593" containerName="discovery" Jul 18 01:01:07.352034 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.351837 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bdc1d59-53b7-41f5-80d9-a6eca68c09f4" containerName="istio-proxy" Jul 18 01:01:07.352034 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.351847 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b40b3d2-18bd-4885-ba6f-6f45cb257593" containerName="discovery" Jul 18 01:01:07.355454 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.355428 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" Jul 18 01:01:07.357620 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.357599 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 18 01:01:07.357732 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.357600 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dgv8j\"" Jul 18 01:01:07.358370 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.358353 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 18 01:01:07.366090 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.366060 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd5nk"] Jul 18 01:01:07.525338 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.525307 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qflt\" (UniqueName: \"kubernetes.io/projected/04d9a644-7dc9-4822-b739-c6162c3e7b1a-kube-api-access-4qflt\") pod \"kuadrant-operator-catalog-kd5nk\" (UID: \"04d9a644-7dc9-4822-b739-c6162c3e7b1a\") " pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" Jul 18 01:01:07.626409 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.626306 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qflt\" (UniqueName: \"kubernetes.io/projected/04d9a644-7dc9-4822-b739-c6162c3e7b1a-kube-api-access-4qflt\") pod \"kuadrant-operator-catalog-kd5nk\" (UID: \"04d9a644-7dc9-4822-b739-c6162c3e7b1a\") " pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" Jul 18 01:01:07.634889 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.634860 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qflt\" (UniqueName: \"kubernetes.io/projected/04d9a644-7dc9-4822-b739-c6162c3e7b1a-kube-api-access-4qflt\") pod \"kuadrant-operator-catalog-kd5nk\" (UID: \"04d9a644-7dc9-4822-b739-c6162c3e7b1a\") " pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" Jul 18 01:01:07.658820 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.658786 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd5nk"] Jul 18 01:01:07.659102 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.659085 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" Jul 18 01:01:07.792261 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.792237 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd5nk"] Jul 18 01:01:07.795011 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:01:07.794966 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d9a644_7dc9_4822_b739_c6162c3e7b1a.slice/crio-dea109a51bdeef1f44936be0739eb8247dcb26668d1ee13c933b8fc361518bbc WatchSource:0}: Error finding container dea109a51bdeef1f44936be0739eb8247dcb26668d1ee13c933b8fc361518bbc: Status 404 returned error can't find the container with id dea109a51bdeef1f44936be0739eb8247dcb26668d1ee13c933b8fc361518bbc Jul 18 01:01:07.869639 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.869612 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kn6cs"] Jul 18 01:01:07.874048 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.874031 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" Jul 18 01:01:07.879893 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:07.879840 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kn6cs"] Jul 18 01:01:08.029795 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:08.029750 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rtp4\" (UniqueName: \"kubernetes.io/projected/70a22d90-bca9-4af2-ae5f-4c7b092ab9a4-kube-api-access-8rtp4\") pod \"kuadrant-operator-catalog-kn6cs\" (UID: \"70a22d90-bca9-4af2-ae5f-4c7b092ab9a4\") " pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" Jul 18 01:01:08.130937 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:08.130849 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rtp4\" (UniqueName: \"kubernetes.io/projected/70a22d90-bca9-4af2-ae5f-4c7b092ab9a4-kube-api-access-8rtp4\") pod \"kuadrant-operator-catalog-kn6cs\" (UID: \"70a22d90-bca9-4af2-ae5f-4c7b092ab9a4\") " pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" Jul 18 01:01:08.138931 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:08.138899 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rtp4\" (UniqueName: \"kubernetes.io/projected/70a22d90-bca9-4af2-ae5f-4c7b092ab9a4-kube-api-access-8rtp4\") pod \"kuadrant-operator-catalog-kn6cs\" (UID: \"70a22d90-bca9-4af2-ae5f-4c7b092ab9a4\") " pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" Jul 18 01:01:08.183871 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:08.183830 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" Jul 18 01:01:08.335663 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:08.335625 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kn6cs"] Jul 18 01:01:08.339325 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:01:08.339297 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a22d90_bca9_4af2_ae5f_4c7b092ab9a4.slice/crio-4509650c884944aa9c8f68065374d399fe0e21d2b4f80000c6582ca6fb34f13c WatchSource:0}: Error finding container 4509650c884944aa9c8f68065374d399fe0e21d2b4f80000c6582ca6fb34f13c: Status 404 returned error can't find the container with id 4509650c884944aa9c8f68065374d399fe0e21d2b4f80000c6582ca6fb34f13c Jul 18 01:01:08.747404 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:08.747370 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" event={"ID":"04d9a644-7dc9-4822-b739-c6162c3e7b1a","Type":"ContainerStarted","Data":"dea109a51bdeef1f44936be0739eb8247dcb26668d1ee13c933b8fc361518bbc"} Jul 18 01:01:08.748629 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:08.748593 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" event={"ID":"70a22d90-bca9-4af2-ae5f-4c7b092ab9a4","Type":"ContainerStarted","Data":"4509650c884944aa9c8f68065374d399fe0e21d2b4f80000c6582ca6fb34f13c"} Jul 18 01:01:10.760954 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:10.760920 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" event={"ID":"04d9a644-7dc9-4822-b739-c6162c3e7b1a","Type":"ContainerStarted","Data":"5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5"} Jul 18 01:01:10.761427 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:10.761016 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" podUID="04d9a644-7dc9-4822-b739-c6162c3e7b1a" containerName="registry-server" containerID="cri-o://5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5" gracePeriod=2 Jul 18 01:01:10.762492 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:10.762470 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" event={"ID":"70a22d90-bca9-4af2-ae5f-4c7b092ab9a4","Type":"ContainerStarted","Data":"101da779d1a43acf6a68285ad4ab205c77808fe4515301f398f737b70089c007"} Jul 18 01:01:10.776929 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:10.776883 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" podStartSLOduration=1.6800325520000001 podStartE2EDuration="3.776868443s" totalImagesPullingTime="2.096835891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:01:10.775388985 +0000 UTC m=+392.514261207" watchObservedRunningTime="2026-07-18 01:01:10.776868443 +0000 UTC m=+392.515740658" Jul 18 01:01:10.790562 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:10.790519 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" podStartSLOduration=2.235339985 podStartE2EDuration="3.790502713s" totalImagesPullingTime="1.555162728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:01:10.788388823 +0000 UTC m=+392.527261039" watchObservedRunningTime="2026-07-18 01:01:10.790502713 +0000 UTC m=+392.529374951" Jul 18 01:01:11.008025 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.008003 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" Jul 18 01:01:11.052135 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.052063 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qflt\" (UniqueName: \"kubernetes.io/projected/04d9a644-7dc9-4822-b739-c6162c3e7b1a-kube-api-access-4qflt\") pod \"04d9a644-7dc9-4822-b739-c6162c3e7b1a\" (UID: \"04d9a644-7dc9-4822-b739-c6162c3e7b1a\") " Jul 18 01:01:11.054405 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.054377 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d9a644-7dc9-4822-b739-c6162c3e7b1a-kube-api-access-4qflt" (OuterVolumeSpecName: "kube-api-access-4qflt") pod "04d9a644-7dc9-4822-b739-c6162c3e7b1a" (UID: "04d9a644-7dc9-4822-b739-c6162c3e7b1a"). InnerVolumeSpecName "kube-api-access-4qflt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:01:11.152837 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.152807 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qflt\" (UniqueName: \"kubernetes.io/projected/04d9a644-7dc9-4822-b739-c6162c3e7b1a-kube-api-access-4qflt\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:01:11.768125 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.768085 2585 generic.go:356] "Generic (PLEG): container finished" podID="04d9a644-7dc9-4822-b739-c6162c3e7b1a" containerID="5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5" exitCode=0 Jul 18 01:01:11.768125 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.768127 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" Jul 18 01:01:11.768599 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.768168 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" event={"ID":"04d9a644-7dc9-4822-b739-c6162c3e7b1a","Type":"ContainerDied","Data":"5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5"} Jul 18 01:01:11.768599 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.768236 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kd5nk" event={"ID":"04d9a644-7dc9-4822-b739-c6162c3e7b1a","Type":"ContainerDied","Data":"dea109a51bdeef1f44936be0739eb8247dcb26668d1ee13c933b8fc361518bbc"} Jul 18 01:01:11.768599 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.768263 2585 scope.go:117] "RemoveContainer" containerID="5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5" Jul 18 01:01:11.777429 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.777396 2585 scope.go:117] "RemoveContainer" containerID="5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5" Jul 18 01:01:11.777696 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:01:11.777678 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5\": container with ID starting with 5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5 not found: ID does not exist" containerID="5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5" Jul 18 01:01:11.777761 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.777707 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5"} err="failed to get container status \"5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5\": rpc error: code = NotFound desc = could not find container \"5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5\": container with ID starting with 5dc3337705b5141a3b5fa1cd37f26f32c3b36d73e550866d5a07f049b25918f5 not found: ID does not exist" Jul 18 01:01:11.791807 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.791784 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd5nk"] Jul 18 01:01:11.794370 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:11.794351 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kd5nk"] Jul 18 01:01:12.802755 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:12.802717 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d9a644-7dc9-4822-b739-c6162c3e7b1a" path="/var/lib/kubelet/pods/04d9a644-7dc9-4822-b739-c6162c3e7b1a/volumes" Jul 18 01:01:18.184742 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:18.184694 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" Jul 18 01:01:18.185263 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:18.184773 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" Jul 18 01:01:18.207835 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:18.207774 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" Jul 18 01:01:18.821125 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:18.821100 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kn6cs" Jul 18 01:01:39.146697 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.146664 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl"] Jul 18 01:01:39.147121 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.147057 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d9a644-7dc9-4822-b739-c6162c3e7b1a" containerName="registry-server" Jul 18 01:01:39.147121 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.147070 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d9a644-7dc9-4822-b739-c6162c3e7b1a" containerName="registry-server" Jul 18 01:01:39.147193 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.147134 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="04d9a644-7dc9-4822-b739-c6162c3e7b1a" containerName="registry-server" Jul 18 01:01:39.151313 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.151297 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:01:39.153648 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.153623 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-w247v\"" Jul 18 01:01:39.162755 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.162733 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl"] Jul 18 01:01:39.272897 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.272859 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92t6f\" (UniqueName: \"kubernetes.io/projected/23ea8751-ce46-40f3-b38d-fdc3f43449d6-kube-api-access-92t6f\") pod \"limitador-operator-controller-manager-859d7b78bd-vrnjl\" (UID: \"23ea8751-ce46-40f3-b38d-fdc3f43449d6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:01:39.373880 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.373838 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92t6f\" (UniqueName: \"kubernetes.io/projected/23ea8751-ce46-40f3-b38d-fdc3f43449d6-kube-api-access-92t6f\") pod \"limitador-operator-controller-manager-859d7b78bd-vrnjl\" (UID: \"23ea8751-ce46-40f3-b38d-fdc3f43449d6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:01:39.383876 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.383848 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92t6f\" (UniqueName: \"kubernetes.io/projected/23ea8751-ce46-40f3-b38d-fdc3f43449d6-kube-api-access-92t6f\") pod \"limitador-operator-controller-manager-859d7b78bd-vrnjl\" (UID: \"23ea8751-ce46-40f3-b38d-fdc3f43449d6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:01:39.462018 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.461913 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:01:39.594565 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.594536 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl"] Jul 18 01:01:39.596545 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:01:39.596515 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ea8751_ce46_40f3_b38d_fdc3f43449d6.slice/crio-426d92c124fc7fbbfc2b49de614f9d5db564855575b2f58f799f10e670e5bd0c WatchSource:0}: Error finding container 426d92c124fc7fbbfc2b49de614f9d5db564855575b2f58f799f10e670e5bd0c: Status 404 returned error can't find the container with id 426d92c124fc7fbbfc2b49de614f9d5db564855575b2f58f799f10e670e5bd0c Jul 18 01:01:39.888949 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:39.888908 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" event={"ID":"23ea8751-ce46-40f3-b38d-fdc3f43449d6","Type":"ContainerStarted","Data":"426d92c124fc7fbbfc2b49de614f9d5db564855575b2f58f799f10e670e5bd0c"} Jul 18 01:01:41.900095 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:41.899973 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" event={"ID":"23ea8751-ce46-40f3-b38d-fdc3f43449d6","Type":"ContainerStarted","Data":"4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c"} Jul 18 01:01:41.900448 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:41.900199 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:01:41.915087 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:41.915038 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" podStartSLOduration=1.338210078 podStartE2EDuration="2.915022333s" totalImagesPullingTime="1.576812255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:01:41.913316558 +0000 UTC m=+423.652188773" watchObservedRunningTime="2026-07-18 01:01:41.915022333 +0000 UTC m=+423.653894548" Jul 18 01:01:42.604465 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:42.604433 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv"] Jul 18 01:01:42.607799 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:42.607784 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv" Jul 18 01:01:42.610196 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:42.610173 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 18 01:01:42.610319 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:42.610219 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tvkwl\"" Jul 18 01:01:42.615846 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:42.615827 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv"] Jul 18 01:01:42.705443 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:42.705410 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smgqx\" (UniqueName: \"kubernetes.io/projected/709d3ef2-048a-4de2-8128-7a8756fc0062-kube-api-access-smgqx\") pod \"dns-operator-controller-manager-864dd78c4c-44nsv\" (UID: \"709d3ef2-048a-4de2-8128-7a8756fc0062\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv" Jul 18 01:01:42.806283 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:42.806253 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smgqx\" (UniqueName: \"kubernetes.io/projected/709d3ef2-048a-4de2-8128-7a8756fc0062-kube-api-access-smgqx\") pod \"dns-operator-controller-manager-864dd78c4c-44nsv\" (UID: \"709d3ef2-048a-4de2-8128-7a8756fc0062\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv" Jul 18 01:01:42.814142 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:42.814120 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smgqx\" (UniqueName: \"kubernetes.io/projected/709d3ef2-048a-4de2-8128-7a8756fc0062-kube-api-access-smgqx\") pod \"dns-operator-controller-manager-864dd78c4c-44nsv\" (UID: \"709d3ef2-048a-4de2-8128-7a8756fc0062\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv" Jul 18 01:01:42.918535 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:42.918455 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv" Jul 18 01:01:43.051698 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:43.051675 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv"] Jul 18 01:01:43.053893 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:01:43.053865 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod709d3ef2_048a_4de2_8128_7a8756fc0062.slice/crio-1cc0021a7af87f709c227b02294aa365fe6cc9070c8554bc42e5b10038d5dc97 WatchSource:0}: Error finding container 1cc0021a7af87f709c227b02294aa365fe6cc9070c8554bc42e5b10038d5dc97: Status 404 returned error can't find the container with id 1cc0021a7af87f709c227b02294aa365fe6cc9070c8554bc42e5b10038d5dc97 Jul 18 01:01:43.910924 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:43.910893 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv" event={"ID":"709d3ef2-048a-4de2-8128-7a8756fc0062","Type":"ContainerStarted","Data":"1cc0021a7af87f709c227b02294aa365fe6cc9070c8554bc42e5b10038d5dc97"} Jul 18 01:01:45.921488 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:45.921449 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv" event={"ID":"709d3ef2-048a-4de2-8128-7a8756fc0062","Type":"ContainerStarted","Data":"fa3fb7bb02719be990592fb4203bb41b5f049e354fa41dee74fdff5ccd78d5e5"} Jul 18 01:01:45.921900 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:45.921594 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv" Jul 18 01:01:45.939964 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:45.939914 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv" podStartSLOduration=1.493529328 podStartE2EDuration="3.939899534s" totalImagesPullingTime="2.446370206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:01:45.938159778 +0000 UTC m=+427.677031994" watchObservedRunningTime="2026-07-18 01:01:45.939899534 +0000 UTC m=+427.678771750" Jul 18 01:01:46.333799 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:46.333721 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rchnf"] Jul 18 01:01:46.337223 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:46.337207 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rchnf" Jul 18 01:01:46.340836 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:46.340817 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wdjq9\"" Jul 18 01:01:46.350845 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:46.350822 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rchnf"] Jul 18 01:01:46.439468 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:46.439440 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hpwb\" (UniqueName: \"kubernetes.io/projected/1e9850ae-9d19-46ef-8efd-fe975895e7b6-kube-api-access-8hpwb\") pod \"authorino-operator-75cc8d5cb7-rchnf\" (UID: \"1e9850ae-9d19-46ef-8efd-fe975895e7b6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rchnf" Jul 18 01:01:46.540287 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:46.540253 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hpwb\" (UniqueName: \"kubernetes.io/projected/1e9850ae-9d19-46ef-8efd-fe975895e7b6-kube-api-access-8hpwb\") pod \"authorino-operator-75cc8d5cb7-rchnf\" (UID: \"1e9850ae-9d19-46ef-8efd-fe975895e7b6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rchnf" Jul 18 01:01:46.548563 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:46.548539 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hpwb\" (UniqueName: \"kubernetes.io/projected/1e9850ae-9d19-46ef-8efd-fe975895e7b6-kube-api-access-8hpwb\") pod \"authorino-operator-75cc8d5cb7-rchnf\" (UID: \"1e9850ae-9d19-46ef-8efd-fe975895e7b6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rchnf" Jul 18 01:01:46.647196 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:46.647161 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rchnf" Jul 18 01:01:46.785639 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:46.785616 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rchnf"] Jul 18 01:01:46.788296 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:01:46.788256 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9850ae_9d19_46ef_8efd_fe975895e7b6.slice/crio-8f612b245ed108f63f2c12b24700d7d4aba81b74a96bac4e3f9177356ea72629 WatchSource:0}: Error finding container 8f612b245ed108f63f2c12b24700d7d4aba81b74a96bac4e3f9177356ea72629: Status 404 returned error can't find the container with id 8f612b245ed108f63f2c12b24700d7d4aba81b74a96bac4e3f9177356ea72629 Jul 18 01:01:46.927233 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:46.927143 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rchnf" event={"ID":"1e9850ae-9d19-46ef-8efd-fe975895e7b6","Type":"ContainerStarted","Data":"8f612b245ed108f63f2c12b24700d7d4aba81b74a96bac4e3f9177356ea72629"} Jul 18 01:01:49.944404 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:49.944363 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rchnf" event={"ID":"1e9850ae-9d19-46ef-8efd-fe975895e7b6","Type":"ContainerStarted","Data":"ad2c2826c933a0d82e5904af260264f949db302d9d47dadaa40eae239ae06ccf"} Jul 18 01:01:49.944826 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:49.944476 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rchnf" Jul 18 01:01:49.979086 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:49.979035 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rchnf" podStartSLOduration=1.7717665519999999 podStartE2EDuration="3.979018687s" totalImagesPullingTime="2.207252135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:01:49.978783876 +0000 UTC m=+431.717656092" watchObservedRunningTime="2026-07-18 01:01:49.979018687 +0000 UTC m=+431.717890901" Jul 18 01:01:51.051434 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.051397 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf"] Jul 18 01:01:51.054908 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.054891 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:01:51.057493 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.057466 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9hljh\"" Jul 18 01:01:51.072552 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.072526 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf"] Jul 18 01:01:51.183533 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.183489 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b9e9d60-679a-41f2-8224-d7c262fe59ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" (UID: \"5b9e9d60-679a-41f2-8224-d7c262fe59ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:01:51.183713 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.183545 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njf6m\" (UniqueName: \"kubernetes.io/projected/5b9e9d60-679a-41f2-8224-d7c262fe59ce-kube-api-access-njf6m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" (UID: \"5b9e9d60-679a-41f2-8224-d7c262fe59ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:01:51.284491 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.284441 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b9e9d60-679a-41f2-8224-d7c262fe59ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" (UID: \"5b9e9d60-679a-41f2-8224-d7c262fe59ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:01:51.284491 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.284502 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njf6m\" (UniqueName: \"kubernetes.io/projected/5b9e9d60-679a-41f2-8224-d7c262fe59ce-kube-api-access-njf6m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" (UID: \"5b9e9d60-679a-41f2-8224-d7c262fe59ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:01:51.284842 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.284822 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b9e9d60-679a-41f2-8224-d7c262fe59ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" (UID: \"5b9e9d60-679a-41f2-8224-d7c262fe59ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:01:51.293958 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.293932 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njf6m\" (UniqueName: \"kubernetes.io/projected/5b9e9d60-679a-41f2-8224-d7c262fe59ce-kube-api-access-njf6m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" (UID: \"5b9e9d60-679a-41f2-8224-d7c262fe59ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:01:51.364621 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.364586 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:01:51.516602 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.516566 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf"] Jul 18 01:01:51.519719 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:01:51.519694 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9e9d60_679a_41f2_8224_d7c262fe59ce.slice/crio-8a546f84a8c1cbf8b713b15e51a20e5eff4f27e00cc1a58fb4a16d9a5c88f105 WatchSource:0}: Error finding container 8a546f84a8c1cbf8b713b15e51a20e5eff4f27e00cc1a58fb4a16d9a5c88f105: Status 404 returned error can't find the container with id 8a546f84a8c1cbf8b713b15e51a20e5eff4f27e00cc1a58fb4a16d9a5c88f105 Jul 18 01:01:51.954296 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:51.954260 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" event={"ID":"5b9e9d60-679a-41f2-8224-d7c262fe59ce","Type":"ContainerStarted","Data":"8a546f84a8c1cbf8b713b15e51a20e5eff4f27e00cc1a58fb4a16d9a5c88f105"} Jul 18 01:01:52.907297 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:52.907269 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:01:56.929644 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:56.929617 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-44nsv" Jul 18 01:01:56.981552 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:56.981466 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" event={"ID":"5b9e9d60-679a-41f2-8224-d7c262fe59ce","Type":"ContainerStarted","Data":"1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5"} Jul 18 01:01:56.981699 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:56.981606 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:01:56.999747 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:56.999693 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" podStartSLOduration=0.808465247 podStartE2EDuration="5.999672843s" totalImagesPullingTime="5.191207596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:01:56.997548579 +0000 UTC m=+438.736420794" watchObservedRunningTime="2026-07-18 01:01:56.999672843 +0000 UTC m=+438.738545060" Jul 18 01:01:59.534453 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.534423 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv"] Jul 18 01:01:59.538091 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.538069 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:01:59.540504 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.540482 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hdcgr\"" Jul 18 01:01:59.540504 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.540507 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 18 01:01:59.540504 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.540537 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 18 01:01:59.546281 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.546253 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv"] Jul 18 01:01:59.662897 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.662820 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76dd0ac-59eb-4e73-8a21-d390b850ac33-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r45wv\" (UID: \"f76dd0ac-59eb-4e73-8a21-d390b850ac33\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:01:59.662897 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.662868 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f76dd0ac-59eb-4e73-8a21-d390b850ac33-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r45wv\" (UID: \"f76dd0ac-59eb-4e73-8a21-d390b850ac33\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:01:59.663101 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.662918 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drmbm\" (UniqueName: \"kubernetes.io/projected/f76dd0ac-59eb-4e73-8a21-d390b850ac33-kube-api-access-drmbm\") pod \"kuadrant-console-plugin-66b5774985-r45wv\" (UID: \"f76dd0ac-59eb-4e73-8a21-d390b850ac33\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:01:59.764212 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.764176 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drmbm\" (UniqueName: \"kubernetes.io/projected/f76dd0ac-59eb-4e73-8a21-d390b850ac33-kube-api-access-drmbm\") pod \"kuadrant-console-plugin-66b5774985-r45wv\" (UID: \"f76dd0ac-59eb-4e73-8a21-d390b850ac33\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:01:59.764408 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.764236 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76dd0ac-59eb-4e73-8a21-d390b850ac33-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r45wv\" (UID: \"f76dd0ac-59eb-4e73-8a21-d390b850ac33\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:01:59.764408 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.764296 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f76dd0ac-59eb-4e73-8a21-d390b850ac33-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r45wv\" (UID: \"f76dd0ac-59eb-4e73-8a21-d390b850ac33\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:01:59.764408 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:01:59.764394 2585 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 18 01:01:59.764539 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:01:59.764457 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f76dd0ac-59eb-4e73-8a21-d390b850ac33-plugin-serving-cert podName:f76dd0ac-59eb-4e73-8a21-d390b850ac33 nodeName:}" failed. No retries permitted until 2026-07-18 01:02:00.26444155 +0000 UTC m=+442.003313747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/f76dd0ac-59eb-4e73-8a21-d390b850ac33-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-r45wv" (UID: "f76dd0ac-59eb-4e73-8a21-d390b850ac33") : secret "plugin-serving-cert" not found Jul 18 01:01:59.764947 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.764931 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f76dd0ac-59eb-4e73-8a21-d390b850ac33-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-r45wv\" (UID: \"f76dd0ac-59eb-4e73-8a21-d390b850ac33\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:01:59.774543 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:01:59.774517 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drmbm\" (UniqueName: \"kubernetes.io/projected/f76dd0ac-59eb-4e73-8a21-d390b850ac33-kube-api-access-drmbm\") pod \"kuadrant-console-plugin-66b5774985-r45wv\" (UID: \"f76dd0ac-59eb-4e73-8a21-d390b850ac33\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:02:00.268029 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:00.267998 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76dd0ac-59eb-4e73-8a21-d390b850ac33-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r45wv\" (UID: \"f76dd0ac-59eb-4e73-8a21-d390b850ac33\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:02:00.270661 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:00.270638 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f76dd0ac-59eb-4e73-8a21-d390b850ac33-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-r45wv\" (UID: \"f76dd0ac-59eb-4e73-8a21-d390b850ac33\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:02:00.449123 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:00.449085 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" Jul 18 01:02:00.585649 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:00.585625 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv"] Jul 18 01:02:00.588436 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:02:00.588407 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf76dd0ac_59eb_4e73_8a21_d390b850ac33.slice/crio-0f694717ec8e265298757461169522e39514b42bd3d54fba063de723b2619c03 WatchSource:0}: Error finding container 0f694717ec8e265298757461169522e39514b42bd3d54fba063de723b2619c03: Status 404 returned error can't find the container with id 0f694717ec8e265298757461169522e39514b42bd3d54fba063de723b2619c03 Jul 18 01:02:00.951558 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:00.951529 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rchnf" Jul 18 01:02:01.001345 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:01.001316 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" event={"ID":"f76dd0ac-59eb-4e73-8a21-d390b850ac33","Type":"ContainerStarted","Data":"0f694717ec8e265298757461169522e39514b42bd3d54fba063de723b2619c03"} Jul 18 01:02:07.988088 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:07.988053 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:02:09.632086 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.632054 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf"] Jul 18 01:02:09.632591 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.632253 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" containerName="manager" containerID="cri-o://1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5" gracePeriod=2 Jul 18 01:02:09.639947 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.639921 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf"] Jul 18 01:02:09.644502 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:09.644463 2585 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5b9e9d60-679a-41f2-8224-d7c262fe59ce\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\": pods \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:02:09.655468 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.654883 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl"] Jul 18 01:02:09.655468 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.655140 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" podUID="23ea8751-ce46-40f3-b38d-fdc3f43449d6" containerName="manager" containerID="cri-o://4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c" gracePeriod=2 Jul 18 01:02:09.657180 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.657146 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm"] Jul 18 01:02:09.657649 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:09.657357 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" is forbidden: User \"system:node:ip-10-0-132-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-32.ec2.internal' and this object" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:02:09.657753 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.657728 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" containerName="manager" Jul 18 01:02:09.657753 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.657752 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" containerName="manager" Jul 18 01:02:09.657921 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.657902 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" containerName="manager" Jul 18 01:02:09.662685 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.662658 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" Jul 18 01:02:09.669915 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.669896 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl"] Jul 18 01:02:09.686933 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:09.685754 2585 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"23ea8751-ce46-40f3-b38d-fdc3f43449d6\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-vrnjl\": pods \"limitador-operator-controller-manager-859d7b78bd-vrnjl\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:02:09.687770 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:09.687737 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" is forbidden: User \"system:node:ip-10-0-132-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-32.ec2.internal' and this object" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:02:09.689464 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.689442 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm"] Jul 18 01:02:09.710355 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:09.710321 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vrnjl\" is forbidden: User \"system:node:ip-10-0-132-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-32.ec2.internal' and this object" podUID="23ea8751-ce46-40f3-b38d-fdc3f43449d6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:02:09.756123 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.756089 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84ndq\" (UniqueName: \"kubernetes.io/projected/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-kube-api-access-84ndq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9dmm\" (UID: \"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" Jul 18 01:02:09.756295 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.756228 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9dmm\" (UID: \"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" Jul 18 01:02:09.857300 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.857260 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9dmm\" (UID: \"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" Jul 18 01:02:09.857480 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.857318 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84ndq\" (UniqueName: \"kubernetes.io/projected/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-kube-api-access-84ndq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9dmm\" (UID: \"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" Jul 18 01:02:09.857724 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.857691 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9dmm\" (UID: \"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" Jul 18 01:02:09.873245 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:09.873218 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84ndq\" (UniqueName: \"kubernetes.io/projected/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-kube-api-access-84ndq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z9dmm\" (UID: \"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" Jul 18 01:02:10.075174 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:10.075090 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" Jul 18 01:02:22.330773 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.330598 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm"] Jul 18 01:02:22.336162 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:02:22.336116 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9f10d6_3b6a_434e_b24e_fd26bbd201d4.slice/crio-28435a8f121073219f87662be6a2e52ee3cca62800cfe4b0fbcf9c0dc5c6901e WatchSource:0}: Error finding container 28435a8f121073219f87662be6a2e52ee3cca62800cfe4b0fbcf9c0dc5c6901e: Status 404 returned error can't find the container with id 28435a8f121073219f87662be6a2e52ee3cca62800cfe4b0fbcf9c0dc5c6901e Jul 18 01:02:22.353295 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.353270 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:02:22.355412 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.355388 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:02:22.355552 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:22.355520 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" is forbidden: User \"system:node:ip-10-0-132-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-32.ec2.internal' and this object" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:02:22.357619 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:22.357591 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" is forbidden: User \"system:node:ip-10-0-132-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-32.ec2.internal' and this object" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:02:22.359481 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:22.359454 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vrnjl\" is forbidden: User \"system:node:ip-10-0-132-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-32.ec2.internal' and this object" podUID="23ea8751-ce46-40f3-b38d-fdc3f43449d6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:02:22.476083 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.475991 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92t6f\" (UniqueName: \"kubernetes.io/projected/23ea8751-ce46-40f3-b38d-fdc3f43449d6-kube-api-access-92t6f\") pod \"23ea8751-ce46-40f3-b38d-fdc3f43449d6\" (UID: \"23ea8751-ce46-40f3-b38d-fdc3f43449d6\") " Jul 18 01:02:22.476083 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.476057 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b9e9d60-679a-41f2-8224-d7c262fe59ce-extensions-socket-volume\") pod \"5b9e9d60-679a-41f2-8224-d7c262fe59ce\" (UID: \"5b9e9d60-679a-41f2-8224-d7c262fe59ce\") " Jul 18 01:02:22.476296 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.476088 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njf6m\" (UniqueName: \"kubernetes.io/projected/5b9e9d60-679a-41f2-8224-d7c262fe59ce-kube-api-access-njf6m\") pod \"5b9e9d60-679a-41f2-8224-d7c262fe59ce\" (UID: \"5b9e9d60-679a-41f2-8224-d7c262fe59ce\") " Jul 18 01:02:22.476573 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.476546 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9e9d60-679a-41f2-8224-d7c262fe59ce-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5b9e9d60-679a-41f2-8224-d7c262fe59ce" (UID: "5b9e9d60-679a-41f2-8224-d7c262fe59ce"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:02:22.478389 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.478367 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b9e9d60-679a-41f2-8224-d7c262fe59ce-kube-api-access-njf6m" (OuterVolumeSpecName: "kube-api-access-njf6m") pod "5b9e9d60-679a-41f2-8224-d7c262fe59ce" (UID: "5b9e9d60-679a-41f2-8224-d7c262fe59ce"). InnerVolumeSpecName "kube-api-access-njf6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:02:22.478389 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.478376 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ea8751-ce46-40f3-b38d-fdc3f43449d6-kube-api-access-92t6f" (OuterVolumeSpecName: "kube-api-access-92t6f") pod "23ea8751-ce46-40f3-b38d-fdc3f43449d6" (UID: "23ea8751-ce46-40f3-b38d-fdc3f43449d6"). InnerVolumeSpecName "kube-api-access-92t6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:02:22.577289 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.577250 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92t6f\" (UniqueName: \"kubernetes.io/projected/23ea8751-ce46-40f3-b38d-fdc3f43449d6-kube-api-access-92t6f\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:02:22.577289 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.577283 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b9e9d60-679a-41f2-8224-d7c262fe59ce-extensions-socket-volume\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:02:22.577289 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.577295 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njf6m\" (UniqueName: \"kubernetes.io/projected/5b9e9d60-679a-41f2-8224-d7c262fe59ce-kube-api-access-njf6m\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:02:22.796294 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.796211 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23ea8751-ce46-40f3-b38d-fdc3f43449d6" path="/var/lib/kubelet/pods/23ea8751-ce46-40f3-b38d-fdc3f43449d6/volumes" Jul 18 01:02:22.796616 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:22.796602 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" path="/var/lib/kubelet/pods/5b9e9d60-679a-41f2-8224-d7c262fe59ce/volumes" Jul 18 01:02:23.136063 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.136025 2585 generic.go:356] "Generic (PLEG): container finished" podID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" containerID="1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5" exitCode=0 Jul 18 01:02:23.136063 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.136069 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:02:23.136348 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.136130 2585 scope.go:117] "RemoveContainer" containerID="1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5" Jul 18 01:02:23.138066 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.138023 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" event={"ID":"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4","Type":"ContainerStarted","Data":"a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90"} Jul 18 01:02:23.138192 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.138100 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" event={"ID":"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4","Type":"ContainerStarted","Data":"28435a8f121073219f87662be6a2e52ee3cca62800cfe4b0fbcf9c0dc5c6901e"} Jul 18 01:02:23.138192 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.138167 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" Jul 18 01:02:23.138315 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:23.138287 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" is forbidden: User \"system:node:ip-10-0-132-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-32.ec2.internal' and this object" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:02:23.139541 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.139520 2585 generic.go:356] "Generic (PLEG): container finished" podID="23ea8751-ce46-40f3-b38d-fdc3f43449d6" containerID="4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c" exitCode=0 Jul 18 01:02:23.139661 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.139558 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:02:23.140073 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:23.140049 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" is forbidden: User \"system:node:ip-10-0-132-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-32.ec2.internal' and this object" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:02:23.141540 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.141515 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" event={"ID":"f76dd0ac-59eb-4e73-8a21-d390b850ac33","Type":"ContainerStarted","Data":"d5e53e131e5fb8ff5bfb1a47e3151e437d3e8d5e24805680cb88beec90f734f4"} Jul 18 01:02:23.147830 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.147806 2585 scope.go:117] "RemoveContainer" containerID="1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5" Jul 18 01:02:23.148368 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:23.148343 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5\": container with ID starting with 1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5 not found: ID does not exist" containerID="1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5" Jul 18 01:02:23.148473 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.148375 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5"} err="failed to get container status \"1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5\": rpc error: code = NotFound desc = could not find container \"1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5\": container with ID starting with 1ddfd153a88ca0a633322c43777aeab72e9eed97f4af7a7faa9135653fd0a9d5 not found: ID does not exist" Jul 18 01:02:23.148473 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.148394 2585 scope.go:117] "RemoveContainer" containerID="4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c" Jul 18 01:02:23.157164 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.157123 2585 scope.go:117] "RemoveContainer" containerID="4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c" Jul 18 01:02:23.157527 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:23.157505 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c\": container with ID starting with 4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c not found: ID does not exist" containerID="4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c" Jul 18 01:02:23.157629 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.157537 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c"} err="failed to get container status \"4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c\": rpc error: code = NotFound desc = could not find container \"4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c\": container with ID starting with 4997b1006191c4cc47faf37a6bc77f3d6fc2e4794e8559cba05dde38f169654c not found: ID does not exist" Jul 18 01:02:23.158490 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.158445 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" podStartSLOduration=14.15842915 podStartE2EDuration="14.15842915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:02:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:02:23.158166405 +0000 UTC m=+464.897038621" watchObservedRunningTime="2026-07-18 01:02:23.15842915 +0000 UTC m=+464.897301367" Jul 18 01:02:23.172847 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:23.172801 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-r45wv" podStartSLOduration=2.505154738 podStartE2EDuration="24.172787478s" totalImagesPullingTime="21.66763274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:02:23.171424948 +0000 UTC m=+464.910297164" watchObservedRunningTime="2026-07-18 01:02:23.172787478 +0000 UTC m=+464.911659694" Jul 18 01:02:23.173102 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:23.173079 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7dtsf\" is forbidden: User \"system:node:ip-10-0-132-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-32.ec2.internal' and this object" podUID="5b9e9d60-679a-41f2-8224-d7c262fe59ce" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7dtsf" Jul 18 01:02:23.174757 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:23.174735 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vrnjl\" is forbidden: User \"system:node:ip-10-0-132-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-32.ec2.internal' and this object" podUID="23ea8751-ce46-40f3-b38d-fdc3f43449d6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vrnjl" Jul 18 01:02:25.848874 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:25.848838 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm"] Jul 18 01:02:25.849304 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:25.849042 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" podUID="fc9f10d6-3b6a-434e-b24e-fd26bbd201d4" containerName="manager" containerID="cri-o://a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90" gracePeriod=10 Jul 18 01:02:26.038780 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.038749 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj"] Jul 18 01:02:26.039327 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.039305 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ea8751-ce46-40f3-b38d-fdc3f43449d6" containerName="manager" Jul 18 01:02:26.039327 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.039328 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ea8751-ce46-40f3-b38d-fdc3f43449d6" containerName="manager" Jul 18 01:02:26.039499 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.039440 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="23ea8751-ce46-40f3-b38d-fdc3f43449d6" containerName="manager" Jul 18 01:02:26.043322 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.043296 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:02:26.057670 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.057645 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj"] Jul 18 01:02:26.101661 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.101606 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" Jul 18 01:02:26.111704 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.111679 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwgxx\" (UniqueName: \"kubernetes.io/projected/acf0c14b-e4ad-4896-b455-970fe296b369-kube-api-access-hwgxx\") pod \"kuadrant-operator-controller-manager-86878c769f-nckpj\" (UID: \"acf0c14b-e4ad-4896-b455-970fe296b369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:02:26.111879 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.111726 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acf0c14b-e4ad-4896-b455-970fe296b369-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nckpj\" (UID: \"acf0c14b-e4ad-4896-b455-970fe296b369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:02:26.160553 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.160515 2585 generic.go:356] "Generic (PLEG): container finished" podID="fc9f10d6-3b6a-434e-b24e-fd26bbd201d4" containerID="a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90" exitCode=0 Jul 18 01:02:26.160705 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.160564 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" Jul 18 01:02:26.160705 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.160602 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" event={"ID":"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4","Type":"ContainerDied","Data":"a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90"} Jul 18 01:02:26.160705 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.160656 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm" event={"ID":"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4","Type":"ContainerDied","Data":"28435a8f121073219f87662be6a2e52ee3cca62800cfe4b0fbcf9c0dc5c6901e"} Jul 18 01:02:26.160705 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.160682 2585 scope.go:117] "RemoveContainer" containerID="a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90" Jul 18 01:02:26.169453 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.169435 2585 scope.go:117] "RemoveContainer" containerID="a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90" Jul 18 01:02:26.169745 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:02:26.169728 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90\": container with ID starting with a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90 not found: ID does not exist" containerID="a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90" Jul 18 01:02:26.169788 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.169753 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90"} err="failed to get container status \"a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90\": rpc error: code = NotFound desc = could not find container \"a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90\": container with ID starting with a22d785ba210cd0458559c2ce034f6ea668a225c0f6c03e86039f8a1f4996f90 not found: ID does not exist" Jul 18 01:02:26.213049 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.213016 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-extensions-socket-volume\") pod \"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4\" (UID: \"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4\") " Jul 18 01:02:26.213200 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.213100 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84ndq\" (UniqueName: \"kubernetes.io/projected/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-kube-api-access-84ndq\") pod \"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4\" (UID: \"fc9f10d6-3b6a-434e-b24e-fd26bbd201d4\") " Jul 18 01:02:26.213298 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.213278 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwgxx\" (UniqueName: \"kubernetes.io/projected/acf0c14b-e4ad-4896-b455-970fe296b369-kube-api-access-hwgxx\") pod \"kuadrant-operator-controller-manager-86878c769f-nckpj\" (UID: \"acf0c14b-e4ad-4896-b455-970fe296b369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:02:26.213379 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.213362 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acf0c14b-e4ad-4896-b455-970fe296b369-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nckpj\" (UID: \"acf0c14b-e4ad-4896-b455-970fe296b369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:02:26.213471 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.213434 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc9f10d6-3b6a-434e-b24e-fd26bbd201d4" (UID: "fc9f10d6-3b6a-434e-b24e-fd26bbd201d4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:02:26.213717 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.213687 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acf0c14b-e4ad-4896-b455-970fe296b369-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nckpj\" (UID: \"acf0c14b-e4ad-4896-b455-970fe296b369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:02:26.215299 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.215276 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-kube-api-access-84ndq" (OuterVolumeSpecName: "kube-api-access-84ndq") pod "fc9f10d6-3b6a-434e-b24e-fd26bbd201d4" (UID: "fc9f10d6-3b6a-434e-b24e-fd26bbd201d4"). InnerVolumeSpecName "kube-api-access-84ndq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:02:26.222639 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.222620 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwgxx\" (UniqueName: \"kubernetes.io/projected/acf0c14b-e4ad-4896-b455-970fe296b369-kube-api-access-hwgxx\") pod \"kuadrant-operator-controller-manager-86878c769f-nckpj\" (UID: \"acf0c14b-e4ad-4896-b455-970fe296b369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:02:26.314372 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.314343 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-extensions-socket-volume\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:02:26.314372 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.314369 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84ndq\" (UniqueName: \"kubernetes.io/projected/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4-kube-api-access-84ndq\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:02:26.355297 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.355226 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:02:26.495509 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.495476 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm"] Jul 18 01:02:26.497171 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.497141 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj"] Jul 18 01:02:26.499717 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:02:26.499682 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf0c14b_e4ad_4896_b455_970fe296b369.slice/crio-f01ee0c2caf63968c2e6b770f0095cb375a9c851a33b09956c9020940981d3c5 WatchSource:0}: Error finding container f01ee0c2caf63968c2e6b770f0095cb375a9c851a33b09956c9020940981d3c5: Status 404 returned error can't find the container with id f01ee0c2caf63968c2e6b770f0095cb375a9c851a33b09956c9020940981d3c5 Jul 18 01:02:26.502601 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.502586 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z9dmm"] Jul 18 01:02:26.795841 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:26.795748 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc9f10d6-3b6a-434e-b24e-fd26bbd201d4" path="/var/lib/kubelet/pods/fc9f10d6-3b6a-434e-b24e-fd26bbd201d4/volumes" Jul 18 01:02:27.168147 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:27.168120 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" event={"ID":"acf0c14b-e4ad-4896-b455-970fe296b369","Type":"ContainerStarted","Data":"701c415d5eab0eafef12e778ec53555793e79574786da1ff577dc2ac36abbc9c"} Jul 18 01:02:27.168543 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:27.168166 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" event={"ID":"acf0c14b-e4ad-4896-b455-970fe296b369","Type":"ContainerStarted","Data":"f01ee0c2caf63968c2e6b770f0095cb375a9c851a33b09956c9020940981d3c5"} Jul 18 01:02:27.168543 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:27.168251 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:02:27.190136 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:27.190085 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" podStartSLOduration=1.19006974 podStartE2EDuration="1.19006974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:02:27.188583438 +0000 UTC m=+468.927455654" watchObservedRunningTime="2026-07-18 01:02:27.19006974 +0000 UTC m=+468.928941934" Jul 18 01:02:38.175635 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:38.175605 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:02:42.940729 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:42.940697 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k"] Jul 18 01:02:42.941131 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:42.941089 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc9f10d6-3b6a-434e-b24e-fd26bbd201d4" containerName="manager" Jul 18 01:02:42.941131 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:42.941101 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc9f10d6-3b6a-434e-b24e-fd26bbd201d4" containerName="manager" Jul 18 01:02:42.941199 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:42.941183 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc9f10d6-3b6a-434e-b24e-fd26bbd201d4" containerName="manager" Jul 18 01:02:43.093647 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.093598 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k"] Jul 18 01:02:43.093813 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.093715 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.096768 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.096748 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-btjn6\"" Jul 18 01:02:43.097034 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.097017 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 01:02:43.265376 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.265284 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0605587-0bc3-4641-8704-798f6de1eb79-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.265376 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.265318 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.265376 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.265348 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.265650 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.265460 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h65s\" (UniqueName: \"kubernetes.io/projected/e0605587-0bc3-4641-8704-798f6de1eb79-kube-api-access-8h65s\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.265650 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.265489 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.265650 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.265511 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.265650 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.265527 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0605587-0bc3-4641-8704-798f6de1eb79-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.265650 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.265611 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0605587-0bc3-4641-8704-798f6de1eb79-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.265836 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.265651 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.366952 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.366914 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367176 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367005 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h65s\" (UniqueName: \"kubernetes.io/projected/e0605587-0bc3-4641-8704-798f6de1eb79-kube-api-access-8h65s\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367176 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367026 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367176 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367042 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367176 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367057 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0605587-0bc3-4641-8704-798f6de1eb79-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367176 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367087 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0605587-0bc3-4641-8704-798f6de1eb79-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367176 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367116 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367176 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367158 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0605587-0bc3-4641-8704-798f6de1eb79-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367532 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367183 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367532 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367429 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367532 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367494 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367632 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367560 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.367632 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.367581 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.368347 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.368323 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0605587-0bc3-4641-8704-798f6de1eb79-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.369577 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.369557 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0605587-0bc3-4641-8704-798f6de1eb79-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.369799 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.369778 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0605587-0bc3-4641-8704-798f6de1eb79-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.375221 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.375196 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0605587-0bc3-4641-8704-798f6de1eb79-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.375387 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.375371 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h65s\" (UniqueName: \"kubernetes.io/projected/e0605587-0bc3-4641-8704-798f6de1eb79-kube-api-access-8h65s\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9m48k\" (UID: \"e0605587-0bc3-4641-8704-798f6de1eb79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.404403 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.404367 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:43.572285 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.572262 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k"] Jul 18 01:02:43.574578 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:02:43.574547 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0605587_0bc3_4641_8704_798f6de1eb79.slice/crio-fff37efbb7dd94a9baf6ce4137a1eb9c22c3358ec18f662fe969f5184d497228 WatchSource:0}: Error finding container fff37efbb7dd94a9baf6ce4137a1eb9c22c3358ec18f662fe969f5184d497228: Status 404 returned error can't find the container with id fff37efbb7dd94a9baf6ce4137a1eb9c22c3358ec18f662fe969f5184d497228 Jul 18 01:02:43.576531 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.576501 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:02:43.576730 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.576579 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:02:43.576730 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:43.576605 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:02:44.251745 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:44.251712 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" event={"ID":"e0605587-0bc3-4641-8704-798f6de1eb79","Type":"ContainerStarted","Data":"03e80a516ca1cbf3f49932db15be4f06b087d65af4f5fa0d3ced3091a6fa724d"} Jul 18 01:02:44.252138 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:44.251761 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" event={"ID":"e0605587-0bc3-4641-8704-798f6de1eb79","Type":"ContainerStarted","Data":"fff37efbb7dd94a9baf6ce4137a1eb9c22c3358ec18f662fe969f5184d497228"} Jul 18 01:02:44.272997 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:44.272939 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" podStartSLOduration=2.2729233349999998 podStartE2EDuration="2.272923335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:02:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:02:44.271814988 +0000 UTC m=+486.010687203" watchObservedRunningTime="2026-07-18 01:02:44.272923335 +0000 UTC m=+486.011795551" Jul 18 01:02:44.405063 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:44.405025 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:44.410339 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:44.410311 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:45.257580 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:45.257551 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:45.258729 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:45.258711 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:02:57.549648 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.549607 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dx8n9"] Jul 18 01:02:57.614725 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.614695 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dx8n9"] Jul 18 01:02:57.614889 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.614808 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:02:57.624687 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.624661 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dx8n9"] Jul 18 01:02:57.625897 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.625877 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 18 01:02:57.690495 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.690451 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5r8x\" (UniqueName: \"kubernetes.io/projected/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-kube-api-access-d5r8x\") pod \"limitador-limitador-64c94fd64f-dx8n9\" (UID: \"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:02:57.690705 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.690522 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-config-file\") pod \"limitador-limitador-64c94fd64f-dx8n9\" (UID: \"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:02:57.791102 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.791060 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5r8x\" (UniqueName: \"kubernetes.io/projected/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-kube-api-access-d5r8x\") pod \"limitador-limitador-64c94fd64f-dx8n9\" (UID: \"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:02:57.791306 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.791138 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-config-file\") pod \"limitador-limitador-64c94fd64f-dx8n9\" (UID: \"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:02:57.791822 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.791798 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-config-file\") pod \"limitador-limitador-64c94fd64f-dx8n9\" (UID: \"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:02:57.800344 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.800287 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5r8x\" (UniqueName: \"kubernetes.io/projected/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-kube-api-access-d5r8x\") pod \"limitador-limitador-64c94fd64f-dx8n9\" (UID: \"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:02:57.927713 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:57.927676 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:02:58.073801 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:58.073777 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dx8n9"] Jul 18 01:02:58.076443 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:02:58.076417 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd307d2d6_f8a3_41ab_a62c_c838e9ddb88a.slice/crio-fa642ea27314db6739ed800083e6d288402746fd8df63000ce7f51964b56e2bb WatchSource:0}: Error finding container fa642ea27314db6739ed800083e6d288402746fd8df63000ce7f51964b56e2bb: Status 404 returned error can't find the container with id fa642ea27314db6739ed800083e6d288402746fd8df63000ce7f51964b56e2bb Jul 18 01:02:58.320251 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:02:58.320208 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" event={"ID":"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a","Type":"ContainerStarted","Data":"fa642ea27314db6739ed800083e6d288402746fd8df63000ce7f51964b56e2bb"} Jul 18 01:03:01.336042 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:01.335974 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" event={"ID":"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a","Type":"ContainerStarted","Data":"9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a"} Jul 18 01:03:01.336513 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:01.336188 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:03:01.373484 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:01.373428 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" podStartSLOduration=1.703765079 podStartE2EDuration="4.37341116s" totalImagesPullingTime="2.669646081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:03:01.372810084 +0000 UTC m=+503.111682302" watchObservedRunningTime="2026-07-18 01:03:01.37341116 +0000 UTC m=+503.112283455" Jul 18 01:03:12.342902 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:12.342870 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:03:15.016513 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:15.016478 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dx8n9"] Jul 18 01:03:15.017071 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:15.016726 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" podUID="d307d2d6-f8a3-41ab-a62c-c838e9ddb88a" containerName="limitador" containerID="cri-o://9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a" gracePeriod=30 Jul 18 01:03:15.575630 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:15.575607 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:03:15.646709 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:15.646672 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5r8x\" (UniqueName: \"kubernetes.io/projected/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-kube-api-access-d5r8x\") pod \"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a\" (UID: \"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a\") " Jul 18 01:03:15.646907 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:15.646736 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-config-file\") pod \"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a\" (UID: \"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a\") " Jul 18 01:03:15.647123 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:15.647097 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-config-file" (OuterVolumeSpecName: "config-file") pod "d307d2d6-f8a3-41ab-a62c-c838e9ddb88a" (UID: "d307d2d6-f8a3-41ab-a62c-c838e9ddb88a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:03:15.648880 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:15.648860 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-kube-api-access-d5r8x" (OuterVolumeSpecName: "kube-api-access-d5r8x") pod "d307d2d6-f8a3-41ab-a62c-c838e9ddb88a" (UID: "d307d2d6-f8a3-41ab-a62c-c838e9ddb88a"). InnerVolumeSpecName "kube-api-access-d5r8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:03:15.748209 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:15.748169 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5r8x\" (UniqueName: \"kubernetes.io/projected/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-kube-api-access-d5r8x\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:03:15.748209 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:15.748202 2585 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a-config-file\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:03:16.409357 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:16.409317 2585 generic.go:356] "Generic (PLEG): container finished" podID="d307d2d6-f8a3-41ab-a62c-c838e9ddb88a" containerID="9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a" exitCode=0 Jul 18 01:03:16.409357 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:16.409359 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" Jul 18 01:03:16.409863 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:16.409403 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" event={"ID":"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a","Type":"ContainerDied","Data":"9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a"} Jul 18 01:03:16.409863 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:16.409460 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dx8n9" event={"ID":"d307d2d6-f8a3-41ab-a62c-c838e9ddb88a","Type":"ContainerDied","Data":"fa642ea27314db6739ed800083e6d288402746fd8df63000ce7f51964b56e2bb"} Jul 18 01:03:16.409863 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:16.409483 2585 scope.go:117] "RemoveContainer" containerID="9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a" Jul 18 01:03:16.418490 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:16.418472 2585 scope.go:117] "RemoveContainer" containerID="9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a" Jul 18 01:03:16.418800 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:03:16.418780 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a\": container with ID starting with 9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a not found: ID does not exist" containerID="9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a" Jul 18 01:03:16.418838 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:16.418811 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a"} err="failed to get container status \"9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a\": rpc error: code = NotFound desc = could not find container \"9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a\": container with ID starting with 9dd78ecba550e3addd8faf1de2830f0893e0134ac6ba9478a9d7df59912e4d7a not found: ID does not exist" Jul 18 01:03:16.429977 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:16.429948 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dx8n9"] Jul 18 01:03:16.433717 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:16.433692 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dx8n9"] Jul 18 01:03:16.796284 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:16.796205 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d307d2d6-f8a3-41ab-a62c-c838e9ddb88a" path="/var/lib/kubelet/pods/d307d2d6-f8a3-41ab-a62c-c838e9ddb88a/volumes" Jul 18 01:03:17.441205 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.441178 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz"] Jul 18 01:03:17.441604 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.441590 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d307d2d6-f8a3-41ab-a62c-c838e9ddb88a" containerName="limitador" Jul 18 01:03:17.441648 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.441606 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d307d2d6-f8a3-41ab-a62c-c838e9ddb88a" containerName="limitador" Jul 18 01:03:17.441681 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.441677 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d307d2d6-f8a3-41ab-a62c-c838e9ddb88a" containerName="limitador" Jul 18 01:03:17.445972 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.445957 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" Jul 18 01:03:17.449722 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.449705 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 18 01:03:17.450305 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.450288 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 18 01:03:17.450415 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.450372 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-kvb77\"" Jul 18 01:03:17.450598 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.450584 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 18 01:03:17.463209 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.463183 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz"] Jul 18 01:03:17.564710 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.564679 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnfv6\" (UniqueName: \"kubernetes.io/projected/ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a-kube-api-access-nnfv6\") pod \"postgres-69fb4594cf-mzmtz\" (UID: \"ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" Jul 18 01:03:17.564890 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.564753 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a-data\") pod \"postgres-69fb4594cf-mzmtz\" (UID: \"ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" Jul 18 01:03:17.665643 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.665606 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a-data\") pod \"postgres-69fb4594cf-mzmtz\" (UID: \"ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" Jul 18 01:03:17.665831 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.665667 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnfv6\" (UniqueName: \"kubernetes.io/projected/ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a-kube-api-access-nnfv6\") pod \"postgres-69fb4594cf-mzmtz\" (UID: \"ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" Jul 18 01:03:17.666059 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.666028 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a-data\") pod \"postgres-69fb4594cf-mzmtz\" (UID: \"ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" Jul 18 01:03:17.673530 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.673507 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnfv6\" (UniqueName: \"kubernetes.io/projected/ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a-kube-api-access-nnfv6\") pod \"postgres-69fb4594cf-mzmtz\" (UID: \"ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" Jul 18 01:03:17.756313 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.756230 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" Jul 18 01:03:17.889687 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:17.889664 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz"] Jul 18 01:03:17.891967 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:03:17.891944 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd68fc3_5dda_4ee2_bb6a_24b2c1cb0e0a.slice/crio-050e49da19f9e0c0a96252d9ff0d57569edba3860e67eeaa8f00dd887dd0086d WatchSource:0}: Error finding container 050e49da19f9e0c0a96252d9ff0d57569edba3860e67eeaa8f00dd887dd0086d: Status 404 returned error can't find the container with id 050e49da19f9e0c0a96252d9ff0d57569edba3860e67eeaa8f00dd887dd0086d Jul 18 01:03:18.423289 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:18.423251 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" event={"ID":"ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a","Type":"ContainerStarted","Data":"050e49da19f9e0c0a96252d9ff0d57569edba3860e67eeaa8f00dd887dd0086d"} Jul 18 01:03:23.455885 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:23.455845 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" event={"ID":"ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a","Type":"ContainerStarted","Data":"4e831566421ced729955af6daef39a839e85d932816b3346f74e700b4e38fb37"} Jul 18 01:03:23.456300 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:23.455931 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" Jul 18 01:03:23.472962 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:23.472918 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" podStartSLOduration=1.440630551 podStartE2EDuration="6.472903009s" totalImagesPullingTime="5.032272458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:03:23.470430433 +0000 UTC m=+525.209302648" watchObservedRunningTime="2026-07-18 01:03:23.472903009 +0000 UTC m=+525.211775225" Jul 18 01:03:29.495078 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:29.495043 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mzmtz" Jul 18 01:03:36.903353 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:36.903319 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-779cc98c8d-569kl"] Jul 18 01:03:36.927552 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:36.927520 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-779cc98c8d-569kl"] Jul 18 01:03:36.927723 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:36.927631 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:36.930520 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:36.930496 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tz2zs\"" Jul 18 01:03:36.930725 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:36.930700 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 18 01:03:36.931137 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:36.931118 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 18 01:03:37.049890 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.049855 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92af6753-6d34-4292-a103-fb298d0ea6fa-webhook-cert\") pod \"maas-controller-779cc98c8d-569kl\" (UID: \"92af6753-6d34-4292-a103-fb298d0ea6fa\") " pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:37.050087 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.050017 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f8rr\" (UniqueName: \"kubernetes.io/projected/92af6753-6d34-4292-a103-fb298d0ea6fa-kube-api-access-9f8rr\") pod \"maas-controller-779cc98c8d-569kl\" (UID: \"92af6753-6d34-4292-a103-fb298d0ea6fa\") " pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:37.117155 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.117119 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cb9884d8c-cnbkl"] Jul 18 01:03:37.121285 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.121262 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:03:37.130945 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.130917 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-cnbkl"] Jul 18 01:03:37.150727 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.150690 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f8rr\" (UniqueName: \"kubernetes.io/projected/92af6753-6d34-4292-a103-fb298d0ea6fa-kube-api-access-9f8rr\") pod \"maas-controller-779cc98c8d-569kl\" (UID: \"92af6753-6d34-4292-a103-fb298d0ea6fa\") " pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:37.150890 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.150741 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92af6753-6d34-4292-a103-fb298d0ea6fa-webhook-cert\") pod \"maas-controller-779cc98c8d-569kl\" (UID: \"92af6753-6d34-4292-a103-fb298d0ea6fa\") " pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:37.153448 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.153392 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92af6753-6d34-4292-a103-fb298d0ea6fa-webhook-cert\") pod \"maas-controller-779cc98c8d-569kl\" (UID: \"92af6753-6d34-4292-a103-fb298d0ea6fa\") " pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:37.158481 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.158460 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f8rr\" (UniqueName: \"kubernetes.io/projected/92af6753-6d34-4292-a103-fb298d0ea6fa-kube-api-access-9f8rr\") pod \"maas-controller-779cc98c8d-569kl\" (UID: \"92af6753-6d34-4292-a103-fb298d0ea6fa\") " pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:37.239051 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.239013 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:37.251722 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.251683 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq4sk\" (UniqueName: \"kubernetes.io/projected/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-kube-api-access-zq4sk\") pod \"maas-controller-cb9884d8c-cnbkl\" (UID: \"53754fa0-2dc8-470b-8dd7-ed16a3dce42d\") " pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:03:37.251837 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.251826 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-webhook-cert\") pod \"maas-controller-cb9884d8c-cnbkl\" (UID: \"53754fa0-2dc8-470b-8dd7-ed16a3dce42d\") " pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:03:37.352630 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.352597 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-webhook-cert\") pod \"maas-controller-cb9884d8c-cnbkl\" (UID: \"53754fa0-2dc8-470b-8dd7-ed16a3dce42d\") " pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:03:37.352798 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.352699 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq4sk\" (UniqueName: \"kubernetes.io/projected/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-kube-api-access-zq4sk\") pod \"maas-controller-cb9884d8c-cnbkl\" (UID: \"53754fa0-2dc8-470b-8dd7-ed16a3dce42d\") " pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:03:37.355363 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.355335 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-webhook-cert\") pod \"maas-controller-cb9884d8c-cnbkl\" (UID: \"53754fa0-2dc8-470b-8dd7-ed16a3dce42d\") " pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:03:37.361528 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.361502 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq4sk\" (UniqueName: \"kubernetes.io/projected/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-kube-api-access-zq4sk\") pod \"maas-controller-cb9884d8c-cnbkl\" (UID: \"53754fa0-2dc8-470b-8dd7-ed16a3dce42d\") " pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:03:37.378265 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.378246 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-779cc98c8d-569kl"] Jul 18 01:03:37.380275 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:03:37.380246 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92af6753_6d34_4292_a103_fb298d0ea6fa.slice/crio-f053ac77bd18b992d5f6e49090b044a0b31428ad8f4adfbea8f91668c965963a WatchSource:0}: Error finding container f053ac77bd18b992d5f6e49090b044a0b31428ad8f4adfbea8f91668c965963a: Status 404 returned error can't find the container with id f053ac77bd18b992d5f6e49090b044a0b31428ad8f4adfbea8f91668c965963a Jul 18 01:03:37.432613 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.432541 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:03:37.529287 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.529250 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-779cc98c8d-569kl" event={"ID":"92af6753-6d34-4292-a103-fb298d0ea6fa","Type":"ContainerStarted","Data":"f053ac77bd18b992d5f6e49090b044a0b31428ad8f4adfbea8f91668c965963a"} Jul 18 01:03:37.571544 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:37.571518 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-cnbkl"] Jul 18 01:03:37.573323 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:03:37.573294 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53754fa0_2dc8_470b_8dd7_ed16a3dce42d.slice/crio-392c776f934bbc14e7cdcbb75e76f8c29a2c27072d13d5306dc63aa6878ecf23 WatchSource:0}: Error finding container 392c776f934bbc14e7cdcbb75e76f8c29a2c27072d13d5306dc63aa6878ecf23: Status 404 returned error can't find the container with id 392c776f934bbc14e7cdcbb75e76f8c29a2c27072d13d5306dc63aa6878ecf23 Jul 18 01:03:38.538576 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:38.538501 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" event={"ID":"53754fa0-2dc8-470b-8dd7-ed16a3dce42d","Type":"ContainerStarted","Data":"392c776f934bbc14e7cdcbb75e76f8c29a2c27072d13d5306dc63aa6878ecf23"} Jul 18 01:03:40.142191 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:40.142165 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 18 01:03:40.550456 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:40.550348 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-779cc98c8d-569kl" event={"ID":"92af6753-6d34-4292-a103-fb298d0ea6fa","Type":"ContainerStarted","Data":"b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44"} Jul 18 01:03:40.550644 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:40.550456 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:40.552096 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:40.552066 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" event={"ID":"53754fa0-2dc8-470b-8dd7-ed16a3dce42d","Type":"ContainerStarted","Data":"aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f"} Jul 18 01:03:40.552225 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:40.552155 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:03:40.567879 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:40.567814 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-779cc98c8d-569kl" podStartSLOduration=1.810348658 podStartE2EDuration="4.567795918s" totalImagesPullingTime="2.75744726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:03:40.567169327 +0000 UTC m=+542.306041544" watchObservedRunningTime="2026-07-18 01:03:40.567795918 +0000 UTC m=+542.306668133" Jul 18 01:03:40.584565 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:40.584500 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" podStartSLOduration=1.011638183 podStartE2EDuration="3.584476306s" totalImagesPullingTime="2.572838123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:03:40.583208608 +0000 UTC m=+542.322080824" watchObservedRunningTime="2026-07-18 01:03:40.584476306 +0000 UTC m=+542.323348523" Jul 18 01:03:51.560113 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:51.560081 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:51.560593 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:51.560256 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:03:51.628295 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:51.628256 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-779cc98c8d-569kl"] Jul 18 01:03:51.628563 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:51.628510 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-779cc98c8d-569kl" podUID="92af6753-6d34-4292-a103-fb298d0ea6fa" containerName="manager" containerID="cri-o://b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44" gracePeriod=30 Jul 18 01:03:51.876510 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:51.876487 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:51.971395 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:51.971370 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92af6753-6d34-4292-a103-fb298d0ea6fa-webhook-cert\") pod \"92af6753-6d34-4292-a103-fb298d0ea6fa\" (UID: \"92af6753-6d34-4292-a103-fb298d0ea6fa\") " Jul 18 01:03:51.971574 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:51.971432 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f8rr\" (UniqueName: \"kubernetes.io/projected/92af6753-6d34-4292-a103-fb298d0ea6fa-kube-api-access-9f8rr\") pod \"92af6753-6d34-4292-a103-fb298d0ea6fa\" (UID: \"92af6753-6d34-4292-a103-fb298d0ea6fa\") " Jul 18 01:03:51.973717 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:51.973683 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92af6753-6d34-4292-a103-fb298d0ea6fa-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "92af6753-6d34-4292-a103-fb298d0ea6fa" (UID: "92af6753-6d34-4292-a103-fb298d0ea6fa"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:03:51.973832 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:51.973763 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92af6753-6d34-4292-a103-fb298d0ea6fa-kube-api-access-9f8rr" (OuterVolumeSpecName: "kube-api-access-9f8rr") pod "92af6753-6d34-4292-a103-fb298d0ea6fa" (UID: "92af6753-6d34-4292-a103-fb298d0ea6fa"). InnerVolumeSpecName "kube-api-access-9f8rr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:03:52.072375 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.072337 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f8rr\" (UniqueName: \"kubernetes.io/projected/92af6753-6d34-4292-a103-fb298d0ea6fa-kube-api-access-9f8rr\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:03:52.072375 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.072368 2585 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92af6753-6d34-4292-a103-fb298d0ea6fa-webhook-cert\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:03:52.614446 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.614408 2585 generic.go:356] "Generic (PLEG): container finished" podID="92af6753-6d34-4292-a103-fb298d0ea6fa" containerID="b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44" exitCode=0 Jul 18 01:03:52.614886 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.614456 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-779cc98c8d-569kl" Jul 18 01:03:52.614886 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.614470 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-779cc98c8d-569kl" event={"ID":"92af6753-6d34-4292-a103-fb298d0ea6fa","Type":"ContainerDied","Data":"b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44"} Jul 18 01:03:52.614886 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.614525 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-779cc98c8d-569kl" event={"ID":"92af6753-6d34-4292-a103-fb298d0ea6fa","Type":"ContainerDied","Data":"f053ac77bd18b992d5f6e49090b044a0b31428ad8f4adfbea8f91668c965963a"} Jul 18 01:03:52.614886 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.614554 2585 scope.go:117] "RemoveContainer" containerID="b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44" Jul 18 01:03:52.623706 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.623688 2585 scope.go:117] "RemoveContainer" containerID="b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44" Jul 18 01:03:52.623968 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:03:52.623949 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44\": container with ID starting with b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44 not found: ID does not exist" containerID="b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44" Jul 18 01:03:52.624047 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.623977 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44"} err="failed to get container status \"b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44\": rpc error: code = NotFound desc = could not find container \"b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44\": container with ID starting with b4cd9d8d0c4b686eff9b2f29f6e79289d42a5f0b89a2517f7c37f75ea325ce44 not found: ID does not exist" Jul 18 01:03:52.635779 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.635750 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-779cc98c8d-569kl"] Jul 18 01:03:52.637509 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.637492 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-779cc98c8d-569kl"] Jul 18 01:03:52.798549 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:03:52.798521 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92af6753-6d34-4292-a103-fb298d0ea6fa" path="/var/lib/kubelet/pods/92af6753-6d34-4292-a103-fb298d0ea6fa/volumes" Jul 18 01:04:11.534927 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.534886 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-64f985c967-cc9th"] Jul 18 01:04:11.535552 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.535532 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92af6753-6d34-4292-a103-fb298d0ea6fa" containerName="manager" Jul 18 01:04:11.535628 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.535555 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="92af6753-6d34-4292-a103-fb298d0ea6fa" containerName="manager" Jul 18 01:04:11.535686 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.535675 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="92af6753-6d34-4292-a103-fb298d0ea6fa" containerName="manager" Jul 18 01:04:11.538817 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.538796 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:11.541436 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.541414 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 18 01:04:11.552547 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.552524 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-64f985c967-cc9th"] Jul 18 01:04:11.643288 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.643249 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcnnx\" (UniqueName: \"kubernetes.io/projected/e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe-kube-api-access-bcnnx\") pod \"maas-api-64f985c967-cc9th\" (UID: \"e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe\") " pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:11.643465 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.643370 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe-maas-api-tls\") pod \"maas-api-64f985c967-cc9th\" (UID: \"e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe\") " pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:11.643465 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.643396 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe-openshift-service-ca\") pod \"maas-api-64f985c967-cc9th\" (UID: \"e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe\") " pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:11.744622 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.744590 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe-maas-api-tls\") pod \"maas-api-64f985c967-cc9th\" (UID: \"e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe\") " pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:11.744622 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.744625 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe-openshift-service-ca\") pod \"maas-api-64f985c967-cc9th\" (UID: \"e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe\") " pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:11.744831 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.744660 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcnnx\" (UniqueName: \"kubernetes.io/projected/e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe-kube-api-access-bcnnx\") pod \"maas-api-64f985c967-cc9th\" (UID: \"e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe\") " pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:11.745271 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.745252 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe-openshift-service-ca\") pod \"maas-api-64f985c967-cc9th\" (UID: \"e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe\") " pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:11.747235 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.747219 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe-maas-api-tls\") pod \"maas-api-64f985c967-cc9th\" (UID: \"e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe\") " pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:11.759461 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.759440 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcnnx\" (UniqueName: \"kubernetes.io/projected/e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe-kube-api-access-bcnnx\") pod \"maas-api-64f985c967-cc9th\" (UID: \"e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe\") " pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:11.849761 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:11.849730 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:12.016261 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.016230 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-64f985c967-cc9th"] Jul 18 01:04:12.018162 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:04:12.018129 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21532a4_b7a9_4b26_bb06_5f12f9fa6cbe.slice/crio-6c5ec4b8d7c7ba5bb2daf43d24515a7b3ec509528419a61d5d2af761c624e75c WatchSource:0}: Error finding container 6c5ec4b8d7c7ba5bb2daf43d24515a7b3ec509528419a61d5d2af761c624e75c: Status 404 returned error can't find the container with id 6c5ec4b8d7c7ba5bb2daf43d24515a7b3ec509528419a61d5d2af761c624e75c Jul 18 01:04:12.214415 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.214323 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qp9q9"] Jul 18 01:04:12.219291 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.219269 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" Jul 18 01:04:12.221477 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.221458 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lm2v2\"" Jul 18 01:04:12.221622 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.221603 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 18 01:04:12.231602 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.231580 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qp9q9"] Jul 18 01:04:12.244260 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.244230 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-qk44p"] Jul 18 01:04:12.248346 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.248328 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" Jul 18 01:04:12.260871 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.260848 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-qk44p"] Jul 18 01:04:12.351529 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.351499 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1e70c4b-7de6-4640-a6e6-d34df94b5067-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qp9q9\" (UID: \"c1e70c4b-7de6-4640-a6e6-d34df94b5067\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" Jul 18 01:04:12.351529 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.351539 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hff4\" (UniqueName: \"kubernetes.io/projected/c1e70c4b-7de6-4640-a6e6-d34df94b5067-kube-api-access-7hff4\") pod \"payload-pre-processing-7677b774bb-qp9q9\" (UID: \"c1e70c4b-7de6-4640-a6e6-d34df94b5067\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" Jul 18 01:04:12.351769 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.351579 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h8vx\" (UniqueName: \"kubernetes.io/projected/71d2e4d5-5700-41f6-9269-1646d092d6de-kube-api-access-7h8vx\") pod \"payload-processing-5bf47cd988-qk44p\" (UID: \"71d2e4d5-5700-41f6-9269-1646d092d6de\") " pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" Jul 18 01:04:12.351769 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.351634 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71d2e4d5-5700-41f6-9269-1646d092d6de-plugins-config-volume\") pod \"payload-processing-5bf47cd988-qk44p\" (UID: \"71d2e4d5-5700-41f6-9269-1646d092d6de\") " pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" Jul 18 01:04:12.453163 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.453132 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h8vx\" (UniqueName: \"kubernetes.io/projected/71d2e4d5-5700-41f6-9269-1646d092d6de-kube-api-access-7h8vx\") pod \"payload-processing-5bf47cd988-qk44p\" (UID: \"71d2e4d5-5700-41f6-9269-1646d092d6de\") " pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" Jul 18 01:04:12.453163 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.453177 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71d2e4d5-5700-41f6-9269-1646d092d6de-plugins-config-volume\") pod \"payload-processing-5bf47cd988-qk44p\" (UID: \"71d2e4d5-5700-41f6-9269-1646d092d6de\") " pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" Jul 18 01:04:12.453420 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.453294 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1e70c4b-7de6-4640-a6e6-d34df94b5067-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qp9q9\" (UID: \"c1e70c4b-7de6-4640-a6e6-d34df94b5067\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" Jul 18 01:04:12.453420 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.453320 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hff4\" (UniqueName: \"kubernetes.io/projected/c1e70c4b-7de6-4640-a6e6-d34df94b5067-kube-api-access-7hff4\") pod \"payload-pre-processing-7677b774bb-qp9q9\" (UID: \"c1e70c4b-7de6-4640-a6e6-d34df94b5067\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" Jul 18 01:04:12.454245 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.454219 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71d2e4d5-5700-41f6-9269-1646d092d6de-plugins-config-volume\") pod \"payload-processing-5bf47cd988-qk44p\" (UID: \"71d2e4d5-5700-41f6-9269-1646d092d6de\") " pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" Jul 18 01:04:12.454331 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.454309 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1e70c4b-7de6-4640-a6e6-d34df94b5067-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-qp9q9\" (UID: \"c1e70c4b-7de6-4640-a6e6-d34df94b5067\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" Jul 18 01:04:12.461427 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.461395 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hff4\" (UniqueName: \"kubernetes.io/projected/c1e70c4b-7de6-4640-a6e6-d34df94b5067-kube-api-access-7hff4\") pod \"payload-pre-processing-7677b774bb-qp9q9\" (UID: \"c1e70c4b-7de6-4640-a6e6-d34df94b5067\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" Jul 18 01:04:12.461612 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.461588 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h8vx\" (UniqueName: \"kubernetes.io/projected/71d2e4d5-5700-41f6-9269-1646d092d6de-kube-api-access-7h8vx\") pod \"payload-processing-5bf47cd988-qk44p\" (UID: \"71d2e4d5-5700-41f6-9269-1646d092d6de\") " pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" Jul 18 01:04:12.530632 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.530546 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" Jul 18 01:04:12.560998 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.560949 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" Jul 18 01:04:12.696495 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.695741 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-qp9q9"] Jul 18 01:04:12.714320 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.714275 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" event={"ID":"e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe","Type":"ContainerStarted","Data":"6c5ec4b8d7c7ba5bb2daf43d24515a7b3ec509528419a61d5d2af761c624e75c"} Jul 18 01:04:12.715647 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.715612 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" event={"ID":"c1e70c4b-7de6-4640-a6e6-d34df94b5067","Type":"ContainerStarted","Data":"f9bafdf51287f2a0f21e9d0c5e817a92626c8b7f036fc0c6f6a0b8941c0946a9"} Jul 18 01:04:12.725472 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:12.725446 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-qk44p"] Jul 18 01:04:12.728030 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:04:12.727966 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d2e4d5_5700_41f6_9269_1646d092d6de.slice/crio-ffbc1dc8604090b32091bd6c6975ddb2a9c3bc17418767e30f25f19d85fdc272 WatchSource:0}: Error finding container ffbc1dc8604090b32091bd6c6975ddb2a9c3bc17418767e30f25f19d85fdc272: Status 404 returned error can't find the container with id ffbc1dc8604090b32091bd6c6975ddb2a9c3bc17418767e30f25f19d85fdc272 Jul 18 01:04:13.726400 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:13.726264 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" event={"ID":"71d2e4d5-5700-41f6-9269-1646d092d6de","Type":"ContainerStarted","Data":"ffbc1dc8604090b32091bd6c6975ddb2a9c3bc17418767e30f25f19d85fdc272"} Jul 18 01:04:16.744906 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:16.744856 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" event={"ID":"c1e70c4b-7de6-4640-a6e6-d34df94b5067","Type":"ContainerStarted","Data":"487833d9a01a3ce02c2b3b01eba874b6014a4104dc85c6696f9809d6755cd3b7"} Jul 18 01:04:16.745842 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:16.745813 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" Jul 18 01:04:16.747902 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:16.747867 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" event={"ID":"e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe","Type":"ContainerStarted","Data":"d0cedcbeab6fc994601639e8c9d398cc6cbe0c016dc3da07592b241e904ddb1f"} Jul 18 01:04:16.748421 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:16.748397 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:16.755848 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:16.755815 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" event={"ID":"71d2e4d5-5700-41f6-9269-1646d092d6de","Type":"ContainerStarted","Data":"6cbd1efbfc9d1ccd6161472d0cfa24fd9307cfa4a249ca1be2bb0f972417ae7e"} Jul 18 01:04:16.756344 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:16.756324 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" Jul 18 01:04:16.804372 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:16.804326 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" podStartSLOduration=1.850000412 podStartE2EDuration="5.804309276s" totalImagesPullingTime="3.954308864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:04:16.803751091 +0000 UTC m=+578.542623307" watchObservedRunningTime="2026-07-18 01:04:16.804309276 +0000 UTC m=+578.543181491" Jul 18 01:04:16.805404 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:16.805368 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" podStartSLOduration=1.466907354 podStartE2EDuration="4.805359246s" totalImagesPullingTime="3.338451892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:04:16.77117403 +0000 UTC m=+578.510046248" watchObservedRunningTime="2026-07-18 01:04:16.805359246 +0000 UTC m=+578.544231461" Jul 18 01:04:16.839401 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:16.839361 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" podStartSLOduration=1.4964658960000001 podStartE2EDuration="4.839345401s" totalImagesPullingTime="3.342879505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:04:16.839106204 +0000 UTC m=+578.577978411" watchObservedRunningTime="2026-07-18 01:04:16.839345401 +0000 UTC m=+578.578217617" Jul 18 01:04:20.781079 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:20.781047 2585 generic.go:356] "Generic (PLEG): container finished" podID="e0605587-0bc3-4641-8704-798f6de1eb79" containerID="03e80a516ca1cbf3f49932db15be4f06b087d65af4f5fa0d3ced3091a6fa724d" exitCode=0 Jul 18 01:04:20.781510 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:20.781121 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" event={"ID":"e0605587-0bc3-4641-8704-798f6de1eb79","Type":"ContainerDied","Data":"03e80a516ca1cbf3f49932db15be4f06b087d65af4f5fa0d3ced3091a6fa724d"} Jul 18 01:04:20.781510 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:20.781494 2585 scope.go:117] "RemoveContainer" containerID="03e80a516ca1cbf3f49932db15be4f06b087d65af4f5fa0d3ced3091a6fa724d" Jul 18 01:04:20.782502 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:20.782475 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:04:20.782608 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:20.782551 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:04:20.782672 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:20.782608 2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:04:21.787572 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:21.787532 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" event={"ID":"e0605587-0bc3-4641-8704-798f6de1eb79","Type":"ContainerStarted","Data":"ca52be1cbbefe30ca130e6f2c4daa72ee90d5ac535fa599da5f753cab98e77a4"} Jul 18 01:04:22.404680 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:22.404638 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:04:22.404925 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:22.404908 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9m48k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 18 01:04:22.404971 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:22.404950 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" podUID="e0605587-0bc3-4641-8704-798f6de1eb79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 18 01:04:23.405188 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:23.405152 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9m48k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 18 01:04:23.405584 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:23.405227 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" podUID="e0605587-0bc3-4641-8704-798f6de1eb79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 18 01:04:23.772163 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:23.772091 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-64f985c967-cc9th" Jul 18 01:04:24.405113 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:24.405075 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9m48k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 18 01:04:24.405286 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:24.405144 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" podUID="e0605587-0bc3-4641-8704-798f6de1eb79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 18 01:04:25.405582 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:25.405542 2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9m48k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 18 01:04:25.406022 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:25.405604 2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" podUID="e0605587-0bc3-4641-8704-798f6de1eb79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 18 01:04:26.408745 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:26.408711 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:04:26.409234 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:26.409093 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:04:26.409864 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:26.409844 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9m48k" Jul 18 01:04:28.768006 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:28.767943 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-qk44p" Jul 18 01:04:28.768363 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:28.768069 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-qp9q9" Jul 18 01:04:30.068156 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.068122 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl"] Jul 18 01:04:30.071951 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.071933 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.075144 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.075123 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 18 01:04:30.075144 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.075133 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wwm57\"" Jul 18 01:04:30.075302 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.075185 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 18 01:04:30.075302 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.075133 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 18 01:04:30.081317 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.081293 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl"] Jul 18 01:04:30.131564 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.131534 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh6bh\" (UniqueName: \"kubernetes.io/projected/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-kube-api-access-bh6bh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.131738 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.131598 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.131738 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.131628 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.131738 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.131654 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.131917 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.131741 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.131917 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.131801 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.232337 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.232296 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.232521 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.232349 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.232521 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.232478 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh6bh\" (UniqueName: \"kubernetes.io/projected/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-kube-api-access-bh6bh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.232637 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.232584 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.232637 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.232604 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.232637 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.232623 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.232773 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.232755 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.232938 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.232913 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.233023 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.232928 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.235180 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.235156 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.235428 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.235410 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.241739 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.241714 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh6bh\" (UniqueName: \"kubernetes.io/projected/e3599b29-1c7b-4e9b-85f8-6e7ed888859d-kube-api-access-bh6bh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl\" (UID: \"e3599b29-1c7b-4e9b-85f8-6e7ed888859d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.383391 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.383356 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:30.534299 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.534272 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl"] Jul 18 01:04:30.536094 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:04:30.536043 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3599b29_1c7b_4e9b_85f8_6e7ed888859d.slice/crio-08740c28afc494b36d422f227251ab901176bf63e600ba118d0bb8f6b84d1dd1 WatchSource:0}: Error finding container 08740c28afc494b36d422f227251ab901176bf63e600ba118d0bb8f6b84d1dd1: Status 404 returned error can't find the container with id 08740c28afc494b36d422f227251ab901176bf63e600ba118d0bb8f6b84d1dd1 Jul 18 01:04:30.837643 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:30.837547 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" event={"ID":"e3599b29-1c7b-4e9b-85f8-6e7ed888859d","Type":"ContainerStarted","Data":"08740c28afc494b36d422f227251ab901176bf63e600ba118d0bb8f6b84d1dd1"} Jul 18 01:04:31.844699 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:31.844602 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" event={"ID":"e3599b29-1c7b-4e9b-85f8-6e7ed888859d","Type":"ContainerStarted","Data":"970b772f414a886b3b03e2a925991d26587f07c3163a25566ec3c3904d45f4af"} Jul 18 01:04:31.864959 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:31.864902 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" podStartSLOduration=0.822292704 podStartE2EDuration="1.864882345s" totalImagesPullingTime="1.042589641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:04:31.863943102 +0000 UTC m=+593.602815314" watchObservedRunningTime="2026-07-18 01:04:31.864882345 +0000 UTC m=+593.603754558" Jul 18 01:04:38.723518 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:38.723492 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 01:04:38.727967 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:38.727941 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 01:04:38.731087 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:38.731060 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 01:04:38.735500 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:38.735478 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 01:04:40.384094 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:40.384062 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:40.384566 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:40.384123 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:40.396790 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:40.396754 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:40.903670 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:40.903638 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl" Jul 18 01:04:55.653942 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.653907 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk"] Jul 18 01:04:55.662760 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.662738 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.665294 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.665264 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 18 01:04:55.670056 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.670032 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk"] Jul 18 01:04:55.772760 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.772728 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.772760 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.772766 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.773020 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.772785 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.773020 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.772807 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26s4w\" (UniqueName: \"kubernetes.io/projected/4b21069c-e22f-4ab9-ada2-463597839df5-kube-api-access-26s4w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.773020 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.772867 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b21069c-e22f-4ab9-ada2-463597839df5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.773020 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.772965 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.874209 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.874169 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.874209 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.874210 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.874439 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.874233 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26s4w\" (UniqueName: \"kubernetes.io/projected/4b21069c-e22f-4ab9-ada2-463597839df5-kube-api-access-26s4w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.874439 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.874260 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b21069c-e22f-4ab9-ada2-463597839df5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.874439 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.874350 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.874439 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.874387 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.874691 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.874626 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.874691 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.874656 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.874789 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.874696 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.876806 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.876782 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b21069c-e22f-4ab9-ada2-463597839df5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.877212 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.877193 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b21069c-e22f-4ab9-ada2-463597839df5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.882288 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.882264 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26s4w\" (UniqueName: \"kubernetes.io/projected/4b21069c-e22f-4ab9-ada2-463597839df5-kube-api-access-26s4w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-srqgk\" (UID: \"4b21069c-e22f-4ab9-ada2-463597839df5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:55.975056 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:55.974943 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:04:56.119943 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:56.119912 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk"] Jul 18 01:04:56.122047 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:04:56.122022 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b21069c_e22f_4ab9_ada2_463597839df5.slice/crio-c37d90b62f430367d43f7e63562abe52f59cb1b3efdb89f11aa10ba1ca5de758 WatchSource:0}: Error finding container c37d90b62f430367d43f7e63562abe52f59cb1b3efdb89f11aa10ba1ca5de758: Status 404 returned error can't find the container with id c37d90b62f430367d43f7e63562abe52f59cb1b3efdb89f11aa10ba1ca5de758 Jul 18 01:04:56.123390 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:56.123369 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 01:04:56.974833 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:56.974787 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" event={"ID":"4b21069c-e22f-4ab9-ada2-463597839df5","Type":"ContainerStarted","Data":"28b3611453338d1576dc6db165b97dbbb64f0ce93ffc260c7aecf9fcc6f6927f"} Jul 18 01:04:56.975266 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:56.974852 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" event={"ID":"4b21069c-e22f-4ab9-ada2-463597839df5","Type":"ContainerStarted","Data":"c37d90b62f430367d43f7e63562abe52f59cb1b3efdb89f11aa10ba1ca5de758"} Jul 18 01:04:57.008778 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:04:57.008721 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" podStartSLOduration=1.832156737 podStartE2EDuration="2.008706128s" totalImagesPullingTime="176.549391ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:04:57.00822939 +0000 UTC m=+618.747101606" watchObservedRunningTime="2026-07-18 01:04:57.008706128 +0000 UTC m=+618.747578343" Jul 18 01:05:05.976053 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:05:05.975945 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:05:05.976540 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:05:05.976282 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:05:05.989805 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:05:05.989771 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:05:06.035240 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:05:06.035207 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-srqgk" Jul 18 01:07:43.158347 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.158315 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-cnbkl"] Jul 18 01:07:43.158963 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.158559 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" podUID="53754fa0-2dc8-470b-8dd7-ed16a3dce42d" containerName="manager" containerID="cri-o://aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f" gracePeriod=30 Jul 18 01:07:43.412396 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.412342 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:07:43.518719 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.518681 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq4sk\" (UniqueName: \"kubernetes.io/projected/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-kube-api-access-zq4sk\") pod \"53754fa0-2dc8-470b-8dd7-ed16a3dce42d\" (UID: \"53754fa0-2dc8-470b-8dd7-ed16a3dce42d\") " Jul 18 01:07:43.518905 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.518762 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-webhook-cert\") pod \"53754fa0-2dc8-470b-8dd7-ed16a3dce42d\" (UID: \"53754fa0-2dc8-470b-8dd7-ed16a3dce42d\") " Jul 18 01:07:43.521017 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.520962 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "53754fa0-2dc8-470b-8dd7-ed16a3dce42d" (UID: "53754fa0-2dc8-470b-8dd7-ed16a3dce42d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:07:43.521103 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.521028 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-kube-api-access-zq4sk" (OuterVolumeSpecName: "kube-api-access-zq4sk") pod "53754fa0-2dc8-470b-8dd7-ed16a3dce42d" (UID: "53754fa0-2dc8-470b-8dd7-ed16a3dce42d"). InnerVolumeSpecName "kube-api-access-zq4sk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:07:43.619896 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.619858 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq4sk\" (UniqueName: \"kubernetes.io/projected/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-kube-api-access-zq4sk\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:07:43.619896 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.619889 2585 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53754fa0-2dc8-470b-8dd7-ed16a3dce42d-webhook-cert\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:07:43.831430 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.831341 2585 generic.go:356] "Generic (PLEG): container finished" podID="53754fa0-2dc8-470b-8dd7-ed16a3dce42d" containerID="aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f" exitCode=0 Jul 18 01:07:43.831430 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.831380 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" Jul 18 01:07:43.831614 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.831428 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" event={"ID":"53754fa0-2dc8-470b-8dd7-ed16a3dce42d","Type":"ContainerDied","Data":"aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f"} Jul 18 01:07:43.831614 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.831474 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb9884d8c-cnbkl" event={"ID":"53754fa0-2dc8-470b-8dd7-ed16a3dce42d","Type":"ContainerDied","Data":"392c776f934bbc14e7cdcbb75e76f8c29a2c27072d13d5306dc63aa6878ecf23"} Jul 18 01:07:43.831614 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.831497 2585 scope.go:117] "RemoveContainer" containerID="aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f" Jul 18 01:07:43.840485 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.840469 2585 scope.go:117] "RemoveContainer" containerID="aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f" Jul 18 01:07:43.840731 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:07:43.840715 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f\": container with ID starting with aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f not found: ID does not exist" containerID="aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f" Jul 18 01:07:43.840781 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.840739 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f"} err="failed to get container status \"aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f\": rpc error: code = NotFound desc = could not find container \"aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f\": container with ID starting with aa1f72db89b0f0ec157f958079d1d7fb9a8d3dacc645b086c6ca339312fea84f not found: ID does not exist" Jul 18 01:07:43.850900 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.850875 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-cnbkl"] Jul 18 01:07:43.853522 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:43.853503 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-cnbkl"] Jul 18 01:07:44.796788 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:07:44.796760 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53754fa0-2dc8-470b-8dd7-ed16a3dce42d" path="/var/lib/kubelet/pods/53754fa0-2dc8-470b-8dd7-ed16a3dce42d/volumes" Jul 18 01:08:44.600746 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.600708 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cb9884d8c-vr86s"] Jul 18 01:08:44.601375 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.601352 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53754fa0-2dc8-470b-8dd7-ed16a3dce42d" containerName="manager" Jul 18 01:08:44.601456 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.601378 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="53754fa0-2dc8-470b-8dd7-ed16a3dce42d" containerName="manager" Jul 18 01:08:44.601510 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.601485 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="53754fa0-2dc8-470b-8dd7-ed16a3dce42d" containerName="manager" Jul 18 01:08:44.605822 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.605801 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:08:44.609101 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.609075 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tz2zs\"" Jul 18 01:08:44.609424 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.609399 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 18 01:08:44.609539 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.609483 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 18 01:08:44.612214 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.612175 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-vr86s"] Jul 18 01:08:44.675312 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.675276 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23868801-ae93-4684-9b14-eb04ce7ebbee-webhook-cert\") pod \"maas-controller-cb9884d8c-vr86s\" (UID: \"23868801-ae93-4684-9b14-eb04ce7ebbee\") " pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:08:44.675507 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.675362 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzg8k\" (UniqueName: \"kubernetes.io/projected/23868801-ae93-4684-9b14-eb04ce7ebbee-kube-api-access-lzg8k\") pod \"maas-controller-cb9884d8c-vr86s\" (UID: \"23868801-ae93-4684-9b14-eb04ce7ebbee\") " pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:08:44.775861 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.775822 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzg8k\" (UniqueName: \"kubernetes.io/projected/23868801-ae93-4684-9b14-eb04ce7ebbee-kube-api-access-lzg8k\") pod \"maas-controller-cb9884d8c-vr86s\" (UID: \"23868801-ae93-4684-9b14-eb04ce7ebbee\") " pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:08:44.776065 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.775897 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23868801-ae93-4684-9b14-eb04ce7ebbee-webhook-cert\") pod \"maas-controller-cb9884d8c-vr86s\" (UID: \"23868801-ae93-4684-9b14-eb04ce7ebbee\") " pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:08:44.778629 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.778595 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23868801-ae93-4684-9b14-eb04ce7ebbee-webhook-cert\") pod \"maas-controller-cb9884d8c-vr86s\" (UID: \"23868801-ae93-4684-9b14-eb04ce7ebbee\") " pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:08:44.784472 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.784445 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzg8k\" (UniqueName: \"kubernetes.io/projected/23868801-ae93-4684-9b14-eb04ce7ebbee-kube-api-access-lzg8k\") pod \"maas-controller-cb9884d8c-vr86s\" (UID: \"23868801-ae93-4684-9b14-eb04ce7ebbee\") " pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:08:44.917619 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:44.917507 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:08:45.057758 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:45.057732 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-vr86s"] Jul 18 01:08:45.145719 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:45.145684 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb9884d8c-vr86s" event={"ID":"23868801-ae93-4684-9b14-eb04ce7ebbee","Type":"ContainerStarted","Data":"5f720dca4fc91cd882ce947266aa0dcbde1c8b889f5b99b814197e174bcc2ffa"} Jul 18 01:08:46.152634 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:46.152596 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb9884d8c-vr86s" event={"ID":"23868801-ae93-4684-9b14-eb04ce7ebbee","Type":"ContainerStarted","Data":"082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362"} Jul 18 01:08:46.153102 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:46.152717 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:08:46.172344 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:46.172285 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cb9884d8c-vr86s" podStartSLOduration=1.780434113 podStartE2EDuration="2.172266447s" totalImagesPullingTime="391.832334ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:08:46.171067741 +0000 UTC m=+847.909939961" watchObservedRunningTime="2026-07-18 01:08:46.172266447 +0000 UTC m=+847.911138692" Jul 18 01:08:57.160331 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:08:57.160302 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:09:01.785859 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:01.785822 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-vr86s"] Jul 18 01:09:01.786325 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:01.786032 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-cb9884d8c-vr86s" podUID="23868801-ae93-4684-9b14-eb04ce7ebbee" containerName="manager" containerID="cri-o://082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362" gracePeriod=30 Jul 18 01:09:02.032169 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.032144 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:09:02.127342 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.127311 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23868801-ae93-4684-9b14-eb04ce7ebbee-webhook-cert\") pod \"23868801-ae93-4684-9b14-eb04ce7ebbee\" (UID: \"23868801-ae93-4684-9b14-eb04ce7ebbee\") " Jul 18 01:09:02.127527 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.127404 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzg8k\" (UniqueName: \"kubernetes.io/projected/23868801-ae93-4684-9b14-eb04ce7ebbee-kube-api-access-lzg8k\") pod \"23868801-ae93-4684-9b14-eb04ce7ebbee\" (UID: \"23868801-ae93-4684-9b14-eb04ce7ebbee\") " Jul 18 01:09:02.129492 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.129466 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23868801-ae93-4684-9b14-eb04ce7ebbee-kube-api-access-lzg8k" (OuterVolumeSpecName: "kube-api-access-lzg8k") pod "23868801-ae93-4684-9b14-eb04ce7ebbee" (UID: "23868801-ae93-4684-9b14-eb04ce7ebbee"). InnerVolumeSpecName "kube-api-access-lzg8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:09:02.129579 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.129507 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23868801-ae93-4684-9b14-eb04ce7ebbee-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "23868801-ae93-4684-9b14-eb04ce7ebbee" (UID: "23868801-ae93-4684-9b14-eb04ce7ebbee"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:09:02.228520 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.228484 2585 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23868801-ae93-4684-9b14-eb04ce7ebbee-webhook-cert\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:09:02.228520 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.228514 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzg8k\" (UniqueName: \"kubernetes.io/projected/23868801-ae93-4684-9b14-eb04ce7ebbee-kube-api-access-lzg8k\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:09:02.234534 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.234505 2585 generic.go:356] "Generic (PLEG): container finished" podID="23868801-ae93-4684-9b14-eb04ce7ebbee" containerID="082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362" exitCode=0 Jul 18 01:09:02.234673 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.234554 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb9884d8c-vr86s" Jul 18 01:09:02.234673 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.234593 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb9884d8c-vr86s" event={"ID":"23868801-ae93-4684-9b14-eb04ce7ebbee","Type":"ContainerDied","Data":"082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362"} Jul 18 01:09:02.234673 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.234647 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb9884d8c-vr86s" event={"ID":"23868801-ae93-4684-9b14-eb04ce7ebbee","Type":"ContainerDied","Data":"5f720dca4fc91cd882ce947266aa0dcbde1c8b889f5b99b814197e174bcc2ffa"} Jul 18 01:09:02.234673 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.234672 2585 scope.go:117] "RemoveContainer" containerID="082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362" Jul 18 01:09:02.244183 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.244168 2585 scope.go:117] "RemoveContainer" containerID="082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362" Jul 18 01:09:02.244447 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:09:02.244429 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362\": container with ID starting with 082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362 not found: ID does not exist" containerID="082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362" Jul 18 01:09:02.244494 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.244455 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362"} err="failed to get container status \"082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362\": rpc error: code = NotFound desc = could not find container \"082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362\": container with ID starting with 082ca773071c39048a4ee7c1af47a847d706fadc8bd9652bee5caeef82011362 not found: ID does not exist" Jul 18 01:09:02.256626 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.256603 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-vr86s"] Jul 18 01:09:02.260151 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.260130 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-vr86s"] Jul 18 01:09:02.796055 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:02.796025 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23868801-ae93-4684-9b14-eb04ce7ebbee" path="/var/lib/kubelet/pods/23868801-ae93-4684-9b14-eb04ce7ebbee/volumes" Jul 18 01:09:03.061132 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.061050 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cb9884d8c-vz8jd"] Jul 18 01:09:03.061512 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.061495 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23868801-ae93-4684-9b14-eb04ce7ebbee" containerName="manager" Jul 18 01:09:03.061597 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.061515 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="23868801-ae93-4684-9b14-eb04ce7ebbee" containerName="manager" Jul 18 01:09:03.061658 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.061649 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="23868801-ae93-4684-9b14-eb04ce7ebbee" containerName="manager" Jul 18 01:09:03.064658 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.064638 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb9884d8c-vz8jd" Jul 18 01:09:03.067307 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.067290 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 18 01:09:03.067825 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.067808 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 18 01:09:03.067913 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.067811 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tz2zs\"" Jul 18 01:09:03.072031 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.071959 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-vz8jd"] Jul 18 01:09:03.134004 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.133961 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-442mk\" (UniqueName: \"kubernetes.io/projected/b2572a31-8506-4e8e-89b8-a19b855e6357-kube-api-access-442mk\") pod \"maas-controller-cb9884d8c-vz8jd\" (UID: \"b2572a31-8506-4e8e-89b8-a19b855e6357\") " pod="opendatahub/maas-controller-cb9884d8c-vz8jd" Jul 18 01:09:03.134128 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.134074 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2572a31-8506-4e8e-89b8-a19b855e6357-webhook-cert\") pod \"maas-controller-cb9884d8c-vz8jd\" (UID: \"b2572a31-8506-4e8e-89b8-a19b855e6357\") " pod="opendatahub/maas-controller-cb9884d8c-vz8jd" Jul 18 01:09:03.235215 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.235185 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-442mk\" (UniqueName: \"kubernetes.io/projected/b2572a31-8506-4e8e-89b8-a19b855e6357-kube-api-access-442mk\") pod \"maas-controller-cb9884d8c-vz8jd\" (UID: \"b2572a31-8506-4e8e-89b8-a19b855e6357\") " pod="opendatahub/maas-controller-cb9884d8c-vz8jd" Jul 18 01:09:03.235345 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.235249 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2572a31-8506-4e8e-89b8-a19b855e6357-webhook-cert\") pod \"maas-controller-cb9884d8c-vz8jd\" (UID: \"b2572a31-8506-4e8e-89b8-a19b855e6357\") " pod="opendatahub/maas-controller-cb9884d8c-vz8jd" Jul 18 01:09:03.237855 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.237829 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2572a31-8506-4e8e-89b8-a19b855e6357-webhook-cert\") pod \"maas-controller-cb9884d8c-vz8jd\" (UID: \"b2572a31-8506-4e8e-89b8-a19b855e6357\") " pod="opendatahub/maas-controller-cb9884d8c-vz8jd" Jul 18 01:09:03.243591 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.243571 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-442mk\" (UniqueName: \"kubernetes.io/projected/b2572a31-8506-4e8e-89b8-a19b855e6357-kube-api-access-442mk\") pod \"maas-controller-cb9884d8c-vz8jd\" (UID: \"b2572a31-8506-4e8e-89b8-a19b855e6357\") " pod="opendatahub/maas-controller-cb9884d8c-vz8jd" Jul 18 01:09:03.377259 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.377234 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb9884d8c-vz8jd" Jul 18 01:09:03.510916 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:03.510881 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cb9884d8c-vz8jd"] Jul 18 01:09:04.249204 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:04.249130 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb9884d8c-vz8jd" event={"ID":"b2572a31-8506-4e8e-89b8-a19b855e6357","Type":"ContainerStarted","Data":"61de7b362f6ed7f90baf40653824719428deb4d1d37ff13a37e88e521e223f81"} Jul 18 01:09:04.249204 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:04.249177 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb9884d8c-vz8jd" event={"ID":"b2572a31-8506-4e8e-89b8-a19b855e6357","Type":"ContainerStarted","Data":"b702e5011aa0b24df0b9a0e3c83ce3670b9ee972d2eee2025a3070a6585c5945"} Jul 18 01:09:04.249590 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:04.249255 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cb9884d8c-vz8jd" Jul 18 01:09:04.288377 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:04.288327 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cb9884d8c-vz8jd" podStartSLOduration=0.861712003 podStartE2EDuration="1.288313291s" totalImagesPullingTime="426.601288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:09:04.286764728 +0000 UTC m=+866.025636946" watchObservedRunningTime="2026-07-18 01:09:04.288313291 +0000 UTC m=+866.027185506" Jul 18 01:09:15.257052 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:15.257025 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cb9884d8c-vz8jd" Jul 18 01:09:38.760251 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:38.760155 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 01:09:38.763161 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:38.763139 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 01:09:38.768521 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:38.768503 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 01:09:38.771370 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:09:38.771349 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 01:13:54.428186 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:54.428154 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj"] Jul 18 01:13:54.428765 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:54.428343 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" podUID="acf0c14b-e4ad-4896-b455-970fe296b369" containerName="manager" containerID="cri-o://701c415d5eab0eafef12e778ec53555793e79574786da1ff577dc2ac36abbc9c" gracePeriod=10 Jul 18 01:13:55.770828 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:55.770793 2585 generic.go:356] "Generic (PLEG): container finished" podID="acf0c14b-e4ad-4896-b455-970fe296b369" containerID="701c415d5eab0eafef12e778ec53555793e79574786da1ff577dc2ac36abbc9c" exitCode=0 Jul 18 01:13:55.771291 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:55.770874 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" event={"ID":"acf0c14b-e4ad-4896-b455-970fe296b369","Type":"ContainerDied","Data":"701c415d5eab0eafef12e778ec53555793e79574786da1ff577dc2ac36abbc9c"} Jul 18 01:13:55.793810 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:55.793744 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:13:55.912097 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:55.912059 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwgxx\" (UniqueName: \"kubernetes.io/projected/acf0c14b-e4ad-4896-b455-970fe296b369-kube-api-access-hwgxx\") pod \"acf0c14b-e4ad-4896-b455-970fe296b369\" (UID: \"acf0c14b-e4ad-4896-b455-970fe296b369\") " Jul 18 01:13:55.912281 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:55.912191 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acf0c14b-e4ad-4896-b455-970fe296b369-extensions-socket-volume\") pod \"acf0c14b-e4ad-4896-b455-970fe296b369\" (UID: \"acf0c14b-e4ad-4896-b455-970fe296b369\") " Jul 18 01:13:55.912585 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:55.912553 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf0c14b-e4ad-4896-b455-970fe296b369-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "acf0c14b-e4ad-4896-b455-970fe296b369" (UID: "acf0c14b-e4ad-4896-b455-970fe296b369"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:13:55.914517 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:55.914492 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf0c14b-e4ad-4896-b455-970fe296b369-kube-api-access-hwgxx" (OuterVolumeSpecName: "kube-api-access-hwgxx") pod "acf0c14b-e4ad-4896-b455-970fe296b369" (UID: "acf0c14b-e4ad-4896-b455-970fe296b369"). InnerVolumeSpecName "kube-api-access-hwgxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:13:56.012938 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:56.012899 2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/acf0c14b-e4ad-4896-b455-970fe296b369-extensions-socket-volume\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:13:56.012938 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:56.012930 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwgxx\" (UniqueName: \"kubernetes.io/projected/acf0c14b-e4ad-4896-b455-970fe296b369-kube-api-access-hwgxx\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:13:56.777489 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:56.777458 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" Jul 18 01:13:56.777489 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:56.777475 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj" event={"ID":"acf0c14b-e4ad-4896-b455-970fe296b369","Type":"ContainerDied","Data":"f01ee0c2caf63968c2e6b770f0095cb375a9c851a33b09956c9020940981d3c5"} Jul 18 01:13:56.778040 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:56.777543 2585 scope.go:117] "RemoveContainer" containerID="701c415d5eab0eafef12e778ec53555793e79574786da1ff577dc2ac36abbc9c" Jul 18 01:13:56.799728 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:56.799702 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj"] Jul 18 01:13:56.803551 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:56.803518 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nckpj"] Jul 18 01:13:58.796138 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:13:58.796104 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acf0c14b-e4ad-4896-b455-970fe296b369" path="/var/lib/kubelet/pods/acf0c14b-e4ad-4896-b455-970fe296b369/volumes" Jul 18 01:14:38.796698 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:38.796600 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 01:14:38.800829 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:38.796816 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 01:14:38.804914 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:38.804893 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 01:14:38.805050 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:38.804976 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 01:14:55.533202 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.533163 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h"] Jul 18 01:14:55.533631 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.533572 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf0c14b-e4ad-4896-b455-970fe296b369" containerName="manager" Jul 18 01:14:55.533631 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.533582 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf0c14b-e4ad-4896-b455-970fe296b369" containerName="manager" Jul 18 01:14:55.533716 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.533662 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf0c14b-e4ad-4896-b455-970fe296b369" containerName="manager" Jul 18 01:14:55.537918 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.537901 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" Jul 18 01:14:55.540490 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.540468 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9hljh\"" Jul 18 01:14:55.550722 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.550697 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h"] Jul 18 01:14:55.663946 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.663910 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32537d9e-8156-4542-a5da-c65f8e30f674-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rfv8h\" (UID: \"32537d9e-8156-4542-a5da-c65f8e30f674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" Jul 18 01:14:55.664169 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.664015 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfdvg\" (UniqueName: \"kubernetes.io/projected/32537d9e-8156-4542-a5da-c65f8e30f674-kube-api-access-mfdvg\") pod \"kuadrant-operator-controller-manager-86878c769f-rfv8h\" (UID: \"32537d9e-8156-4542-a5da-c65f8e30f674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" Jul 18 01:14:55.764793 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.764754 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32537d9e-8156-4542-a5da-c65f8e30f674-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rfv8h\" (UID: \"32537d9e-8156-4542-a5da-c65f8e30f674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" Jul 18 01:14:55.764965 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.764843 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfdvg\" (UniqueName: \"kubernetes.io/projected/32537d9e-8156-4542-a5da-c65f8e30f674-kube-api-access-mfdvg\") pod \"kuadrant-operator-controller-manager-86878c769f-rfv8h\" (UID: \"32537d9e-8156-4542-a5da-c65f8e30f674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" Jul 18 01:14:55.765279 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.765254 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32537d9e-8156-4542-a5da-c65f8e30f674-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rfv8h\" (UID: \"32537d9e-8156-4542-a5da-c65f8e30f674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" Jul 18 01:14:55.777872 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.777846 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfdvg\" (UniqueName: \"kubernetes.io/projected/32537d9e-8156-4542-a5da-c65f8e30f674-kube-api-access-mfdvg\") pod \"kuadrant-operator-controller-manager-86878c769f-rfv8h\" (UID: \"32537d9e-8156-4542-a5da-c65f8e30f674\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" Jul 18 01:14:55.848219 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.848177 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" Jul 18 01:14:55.996412 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:55.996383 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h"] Jul 18 01:14:55.998366 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:14:55.998336 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32537d9e_8156_4542_a5da_c65f8e30f674.slice/crio-2cfb16bfdb6b54e1789dc7d59f97ee24885cf6842cdc7b6869a69c158df1118c WatchSource:0}: Error finding container 2cfb16bfdb6b54e1789dc7d59f97ee24885cf6842cdc7b6869a69c158df1118c: Status 404 returned error can't find the container with id 2cfb16bfdb6b54e1789dc7d59f97ee24885cf6842cdc7b6869a69c158df1118c Jul 18 01:14:56.089648 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:56.089613 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" event={"ID":"32537d9e-8156-4542-a5da-c65f8e30f674","Type":"ContainerStarted","Data":"0de5de90bc69d956dd742727994efc5559a53fb8db7428d783d01ae1d27061be"} Jul 18 01:14:56.089835 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:56.089671 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" event={"ID":"32537d9e-8156-4542-a5da-c65f8e30f674","Type":"ContainerStarted","Data":"2cfb16bfdb6b54e1789dc7d59f97ee24885cf6842cdc7b6869a69c158df1118c"} Jul 18 01:14:56.089835 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:56.089791 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" Jul 18 01:14:56.112902 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:14:56.112765 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" podStartSLOduration=1.112745522 podStartE2EDuration="1.112745522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:14:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:14:56.111545477 +0000 UTC m=+1217.850417693" watchObservedRunningTime="2026-07-18 01:14:56.112745522 +0000 UTC m=+1217.851617738" Jul 18 01:15:00.139305 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:00.139271 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn"] Jul 18 01:15:00.143049 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:00.143031 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn" Jul 18 01:15:00.145489 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:00.145467 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jfcsk\"" Jul 18 01:15:00.151311 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:00.151285 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn"] Jul 18 01:15:00.155375 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:00.155354 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn" Jul 18 01:15:00.301042 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:00.300978 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn"] Jul 18 01:15:00.304043 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:15:00.304016 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0da4aac_c754_4066_a818_d52901945bbf.slice/crio-b0f5ae24a78e9c2c8fd63a6fde45d6a400bc1b8ea3e32f209d2381337806271a WatchSource:0}: Error finding container b0f5ae24a78e9c2c8fd63a6fde45d6a400bc1b8ea3e32f209d2381337806271a: Status 404 returned error can't find the container with id b0f5ae24a78e9c2c8fd63a6fde45d6a400bc1b8ea3e32f209d2381337806271a Jul 18 01:15:00.305921 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:00.305905 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 01:15:01.115633 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:01.115595 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn" event={"ID":"b0da4aac-c754-4066-a818-d52901945bbf","Type":"ContainerStarted","Data":"b0f5ae24a78e9c2c8fd63a6fde45d6a400bc1b8ea3e32f209d2381337806271a"} Jul 18 01:15:03.127625 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:03.127580 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn" event={"ID":"b0da4aac-c754-4066-a818-d52901945bbf","Type":"ContainerStarted","Data":"2c8ddab4ca218c732c1d63f90165a77d21a5c92091947c5c8461317e0f8a48c4"} Jul 18 01:15:03.143637 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:03.143572 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn" podStartSLOduration=0.612437441 podStartE2EDuration="3.143554984s" totalImagesPullingTime="2.531117543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:15:03.141158547 +0000 UTC m=+1224.880030766" watchObservedRunningTime="2026-07-18 01:15:03.143554984 +0000 UTC m=+1224.882427200" Jul 18 01:15:04.134962 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:04.134926 2585 generic.go:356] "Generic (PLEG): container finished" podID="b0da4aac-c754-4066-a818-d52901945bbf" containerID="2c8ddab4ca218c732c1d63f90165a77d21a5c92091947c5c8461317e0f8a48c4" exitCode=0 Jul 18 01:15:04.135365 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:04.134970 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn" event={"ID":"b0da4aac-c754-4066-a818-d52901945bbf","Type":"ContainerDied","Data":"2c8ddab4ca218c732c1d63f90165a77d21a5c92091947c5c8461317e0f8a48c4"} Jul 18 01:15:05.285821 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:05.285790 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn" Jul 18 01:15:06.146450 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:06.146418 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn" Jul 18 01:15:06.146632 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:06.146452 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738955-vvvxn" event={"ID":"b0da4aac-c754-4066-a818-d52901945bbf","Type":"ContainerDied","Data":"b0f5ae24a78e9c2c8fd63a6fde45d6a400bc1b8ea3e32f209d2381337806271a"} Jul 18 01:15:06.146632 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:06.146501 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0f5ae24a78e9c2c8fd63a6fde45d6a400bc1b8ea3e32f209d2381337806271a" Jul 18 01:15:07.097240 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:15:07.097212 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfv8h" Jul 18 01:19:38.840757 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:19:38.840648 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 01:19:38.844767 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:19:38.841411 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 01:19:38.848796 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:19:38.848776 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 01:19:38.849488 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:19:38.849470 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 01:21:14.096295 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.096259 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52"] Jul 18 01:21:14.096905 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.096888 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0da4aac-c754-4066-a818-d52901945bbf" containerName="cleanup" Jul 18 01:21:14.096962 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.096909 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0da4aac-c754-4066-a818-d52901945bbf" containerName="cleanup" Jul 18 01:21:14.097046 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.097034 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0da4aac-c754-4066-a818-d52901945bbf" containerName="cleanup" Jul 18 01:21:14.100758 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.100740 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:14.103522 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.103495 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lpsl4\"" Jul 18 01:21:14.103655 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.103616 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d0a195eb-serving-cert\"" Jul 18 01:21:14.111202 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.111176 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52"] Jul 18 01:21:14.214709 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.214672 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c36fb9f-ce8a-4c50-8a14-91499865eafc-maas-api-tls\") pod \"maas-api-e2e-ait-d0a195eb-866466c695-sxk52\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:14.214879 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.214714 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c36fb9f-ce8a-4c50-8a14-91499865eafc-openshift-service-ca\") pod \"maas-api-e2e-ait-d0a195eb-866466c695-sxk52\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:14.214879 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.214750 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9sdt\" (UniqueName: \"kubernetes.io/projected/0c36fb9f-ce8a-4c50-8a14-91499865eafc-kube-api-access-x9sdt\") pod \"maas-api-e2e-ait-d0a195eb-866466c695-sxk52\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:14.315520 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.315485 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c36fb9f-ce8a-4c50-8a14-91499865eafc-maas-api-tls\") pod \"maas-api-e2e-ait-d0a195eb-866466c695-sxk52\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:14.315520 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.315524 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c36fb9f-ce8a-4c50-8a14-91499865eafc-openshift-service-ca\") pod \"maas-api-e2e-ait-d0a195eb-866466c695-sxk52\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:14.315802 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.315549 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9sdt\" (UniqueName: \"kubernetes.io/projected/0c36fb9f-ce8a-4c50-8a14-91499865eafc-kube-api-access-x9sdt\") pod \"maas-api-e2e-ait-d0a195eb-866466c695-sxk52\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:14.315802 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:21:14.315651 2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-serving-cert: secret "maas-api-e2e-ait-d0a195eb-serving-cert" not found Jul 18 01:21:14.315802 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:21:14.315721 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c36fb9f-ce8a-4c50-8a14-91499865eafc-maas-api-tls podName:0c36fb9f-ce8a-4c50-8a14-91499865eafc nodeName:}" failed. No retries permitted until 2026-07-18 01:21:14.815701402 +0000 UTC m=+1596.554573596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0c36fb9f-ce8a-4c50-8a14-91499865eafc-maas-api-tls") pod "maas-api-e2e-ait-d0a195eb-866466c695-sxk52" (UID: "0c36fb9f-ce8a-4c50-8a14-91499865eafc") : secret "maas-api-e2e-ait-d0a195eb-serving-cert" not found Jul 18 01:21:14.316259 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.316242 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c36fb9f-ce8a-4c50-8a14-91499865eafc-openshift-service-ca\") pod \"maas-api-e2e-ait-d0a195eb-866466c695-sxk52\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:14.325254 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.325231 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9sdt\" (UniqueName: \"kubernetes.io/projected/0c36fb9f-ce8a-4c50-8a14-91499865eafc-kube-api-access-x9sdt\") pod \"maas-api-e2e-ait-d0a195eb-866466c695-sxk52\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:14.821414 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.821374 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c36fb9f-ce8a-4c50-8a14-91499865eafc-maas-api-tls\") pod \"maas-api-e2e-ait-d0a195eb-866466c695-sxk52\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:14.823895 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:14.823871 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c36fb9f-ce8a-4c50-8a14-91499865eafc-maas-api-tls\") pod \"maas-api-e2e-ait-d0a195eb-866466c695-sxk52\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:15.013785 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:15.013743 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:15.159731 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:15.159703 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52"] Jul 18 01:21:15.161785 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:21:15.161758 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c36fb9f_ce8a_4c50_8a14_91499865eafc.slice/crio-1d6669779b08f4e5e9f7c3f30aad591910a937ce2dfb39f60940a3835773bb69 WatchSource:0}: Error finding container 1d6669779b08f4e5e9f7c3f30aad591910a937ce2dfb39f60940a3835773bb69: Status 404 returned error can't find the container with id 1d6669779b08f4e5e9f7c3f30aad591910a937ce2dfb39f60940a3835773bb69 Jul 18 01:21:15.163200 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:15.163180 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 01:21:16.121557 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:16.121521 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" event={"ID":"0c36fb9f-ce8a-4c50-8a14-91499865eafc","Type":"ContainerStarted","Data":"a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9"} Jul 18 01:21:16.121753 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:16.121576 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" event={"ID":"0c36fb9f-ce8a-4c50-8a14-91499865eafc","Type":"ContainerStarted","Data":"1d6669779b08f4e5e9f7c3f30aad591910a937ce2dfb39f60940a3835773bb69"} Jul 18 01:21:16.121753 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:16.121607 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:16.139223 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:16.139171 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" podStartSLOduration=1.635111555 podStartE2EDuration="2.13915312s" totalImagesPullingTime="504.041565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:21:16.138839213 +0000 UTC m=+1597.877711430" watchObservedRunningTime="2026-07-18 01:21:16.13915312 +0000 UTC m=+1597.878025339" Jul 18 01:21:22.132424 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:22.132392 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:39.502252 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:39.502157 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps"] Jul 18 01:21:39.505691 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:39.505670 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps" Jul 18 01:21:39.508042 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:39.508021 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jfcsk\"" Jul 18 01:21:39.513442 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:39.513108 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps"] Jul 18 01:21:39.648669 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:39.648635 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d33ee167-a203-4c0d-933b-7ae438306bb4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0a195eb-88pps\" (UID: \"d33ee167-a203-4c0d-933b-7ae438306bb4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps" Jul 18 01:21:39.750199 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:39.750160 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d33ee167-a203-4c0d-933b-7ae438306bb4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0a195eb-88pps\" (UID: \"d33ee167-a203-4c0d-933b-7ae438306bb4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps" Jul 18 01:21:39.750766 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:39.750747 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d33ee167-a203-4c0d-933b-7ae438306bb4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d0a195eb-88pps\" (UID: \"d33ee167-a203-4c0d-933b-7ae438306bb4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps" Jul 18 01:21:39.817557 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:39.817467 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps" Jul 18 01:21:39.959706 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:39.959577 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps"] Jul 18 01:21:39.962124 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:21:39.962084 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33ee167_a203_4c0d_933b_7ae438306bb4.slice/crio-19502eacbf4f81d2d0f1b5d66f948d3c34a1dac42dbe6e6e678d442ffd5c4d33 WatchSource:0}: Error finding container 19502eacbf4f81d2d0f1b5d66f948d3c34a1dac42dbe6e6e678d442ffd5c4d33: Status 404 returned error can't find the container with id 19502eacbf4f81d2d0f1b5d66f948d3c34a1dac42dbe6e6e678d442ffd5c4d33 Jul 18 01:21:40.255401 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:40.255377 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps" event={"ID":"d33ee167-a203-4c0d-933b-7ae438306bb4","Type":"ContainerStarted","Data":"19502eacbf4f81d2d0f1b5d66f948d3c34a1dac42dbe6e6e678d442ffd5c4d33"} Jul 18 01:21:41.261952 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:41.261913 2585 generic.go:356] "Generic (PLEG): container finished" podID="d33ee167-a203-4c0d-933b-7ae438306bb4" containerID="e0aeaf479e50baab8ee50f2691f02e4457010afa759d7428303bac6f8d24db5b" exitCode=0 Jul 18 01:21:41.262416 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:41.262016 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps" event={"ID":"d33ee167-a203-4c0d-933b-7ae438306bb4","Type":"ContainerDied","Data":"e0aeaf479e50baab8ee50f2691f02e4457010afa759d7428303bac6f8d24db5b"} Jul 18 01:21:42.411393 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:42.411369 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps" Jul 18 01:21:42.574957 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:42.574873 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d33ee167-a203-4c0d-933b-7ae438306bb4-maas-api-service-ca\") pod \"d33ee167-a203-4c0d-933b-7ae438306bb4\" (UID: \"d33ee167-a203-4c0d-933b-7ae438306bb4\") " Jul 18 01:21:42.575263 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:42.575240 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d33ee167-a203-4c0d-933b-7ae438306bb4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d33ee167-a203-4c0d-933b-7ae438306bb4" (UID: "d33ee167-a203-4c0d-933b-7ae438306bb4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:21:42.675509 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:42.675477 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d33ee167-a203-4c0d-933b-7ae438306bb4-maas-api-service-ca\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:21:43.273513 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:43.273483 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps" Jul 18 01:21:43.273664 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:43.273522 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps" event={"ID":"d33ee167-a203-4c0d-933b-7ae438306bb4","Type":"ContainerDied","Data":"19502eacbf4f81d2d0f1b5d66f948d3c34a1dac42dbe6e6e678d442ffd5c4d33"} Jul 18 01:21:43.273664 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:43.273569 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19502eacbf4f81d2d0f1b5d66f948d3c34a1dac42dbe6e6e678d442ffd5c4d33" Jul 18 01:21:50.002244 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.002207 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52"] Jul 18 01:21:50.002757 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.002451 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" podUID="0c36fb9f-ce8a-4c50-8a14-91499865eafc" containerName="maas-api" containerID="cri-o://a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9" gracePeriod=30 Jul 18 01:21:50.259359 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.259297 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:50.311276 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.311239 2585 generic.go:356] "Generic (PLEG): container finished" podID="0c36fb9f-ce8a-4c50-8a14-91499865eafc" containerID="a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9" exitCode=0 Jul 18 01:21:50.311433 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.311281 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" event={"ID":"0c36fb9f-ce8a-4c50-8a14-91499865eafc","Type":"ContainerDied","Data":"a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9"} Jul 18 01:21:50.311433 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.311289 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" Jul 18 01:21:50.311433 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.311325 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52" event={"ID":"0c36fb9f-ce8a-4c50-8a14-91499865eafc","Type":"ContainerDied","Data":"1d6669779b08f4e5e9f7c3f30aad591910a937ce2dfb39f60940a3835773bb69"} Jul 18 01:21:50.311433 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.311353 2585 scope.go:117] "RemoveContainer" containerID="a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9" Jul 18 01:21:50.320123 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.320102 2585 scope.go:117] "RemoveContainer" containerID="a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9" Jul 18 01:21:50.320379 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:21:50.320359 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9\": container with ID starting with a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9 not found: ID does not exist" containerID="a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9" Jul 18 01:21:50.320425 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.320394 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9"} err="failed to get container status \"a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9\": rpc error: code = NotFound desc = could not find container \"a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9\": container with ID starting with a4d875c42b86fa6395fffcd368b4e26b28dea4a0b206db71cd93d5c1814f5ee9 not found: ID does not exist" Jul 18 01:21:50.445973 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.445938 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c36fb9f-ce8a-4c50-8a14-91499865eafc-maas-api-tls\") pod \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " Jul 18 01:21:50.446170 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.446055 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c36fb9f-ce8a-4c50-8a14-91499865eafc-openshift-service-ca\") pod \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " Jul 18 01:21:50.446170 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.446086 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9sdt\" (UniqueName: \"kubernetes.io/projected/0c36fb9f-ce8a-4c50-8a14-91499865eafc-kube-api-access-x9sdt\") pod \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\" (UID: \"0c36fb9f-ce8a-4c50-8a14-91499865eafc\") " Jul 18 01:21:50.446470 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.446436 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c36fb9f-ce8a-4c50-8a14-91499865eafc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c36fb9f-ce8a-4c50-8a14-91499865eafc" (UID: "0c36fb9f-ce8a-4c50-8a14-91499865eafc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:21:50.448378 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.448353 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c36fb9f-ce8a-4c50-8a14-91499865eafc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c36fb9f-ce8a-4c50-8a14-91499865eafc" (UID: "0c36fb9f-ce8a-4c50-8a14-91499865eafc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:21:50.448482 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.448428 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c36fb9f-ce8a-4c50-8a14-91499865eafc-kube-api-access-x9sdt" (OuterVolumeSpecName: "kube-api-access-x9sdt") pod "0c36fb9f-ce8a-4c50-8a14-91499865eafc" (UID: "0c36fb9f-ce8a-4c50-8a14-91499865eafc"). InnerVolumeSpecName "kube-api-access-x9sdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:21:50.547285 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.547190 2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c36fb9f-ce8a-4c50-8a14-91499865eafc-openshift-service-ca\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:21:50.547285 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.547231 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9sdt\" (UniqueName: \"kubernetes.io/projected/0c36fb9f-ce8a-4c50-8a14-91499865eafc-kube-api-access-x9sdt\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:21:50.547285 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.547242 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c36fb9f-ce8a-4c50-8a14-91499865eafc-maas-api-tls\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:21:50.633919 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.633882 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52"] Jul 18 01:21:50.637655 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.637629 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0a195eb-866466c695-sxk52"] Jul 18 01:21:50.797121 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:50.797088 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c36fb9f-ce8a-4c50-8a14-91499865eafc" path="/var/lib/kubelet/pods/0c36fb9f-ce8a-4c50-8a14-91499865eafc/volumes" Jul 18 01:21:54.588699 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:54.588659 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps"] Jul 18 01:21:54.591127 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:54.591104 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d0a195eb-88pps"] Jul 18 01:21:54.796761 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:54.796725 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d33ee167-a203-4c0d-933b-7ae438306bb4" path="/var/lib/kubelet/pods/d33ee167-a203-4c0d-933b-7ae438306bb4/volumes" Jul 18 01:21:58.617105 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.617066 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7"] Jul 18 01:21:58.617711 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.617694 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d33ee167-a203-4c0d-933b-7ae438306bb4" containerName="revoke-keys" Jul 18 01:21:58.617761 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.617714 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d33ee167-a203-4c0d-933b-7ae438306bb4" containerName="revoke-keys" Jul 18 01:21:58.617761 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.617738 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c36fb9f-ce8a-4c50-8a14-91499865eafc" containerName="maas-api" Jul 18 01:21:58.617761 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.617747 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c36fb9f-ce8a-4c50-8a14-91499865eafc" containerName="maas-api" Jul 18 01:21:58.617862 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.617833 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d33ee167-a203-4c0d-933b-7ae438306bb4" containerName="revoke-keys" Jul 18 01:21:58.617862 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.617845 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c36fb9f-ce8a-4c50-8a14-91499865eafc" containerName="maas-api" Jul 18 01:21:58.624408 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.624382 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:21:58.627826 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.627799 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-2d70ef2b-serving-cert\"" Jul 18 01:21:58.628295 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.628273 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lpsl4\"" Jul 18 01:21:58.629884 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.629861 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7"] Jul 18 01:21:58.713130 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.713095 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84qw8\" (UniqueName: \"kubernetes.io/projected/f4744796-f15c-4888-bd1c-b7a97da0b896-kube-api-access-84qw8\") pod \"maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:21:58.713346 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.713142 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls\") pod \"maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:21:58.713346 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.713233 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4744796-f15c-4888-bd1c-b7a97da0b896-openshift-service-ca\") pod \"maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:21:58.814120 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.814079 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84qw8\" (UniqueName: \"kubernetes.io/projected/f4744796-f15c-4888-bd1c-b7a97da0b896-kube-api-access-84qw8\") pod \"maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:21:58.814120 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.814133 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls\") pod \"maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:21:58.814386 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.814198 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4744796-f15c-4888-bd1c-b7a97da0b896-openshift-service-ca\") pod \"maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:21:58.814386 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:21:58.814239 2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-serving-cert: secret "maas-api-e2e-migrate-2d70ef2b-serving-cert" not found Jul 18 01:21:58.814386 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:21:58.814312 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls podName:f4744796-f15c-4888-bd1c-b7a97da0b896 nodeName:}" failed. No retries permitted until 2026-07-18 01:21:59.314291666 +0000 UTC m=+1641.053163874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls") pod "maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" (UID: "f4744796-f15c-4888-bd1c-b7a97da0b896") : secret "maas-api-e2e-migrate-2d70ef2b-serving-cert" not found Jul 18 01:21:58.814936 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.814916 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4744796-f15c-4888-bd1c-b7a97da0b896-openshift-service-ca\") pod \"maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:21:58.833969 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:58.833941 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84qw8\" (UniqueName: \"kubernetes.io/projected/f4744796-f15c-4888-bd1c-b7a97da0b896-kube-api-access-84qw8\") pod \"maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:21:59.319893 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:21:59.319850 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls\") pod \"maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:21:59.320150 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:21:59.320037 2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-serving-cert: secret "maas-api-e2e-migrate-2d70ef2b-serving-cert" not found Jul 18 01:21:59.320150 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:21:59.320114 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls podName:f4744796-f15c-4888-bd1c-b7a97da0b896 nodeName:}" failed. No retries permitted until 2026-07-18 01:22:00.320093598 +0000 UTC m=+1642.058965805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls") pod "maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" (UID: "f4744796-f15c-4888-bd1c-b7a97da0b896") : secret "maas-api-e2e-migrate-2d70ef2b-serving-cert" not found Jul 18 01:22:00.329418 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:00.329383 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls\") pod \"maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:22:00.331954 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:00.331929 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls\") pod \"maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:22:00.438556 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:00.438524 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:22:00.590081 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:00.590051 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7"] Jul 18 01:22:00.592809 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:22:00.592778 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4744796_f15c_4888_bd1c_b7a97da0b896.slice/crio-96f16fa771f20ef5ad92fc787233b293e0275f7890cb612f6ec871e27eef281a WatchSource:0}: Error finding container 96f16fa771f20ef5ad92fc787233b293e0275f7890cb612f6ec871e27eef281a: Status 404 returned error can't find the container with id 96f16fa771f20ef5ad92fc787233b293e0275f7890cb612f6ec871e27eef281a Jul 18 01:22:01.374847 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:01.374810 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" event={"ID":"f4744796-f15c-4888-bd1c-b7a97da0b896","Type":"ContainerStarted","Data":"7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88"} Jul 18 01:22:01.375236 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:01.374862 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" event={"ID":"f4744796-f15c-4888-bd1c-b7a97da0b896","Type":"ContainerStarted","Data":"96f16fa771f20ef5ad92fc787233b293e0275f7890cb612f6ec871e27eef281a"} Jul 18 01:22:01.375236 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:01.374916 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:22:01.394790 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:01.394735 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" podStartSLOduration=3.052378676 podStartE2EDuration="3.394718838s" totalImagesPullingTime="342.340162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:22:01.394270832 +0000 UTC m=+1643.133143049" watchObservedRunningTime="2026-07-18 01:22:01.394718838 +0000 UTC m=+1643.133591054" Jul 18 01:22:07.386272 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:07.386247 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:22:23.384897 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:23.384863 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc"] Jul 18 01:22:23.388493 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:23.388474 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" Jul 18 01:22:23.390941 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:23.390919 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jfcsk\"" Jul 18 01:22:23.395387 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:23.395363 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc"] Jul 18 01:22:23.451500 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:23.451462 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33d9597d-0585-445c-93be-940445068d70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc\" (UID: \"33d9597d-0585-445c-93be-940445068d70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" Jul 18 01:22:23.552945 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:23.552909 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33d9597d-0585-445c-93be-940445068d70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc\" (UID: \"33d9597d-0585-445c-93be-940445068d70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" Jul 18 01:22:23.553572 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:23.553549 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33d9597d-0585-445c-93be-940445068d70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc\" (UID: \"33d9597d-0585-445c-93be-940445068d70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" Jul 18 01:22:23.702123 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:23.702026 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" Jul 18 01:22:23.848446 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:23.848416 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc"] Jul 18 01:22:23.849891 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:22:23.849865 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d9597d_0585_445c_93be_940445068d70.slice/crio-1c4e767d4d646883038928cb6ebe2954c60761b6c89d30c93c7dae2d02faded6 WatchSource:0}: Error finding container 1c4e767d4d646883038928cb6ebe2954c60761b6c89d30c93c7dae2d02faded6: Status 404 returned error can't find the container with id 1c4e767d4d646883038928cb6ebe2954c60761b6c89d30c93c7dae2d02faded6 Jul 18 01:22:24.498166 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:24.498129 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" event={"ID":"33d9597d-0585-445c-93be-940445068d70","Type":"ContainerStarted","Data":"775a11c5a70bce5b9691395a915b7d8305cef8dc0bf2aff4b425f5228d50f0bb"} Jul 18 01:22:24.498667 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:24.498178 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" event={"ID":"33d9597d-0585-445c-93be-940445068d70","Type":"ContainerStarted","Data":"1c4e767d4d646883038928cb6ebe2954c60761b6c89d30c93c7dae2d02faded6"} Jul 18 01:22:24.515789 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:24.515735 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" podStartSLOduration=1.5157182900000001 podStartE2EDuration="1.51571829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:22:24.513687314 +0000 UTC m=+1666.252559531" watchObservedRunningTime="2026-07-18 01:22:24.51571829 +0000 UTC m=+1666.254590505" Jul 18 01:22:25.505361 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:25.505318 2585 generic.go:356] "Generic (PLEG): container finished" podID="33d9597d-0585-445c-93be-940445068d70" containerID="775a11c5a70bce5b9691395a915b7d8305cef8dc0bf2aff4b425f5228d50f0bb" exitCode=0 Jul 18 01:22:25.505777 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:25.505403 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" event={"ID":"33d9597d-0585-445c-93be-940445068d70","Type":"ContainerDied","Data":"775a11c5a70bce5b9691395a915b7d8305cef8dc0bf2aff4b425f5228d50f0bb"} Jul 18 01:22:26.652898 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:26.652871 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" Jul 18 01:22:26.783152 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:26.783024 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33d9597d-0585-445c-93be-940445068d70-maas-api-service-ca\") pod \"33d9597d-0585-445c-93be-940445068d70\" (UID: \"33d9597d-0585-445c-93be-940445068d70\") " Jul 18 01:22:26.783343 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:26.783319 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33d9597d-0585-445c-93be-940445068d70-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "33d9597d-0585-445c-93be-940445068d70" (UID: "33d9597d-0585-445c-93be-940445068d70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:22:26.884834 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:26.884795 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33d9597d-0585-445c-93be-940445068d70-maas-api-service-ca\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:22:27.517749 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:27.517708 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" event={"ID":"33d9597d-0585-445c-93be-940445068d70","Type":"ContainerDied","Data":"1c4e767d4d646883038928cb6ebe2954c60761b6c89d30c93c7dae2d02faded6"} Jul 18 01:22:27.517749 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:27.517739 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc" Jul 18 01:22:27.517971 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:27.517772 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c4e767d4d646883038928cb6ebe2954c60761b6c89d30c93c7dae2d02faded6" Jul 18 01:22:33.855959 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:33.855926 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7"] Jul 18 01:22:33.856431 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:33.856208 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" podUID="f4744796-f15c-4888-bd1c-b7a97da0b896" containerName="maas-api" containerID="cri-o://7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88" gracePeriod=30 Jul 18 01:22:34.121475 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.121415 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:22:34.257116 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.257081 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls\") pod \"f4744796-f15c-4888-bd1c-b7a97da0b896\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " Jul 18 01:22:34.257323 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.257189 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4744796-f15c-4888-bd1c-b7a97da0b896-openshift-service-ca\") pod \"f4744796-f15c-4888-bd1c-b7a97da0b896\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " Jul 18 01:22:34.257323 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.257258 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84qw8\" (UniqueName: \"kubernetes.io/projected/f4744796-f15c-4888-bd1c-b7a97da0b896-kube-api-access-84qw8\") pod \"f4744796-f15c-4888-bd1c-b7a97da0b896\" (UID: \"f4744796-f15c-4888-bd1c-b7a97da0b896\") " Jul 18 01:22:34.257611 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.257587 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4744796-f15c-4888-bd1c-b7a97da0b896-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4744796-f15c-4888-bd1c-b7a97da0b896" (UID: "f4744796-f15c-4888-bd1c-b7a97da0b896"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:22:34.259513 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.259482 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4744796-f15c-4888-bd1c-b7a97da0b896" (UID: "f4744796-f15c-4888-bd1c-b7a97da0b896"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:22:34.259611 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.259486 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4744796-f15c-4888-bd1c-b7a97da0b896-kube-api-access-84qw8" (OuterVolumeSpecName: "kube-api-access-84qw8") pod "f4744796-f15c-4888-bd1c-b7a97da0b896" (UID: "f4744796-f15c-4888-bd1c-b7a97da0b896"). InnerVolumeSpecName "kube-api-access-84qw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:22:34.358754 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.358711 2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4744796-f15c-4888-bd1c-b7a97da0b896-openshift-service-ca\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:22:34.358754 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.358747 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84qw8\" (UniqueName: \"kubernetes.io/projected/f4744796-f15c-4888-bd1c-b7a97da0b896-kube-api-access-84qw8\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:22:34.358754 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.358760 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4744796-f15c-4888-bd1c-b7a97da0b896-maas-api-tls\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:22:34.554520 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.554420 2585 generic.go:356] "Generic (PLEG): container finished" podID="f4744796-f15c-4888-bd1c-b7a97da0b896" containerID="7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88" exitCode=0 Jul 18 01:22:34.554520 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.554468 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" Jul 18 01:22:34.554736 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.554519 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" event={"ID":"f4744796-f15c-4888-bd1c-b7a97da0b896","Type":"ContainerDied","Data":"7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88"} Jul 18 01:22:34.554736 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.554574 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7" event={"ID":"f4744796-f15c-4888-bd1c-b7a97da0b896","Type":"ContainerDied","Data":"96f16fa771f20ef5ad92fc787233b293e0275f7890cb612f6ec871e27eef281a"} Jul 18 01:22:34.554736 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.554601 2585 scope.go:117] "RemoveContainer" containerID="7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88" Jul 18 01:22:34.564659 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.564638 2585 scope.go:117] "RemoveContainer" containerID="7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88" Jul 18 01:22:34.564931 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:22:34.564913 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88\": container with ID starting with 7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88 not found: ID does not exist" containerID="7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88" Jul 18 01:22:34.565037 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.564940 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88"} err="failed to get container status \"7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88\": rpc error: code = NotFound desc = could not find container \"7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88\": container with ID starting with 7efc7b6f000236cd1b08531f0258ac185cbd2ee64f0fdb1f2fa99fb60e5bac88 not found: ID does not exist" Jul 18 01:22:34.575647 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.575623 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7"] Jul 18 01:22:34.579887 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.579867 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d70ef2b-56f99985b5-hflv7"] Jul 18 01:22:34.797288 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:34.797255 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4744796-f15c-4888-bd1c-b7a97da0b896" path="/var/lib/kubelet/pods/f4744796-f15c-4888-bd1c-b7a97da0b896/volumes" Jul 18 01:22:38.471476 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:38.471435 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc"] Jul 18 01:22:38.479843 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:38.479808 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2d70ef2b-rlfbc"] Jul 18 01:22:38.797084 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:38.797004 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33d9597d-0585-445c-93be-940445068d70" path="/var/lib/kubelet/pods/33d9597d-0585-445c-93be-940445068d70/volumes" Jul 18 01:22:41.614197 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.614164 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd"] Jul 18 01:22:41.614594 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.614580 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4744796-f15c-4888-bd1c-b7a97da0b896" containerName="maas-api" Jul 18 01:22:41.614652 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.614597 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4744796-f15c-4888-bd1c-b7a97da0b896" containerName="maas-api" Jul 18 01:22:41.614652 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.614613 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33d9597d-0585-445c-93be-940445068d70" containerName="revoke-keys" Jul 18 01:22:41.614652 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.614618 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="33d9597d-0585-445c-93be-940445068d70" containerName="revoke-keys" Jul 18 01:22:41.614744 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.614691 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4744796-f15c-4888-bd1c-b7a97da0b896" containerName="maas-api" Jul 18 01:22:41.614744 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.614702 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="33d9597d-0585-445c-93be-940445068d70" containerName="revoke-keys" Jul 18 01:22:41.619114 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.619087 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:41.621652 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.621631 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e06bd601-serving-cert\"" Jul 18 01:22:41.621768 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.621727 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lpsl4\"" Jul 18 01:22:41.635023 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.634965 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd"] Jul 18 01:22:41.724931 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.724888 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99aa1ec4-e551-4656-80e7-fd25ed957dc4-openshift-service-ca\") pod \"maas-api-e2e-ait-e06bd601-86b5848968-6ggrd\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:41.725159 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.725011 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwdcj\" (UniqueName: \"kubernetes.io/projected/99aa1ec4-e551-4656-80e7-fd25ed957dc4-kube-api-access-kwdcj\") pod \"maas-api-e2e-ait-e06bd601-86b5848968-6ggrd\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:41.725159 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.725048 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99aa1ec4-e551-4656-80e7-fd25ed957dc4-maas-api-tls\") pod \"maas-api-e2e-ait-e06bd601-86b5848968-6ggrd\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:41.826148 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.826104 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwdcj\" (UniqueName: \"kubernetes.io/projected/99aa1ec4-e551-4656-80e7-fd25ed957dc4-kube-api-access-kwdcj\") pod \"maas-api-e2e-ait-e06bd601-86b5848968-6ggrd\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:41.826339 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.826164 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99aa1ec4-e551-4656-80e7-fd25ed957dc4-maas-api-tls\") pod \"maas-api-e2e-ait-e06bd601-86b5848968-6ggrd\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:41.826339 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.826203 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99aa1ec4-e551-4656-80e7-fd25ed957dc4-openshift-service-ca\") pod \"maas-api-e2e-ait-e06bd601-86b5848968-6ggrd\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:41.826339 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:22:41.826322 2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-serving-cert: secret "maas-api-e2e-ait-e06bd601-serving-cert" not found Jul 18 01:22:41.826464 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:22:41.826420 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99aa1ec4-e551-4656-80e7-fd25ed957dc4-maas-api-tls podName:99aa1ec4-e551-4656-80e7-fd25ed957dc4 nodeName:}" failed. No retries permitted until 2026-07-18 01:22:42.326395084 +0000 UTC m=+1684.065267283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/99aa1ec4-e551-4656-80e7-fd25ed957dc4-maas-api-tls") pod "maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" (UID: "99aa1ec4-e551-4656-80e7-fd25ed957dc4") : secret "maas-api-e2e-ait-e06bd601-serving-cert" not found Jul 18 01:22:41.826964 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.826941 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99aa1ec4-e551-4656-80e7-fd25ed957dc4-openshift-service-ca\") pod \"maas-api-e2e-ait-e06bd601-86b5848968-6ggrd\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:41.836398 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:41.836368 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwdcj\" (UniqueName: \"kubernetes.io/projected/99aa1ec4-e551-4656-80e7-fd25ed957dc4-kube-api-access-kwdcj\") pod \"maas-api-e2e-ait-e06bd601-86b5848968-6ggrd\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:42.329949 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:42.329911 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99aa1ec4-e551-4656-80e7-fd25ed957dc4-maas-api-tls\") pod \"maas-api-e2e-ait-e06bd601-86b5848968-6ggrd\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:42.332485 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:42.332457 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99aa1ec4-e551-4656-80e7-fd25ed957dc4-maas-api-tls\") pod \"maas-api-e2e-ait-e06bd601-86b5848968-6ggrd\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:42.529441 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:42.529402 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:42.688485 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:42.688454 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd"] Jul 18 01:22:42.691271 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:22:42.691237 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99aa1ec4_e551_4656_80e7_fd25ed957dc4.slice/crio-91d57d918fd31c98ec1c01d024c9ac2ed41a5657cb43bd7302bdbaf233694a28 WatchSource:0}: Error finding container 91d57d918fd31c98ec1c01d024c9ac2ed41a5657cb43bd7302bdbaf233694a28: Status 404 returned error can't find the container with id 91d57d918fd31c98ec1c01d024c9ac2ed41a5657cb43bd7302bdbaf233694a28 Jul 18 01:22:43.610763 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:43.610733 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" event={"ID":"99aa1ec4-e551-4656-80e7-fd25ed957dc4","Type":"ContainerStarted","Data":"7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884"} Jul 18 01:22:43.610946 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:43.610783 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" event={"ID":"99aa1ec4-e551-4656-80e7-fd25ed957dc4","Type":"ContainerStarted","Data":"91d57d918fd31c98ec1c01d024c9ac2ed41a5657cb43bd7302bdbaf233694a28"} Jul 18 01:22:43.610946 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:43.610857 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:22:43.632245 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:43.632196 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" podStartSLOduration=2.227365153 podStartE2EDuration="2.632178806s" totalImagesPullingTime="404.813653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:22:43.629823561 +0000 UTC m=+1685.368695778" watchObservedRunningTime="2026-07-18 01:22:43.632178806 +0000 UTC m=+1685.371051022" Jul 18 01:22:49.622978 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:22:49.622945 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:23:07.330634 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:07.330549 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8"] Jul 18 01:23:07.334539 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:07.334522 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8" Jul 18 01:23:07.337236 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:07.337209 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jfcsk\"" Jul 18 01:23:07.340732 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:07.340707 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8"] Jul 18 01:23:07.445815 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:07.445780 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b41c9e9-5445-412a-8f68-dc395118e1aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8\" (UID: \"7b41c9e9-5445-412a-8f68-dc395118e1aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8" Jul 18 01:23:07.546636 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:07.546603 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b41c9e9-5445-412a-8f68-dc395118e1aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8\" (UID: \"7b41c9e9-5445-412a-8f68-dc395118e1aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8" Jul 18 01:23:07.547266 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:07.547246 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b41c9e9-5445-412a-8f68-dc395118e1aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8\" (UID: \"7b41c9e9-5445-412a-8f68-dc395118e1aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8" Jul 18 01:23:07.647758 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:07.647722 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8" Jul 18 01:23:07.793653 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:07.793617 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8"] Jul 18 01:23:07.796800 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:23:07.796771 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b41c9e9_5445_412a_8f68_dc395118e1aa.slice/crio-763765b82568d417f375cec84237ea32b7af89ae58ab7760cebf76f94860cf38 WatchSource:0}: Error finding container 763765b82568d417f375cec84237ea32b7af89ae58ab7760cebf76f94860cf38: Status 404 returned error can't find the container with id 763765b82568d417f375cec84237ea32b7af89ae58ab7760cebf76f94860cf38 Jul 18 01:23:08.752106 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:08.752016 2585 generic.go:356] "Generic (PLEG): container finished" podID="7b41c9e9-5445-412a-8f68-dc395118e1aa" containerID="5a142494acdd82c8c174c4764709d48900f04225da67eb2e0e13d7bc9c97b8b9" exitCode=0 Jul 18 01:23:08.752489 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:08.752114 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8" event={"ID":"7b41c9e9-5445-412a-8f68-dc395118e1aa","Type":"ContainerDied","Data":"5a142494acdd82c8c174c4764709d48900f04225da67eb2e0e13d7bc9c97b8b9"} Jul 18 01:23:08.752489 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:08.752179 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8" event={"ID":"7b41c9e9-5445-412a-8f68-dc395118e1aa","Type":"ContainerStarted","Data":"763765b82568d417f375cec84237ea32b7af89ae58ab7760cebf76f94860cf38"} Jul 18 01:23:09.906643 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:09.906598 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8" Jul 18 01:23:09.971971 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:09.971935 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b41c9e9-5445-412a-8f68-dc395118e1aa-maas-api-service-ca\") pod \"7b41c9e9-5445-412a-8f68-dc395118e1aa\" (UID: \"7b41c9e9-5445-412a-8f68-dc395118e1aa\") " Jul 18 01:23:09.972287 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:09.972262 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b41c9e9-5445-412a-8f68-dc395118e1aa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7b41c9e9-5445-412a-8f68-dc395118e1aa" (UID: "7b41c9e9-5445-412a-8f68-dc395118e1aa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:23:10.073220 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:10.073134 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b41c9e9-5445-412a-8f68-dc395118e1aa-maas-api-service-ca\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:23:10.764400 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:10.764371 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8" Jul 18 01:23:10.764575 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:10.764410 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8" event={"ID":"7b41c9e9-5445-412a-8f68-dc395118e1aa","Type":"ContainerDied","Data":"763765b82568d417f375cec84237ea32b7af89ae58ab7760cebf76f94860cf38"} Jul 18 01:23:10.764575 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:10.764494 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="763765b82568d417f375cec84237ea32b7af89ae58ab7760cebf76f94860cf38" Jul 18 01:23:17.794394 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:17.794352 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd"] Jul 18 01:23:17.794867 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:17.794565 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" podUID="99aa1ec4-e551-4656-80e7-fd25ed957dc4" containerName="maas-api" containerID="cri-o://7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884" gracePeriod=30 Jul 18 01:23:18.046953 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.046891 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:23:18.158781 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.158744 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99aa1ec4-e551-4656-80e7-fd25ed957dc4-maas-api-tls\") pod \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " Jul 18 01:23:18.159023 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.158828 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99aa1ec4-e551-4656-80e7-fd25ed957dc4-openshift-service-ca\") pod \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " Jul 18 01:23:18.159023 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.158865 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwdcj\" (UniqueName: \"kubernetes.io/projected/99aa1ec4-e551-4656-80e7-fd25ed957dc4-kube-api-access-kwdcj\") pod \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\" (UID: \"99aa1ec4-e551-4656-80e7-fd25ed957dc4\") " Jul 18 01:23:18.159329 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.159300 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99aa1ec4-e551-4656-80e7-fd25ed957dc4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "99aa1ec4-e551-4656-80e7-fd25ed957dc4" (UID: "99aa1ec4-e551-4656-80e7-fd25ed957dc4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:23:18.161239 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.161207 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99aa1ec4-e551-4656-80e7-fd25ed957dc4-kube-api-access-kwdcj" (OuterVolumeSpecName: "kube-api-access-kwdcj") pod "99aa1ec4-e551-4656-80e7-fd25ed957dc4" (UID: "99aa1ec4-e551-4656-80e7-fd25ed957dc4"). InnerVolumeSpecName "kube-api-access-kwdcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:23:18.161338 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.161274 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99aa1ec4-e551-4656-80e7-fd25ed957dc4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "99aa1ec4-e551-4656-80e7-fd25ed957dc4" (UID: "99aa1ec4-e551-4656-80e7-fd25ed957dc4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:23:18.260149 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.260116 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99aa1ec4-e551-4656-80e7-fd25ed957dc4-maas-api-tls\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:23:18.260315 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.260169 2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99aa1ec4-e551-4656-80e7-fd25ed957dc4-openshift-service-ca\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:23:18.260315 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.260180 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwdcj\" (UniqueName: \"kubernetes.io/projected/99aa1ec4-e551-4656-80e7-fd25ed957dc4-kube-api-access-kwdcj\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:23:18.811303 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.811275 2585 generic.go:356] "Generic (PLEG): container finished" podID="99aa1ec4-e551-4656-80e7-fd25ed957dc4" containerID="7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884" exitCode=0 Jul 18 01:23:18.811642 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.811334 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" Jul 18 01:23:18.811642 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.811358 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" event={"ID":"99aa1ec4-e551-4656-80e7-fd25ed957dc4","Type":"ContainerDied","Data":"7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884"} Jul 18 01:23:18.811642 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.811418 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd" event={"ID":"99aa1ec4-e551-4656-80e7-fd25ed957dc4","Type":"ContainerDied","Data":"91d57d918fd31c98ec1c01d024c9ac2ed41a5657cb43bd7302bdbaf233694a28"} Jul 18 01:23:18.811642 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.811448 2585 scope.go:117] "RemoveContainer" containerID="7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884" Jul 18 01:23:18.821384 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.821352 2585 scope.go:117] "RemoveContainer" containerID="7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884" Jul 18 01:23:18.821749 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:23:18.821729 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884\": container with ID starting with 7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884 not found: ID does not exist" containerID="7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884" Jul 18 01:23:18.821811 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.821759 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884"} err="failed to get container status \"7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884\": rpc error: code = NotFound desc = could not find container \"7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884\": container with ID starting with 7348a2d4323645110dae195e3b7ca6dd51e6d2c91e0e5257e54fa0996a9a1884 not found: ID does not exist" Jul 18 01:23:18.828742 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.828715 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd"] Jul 18 01:23:18.833521 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:18.833496 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e06bd601-86b5848968-6ggrd"] Jul 18 01:23:20.797247 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:20.797215 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99aa1ec4-e551-4656-80e7-fd25ed957dc4" path="/var/lib/kubelet/pods/99aa1ec4-e551-4656-80e7-fd25ed957dc4/volumes" Jul 18 01:23:22.416362 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:22.416326 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8"] Jul 18 01:23:22.418439 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:22.418412 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e06bd601-gjgh8"] Jul 18 01:23:22.802704 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:22.802622 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b41c9e9-5445-412a-8f68-dc395118e1aa" path="/var/lib/kubelet/pods/7b41c9e9-5445-412a-8f68-dc395118e1aa/volumes" Jul 18 01:23:26.982796 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:26.982764 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h"] Jul 18 01:23:26.983473 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:26.983455 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b41c9e9-5445-412a-8f68-dc395118e1aa" containerName="revoke-keys" Jul 18 01:23:26.983513 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:26.983477 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b41c9e9-5445-412a-8f68-dc395118e1aa" containerName="revoke-keys" Jul 18 01:23:26.983513 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:26.983502 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99aa1ec4-e551-4656-80e7-fd25ed957dc4" containerName="maas-api" Jul 18 01:23:26.983513 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:26.983510 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="99aa1ec4-e551-4656-80e7-fd25ed957dc4" containerName="maas-api" Jul 18 01:23:26.983681 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:26.983621 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="99aa1ec4-e551-4656-80e7-fd25ed957dc4" containerName="maas-api" Jul 18 01:23:26.983681 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:26.983634 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b41c9e9-5445-412a-8f68-dc395118e1aa" containerName="revoke-keys" Jul 18 01:23:26.986851 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:26.986833 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:26.989526 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:26.989498 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-81658c06-serving-cert\"" Jul 18 01:23:26.989658 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:26.989584 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lpsl4\"" Jul 18 01:23:26.999582 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:26.998969 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h"] Jul 18 01:23:27.141585 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.141541 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0756e88f-fdf9-4c60-a878-a3d21efdbd76-maas-api-tls\") pod \"maas-api-e2e-derive-81658c06-68df965696-ww52h\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:27.141585 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.141584 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfr9c\" (UniqueName: \"kubernetes.io/projected/0756e88f-fdf9-4c60-a878-a3d21efdbd76-kube-api-access-tfr9c\") pod \"maas-api-e2e-derive-81658c06-68df965696-ww52h\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:27.141806 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.141615 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0756e88f-fdf9-4c60-a878-a3d21efdbd76-openshift-service-ca\") pod \"maas-api-e2e-derive-81658c06-68df965696-ww52h\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:27.242357 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.242249 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0756e88f-fdf9-4c60-a878-a3d21efdbd76-maas-api-tls\") pod \"maas-api-e2e-derive-81658c06-68df965696-ww52h\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:27.242357 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.242294 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfr9c\" (UniqueName: \"kubernetes.io/projected/0756e88f-fdf9-4c60-a878-a3d21efdbd76-kube-api-access-tfr9c\") pod \"maas-api-e2e-derive-81658c06-68df965696-ww52h\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:27.242595 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.242431 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0756e88f-fdf9-4c60-a878-a3d21efdbd76-openshift-service-ca\") pod \"maas-api-e2e-derive-81658c06-68df965696-ww52h\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:27.243221 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.243187 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0756e88f-fdf9-4c60-a878-a3d21efdbd76-openshift-service-ca\") pod \"maas-api-e2e-derive-81658c06-68df965696-ww52h\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:27.245021 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.244976 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0756e88f-fdf9-4c60-a878-a3d21efdbd76-maas-api-tls\") pod \"maas-api-e2e-derive-81658c06-68df965696-ww52h\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:27.254114 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.254089 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfr9c\" (UniqueName: \"kubernetes.io/projected/0756e88f-fdf9-4c60-a878-a3d21efdbd76-kube-api-access-tfr9c\") pod \"maas-api-e2e-derive-81658c06-68df965696-ww52h\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:27.301849 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.301811 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:27.457259 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.457213 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h"] Jul 18 01:23:27.457412 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:23:27.457387 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0756e88f_fdf9_4c60_a878_a3d21efdbd76.slice/crio-64dbd702b4bf89045a5e91c61339416285e2aeb269084ff5c49b547b14cf0417 WatchSource:0}: Error finding container 64dbd702b4bf89045a5e91c61339416285e2aeb269084ff5c49b547b14cf0417: Status 404 returned error can't find the container with id 64dbd702b4bf89045a5e91c61339416285e2aeb269084ff5c49b547b14cf0417 Jul 18 01:23:27.865156 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:27.865119 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" event={"ID":"0756e88f-fdf9-4c60-a878-a3d21efdbd76","Type":"ContainerStarted","Data":"64dbd702b4bf89045a5e91c61339416285e2aeb269084ff5c49b547b14cf0417"} Jul 18 01:23:28.872264 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:28.872228 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" event={"ID":"0756e88f-fdf9-4c60-a878-a3d21efdbd76","Type":"ContainerStarted","Data":"67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc"} Jul 18 01:23:28.872684 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:28.872301 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:28.890398 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:28.890344 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" podStartSLOduration=2.41268203 podStartE2EDuration="2.890327887s" totalImagesPullingTime="477.645857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:23:28.88835599 +0000 UTC m=+1730.627228197" watchObservedRunningTime="2026-07-18 01:23:28.890327887 +0000 UTC m=+1730.629200103" Jul 18 01:23:34.883455 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:34.883427 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:23:51.610326 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:51.610284 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9"] Jul 18 01:23:51.616270 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:51.616240 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9" Jul 18 01:23:51.622251 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:51.620070 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jfcsk\"" Jul 18 01:23:51.624208 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:51.624181 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9"] Jul 18 01:23:51.662552 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:51.662518 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4211f97-fab9-46db-87d4-26783604bc93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-81658c06-t4cd9\" (UID: \"a4211f97-fab9-46db-87d4-26783604bc93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9" Jul 18 01:23:51.763743 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:51.763705 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4211f97-fab9-46db-87d4-26783604bc93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-81658c06-t4cd9\" (UID: \"a4211f97-fab9-46db-87d4-26783604bc93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9" Jul 18 01:23:51.764341 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:51.764322 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4211f97-fab9-46db-87d4-26783604bc93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-81658c06-t4cd9\" (UID: \"a4211f97-fab9-46db-87d4-26783604bc93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9" Jul 18 01:23:51.932828 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:51.932737 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9" Jul 18 01:23:52.084048 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:52.084014 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9"] Jul 18 01:23:52.085462 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:23:52.085437 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4211f97_fab9_46db_87d4_26783604bc93.slice/crio-d41f63881224821d06864342141374fc8bca145d0f86d586774c771386367a73 WatchSource:0}: Error finding container d41f63881224821d06864342141374fc8bca145d0f86d586774c771386367a73: Status 404 returned error can't find the container with id d41f63881224821d06864342141374fc8bca145d0f86d586774c771386367a73 Jul 18 01:23:53.006526 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:53.006491 2585 generic.go:356] "Generic (PLEG): container finished" podID="a4211f97-fab9-46db-87d4-26783604bc93" containerID="d7b2f3d4e26d3407476d46af3d01cdeb9179a93dce3fdc79c5bf1fca8b3036a9" exitCode=0 Jul 18 01:23:53.006895 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:53.006575 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9" event={"ID":"a4211f97-fab9-46db-87d4-26783604bc93","Type":"ContainerDied","Data":"d7b2f3d4e26d3407476d46af3d01cdeb9179a93dce3fdc79c5bf1fca8b3036a9"} Jul 18 01:23:53.006895 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:53.006630 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9" event={"ID":"a4211f97-fab9-46db-87d4-26783604bc93","Type":"ContainerStarted","Data":"d41f63881224821d06864342141374fc8bca145d0f86d586774c771386367a73"} Jul 18 01:23:54.153863 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:54.153841 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9" Jul 18 01:23:54.285808 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:54.285715 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4211f97-fab9-46db-87d4-26783604bc93-maas-api-service-ca\") pod \"a4211f97-fab9-46db-87d4-26783604bc93\" (UID: \"a4211f97-fab9-46db-87d4-26783604bc93\") " Jul 18 01:23:54.286144 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:54.286111 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4211f97-fab9-46db-87d4-26783604bc93-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4211f97-fab9-46db-87d4-26783604bc93" (UID: "a4211f97-fab9-46db-87d4-26783604bc93"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:23:54.387472 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:54.387419 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4211f97-fab9-46db-87d4-26783604bc93-maas-api-service-ca\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:23:55.019452 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:55.019412 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9" Jul 18 01:23:55.019652 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:55.019415 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9" event={"ID":"a4211f97-fab9-46db-87d4-26783604bc93","Type":"ContainerDied","Data":"d41f63881224821d06864342141374fc8bca145d0f86d586774c771386367a73"} Jul 18 01:23:55.019652 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:23:55.019552 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d41f63881224821d06864342141374fc8bca145d0f86d586774c771386367a73" Jul 18 01:24:02.175386 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.175347 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h"] Jul 18 01:24:02.175856 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.175566 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" podUID="0756e88f-fdf9-4c60-a878-a3d21efdbd76" containerName="maas-api" containerID="cri-o://67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc" gracePeriod=30 Jul 18 01:24:02.436056 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.435996 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:24:02.562888 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.562854 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0756e88f-fdf9-4c60-a878-a3d21efdbd76-openshift-service-ca\") pod \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " Jul 18 01:24:02.563098 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.562935 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0756e88f-fdf9-4c60-a878-a3d21efdbd76-maas-api-tls\") pod \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " Jul 18 01:24:02.563098 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.563049 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfr9c\" (UniqueName: \"kubernetes.io/projected/0756e88f-fdf9-4c60-a878-a3d21efdbd76-kube-api-access-tfr9c\") pod \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\" (UID: \"0756e88f-fdf9-4c60-a878-a3d21efdbd76\") " Jul 18 01:24:02.563288 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.563266 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0756e88f-fdf9-4c60-a878-a3d21efdbd76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0756e88f-fdf9-4c60-a878-a3d21efdbd76" (UID: "0756e88f-fdf9-4c60-a878-a3d21efdbd76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:24:02.563350 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.563335 2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0756e88f-fdf9-4c60-a878-a3d21efdbd76-openshift-service-ca\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:24:02.565298 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.565268 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0756e88f-fdf9-4c60-a878-a3d21efdbd76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0756e88f-fdf9-4c60-a878-a3d21efdbd76" (UID: "0756e88f-fdf9-4c60-a878-a3d21efdbd76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:24:02.565411 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.565299 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0756e88f-fdf9-4c60-a878-a3d21efdbd76-kube-api-access-tfr9c" (OuterVolumeSpecName: "kube-api-access-tfr9c") pod "0756e88f-fdf9-4c60-a878-a3d21efdbd76" (UID: "0756e88f-fdf9-4c60-a878-a3d21efdbd76"). InnerVolumeSpecName "kube-api-access-tfr9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:24:02.664473 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.664427 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0756e88f-fdf9-4c60-a878-a3d21efdbd76-maas-api-tls\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:24:02.664473 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:02.664468 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfr9c\" (UniqueName: \"kubernetes.io/projected/0756e88f-fdf9-4c60-a878-a3d21efdbd76-kube-api-access-tfr9c\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:24:03.064619 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:03.064514 2585 generic.go:356] "Generic (PLEG): container finished" podID="0756e88f-fdf9-4c60-a878-a3d21efdbd76" containerID="67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc" exitCode=0 Jul 18 01:24:03.064619 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:03.064574 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" Jul 18 01:24:03.064861 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:03.064577 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" event={"ID":"0756e88f-fdf9-4c60-a878-a3d21efdbd76","Type":"ContainerDied","Data":"67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc"} Jul 18 01:24:03.064861 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:03.064699 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h" event={"ID":"0756e88f-fdf9-4c60-a878-a3d21efdbd76","Type":"ContainerDied","Data":"64dbd702b4bf89045a5e91c61339416285e2aeb269084ff5c49b547b14cf0417"} Jul 18 01:24:03.064861 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:03.064728 2585 scope.go:117] "RemoveContainer" containerID="67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc" Jul 18 01:24:03.074186 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:03.074132 2585 scope.go:117] "RemoveContainer" containerID="67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc" Jul 18 01:24:03.074465 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:24:03.074443 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc\": container with ID starting with 67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc not found: ID does not exist" containerID="67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc" Jul 18 01:24:03.074512 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:03.074477 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc"} err="failed to get container status \"67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc\": rpc error: code = NotFound desc = could not find container \"67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc\": container with ID starting with 67b92832500fd5d3737e253ea14346546bd76dac43fcb42e7c75dd540a1d60dc not found: ID does not exist" Jul 18 01:24:03.080010 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:03.079966 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h"] Jul 18 01:24:03.084203 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:03.084176 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-81658c06-68df965696-ww52h"] Jul 18 01:24:04.797027 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:04.796962 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0756e88f-fdf9-4c60-a878-a3d21efdbd76" path="/var/lib/kubelet/pods/0756e88f-fdf9-4c60-a878-a3d21efdbd76/volumes" Jul 18 01:24:06.694276 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:06.694233 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9"] Jul 18 01:24:06.698636 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:06.698607 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-81658c06-t4cd9"] Jul 18 01:24:06.797401 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:06.797357 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4211f97-fab9-46db-87d4-26783604bc93" path="/var/lib/kubelet/pods/a4211f97-fab9-46db-87d4-26783604bc93/volumes" Jul 18 01:24:38.878705 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:38.878677 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 01:24:38.881217 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:38.879420 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 01:24:38.886479 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:38.886461 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 01:24:38.886973 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:24:38.886957 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2kwdv_334a91d8-80d6-40f9-9e09-bc6615534f78/ovn-acl-logging/0.log" Jul 18 01:25:52.104250 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.104209 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5"] Jul 18 01:25:52.104896 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.104844 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4211f97-fab9-46db-87d4-26783604bc93" containerName="revoke-keys" Jul 18 01:25:52.104896 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.104858 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4211f97-fab9-46db-87d4-26783604bc93" containerName="revoke-keys" Jul 18 01:25:52.104896 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.104881 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0756e88f-fdf9-4c60-a878-a3d21efdbd76" containerName="maas-api" Jul 18 01:25:52.104896 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.104891 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0756e88f-fdf9-4c60-a878-a3d21efdbd76" containerName="maas-api" Jul 18 01:25:52.105174 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.104975 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4211f97-fab9-46db-87d4-26783604bc93" containerName="revoke-keys" Jul 18 01:25:52.105174 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.105010 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0756e88f-fdf9-4c60-a878-a3d21efdbd76" containerName="maas-api" Jul 18 01:25:52.108407 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.108384 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:52.111256 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.111228 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-db0b0851-serving-cert\"" Jul 18 01:25:52.111402 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.111338 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lpsl4\"" Jul 18 01:25:52.119521 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.119491 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5"] Jul 18 01:25:52.256472 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.256435 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-maas-api-tls\") pod \"maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:52.256673 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.256487 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwf4k\" (UniqueName: \"kubernetes.io/projected/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-kube-api-access-qwf4k\") pod \"maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:52.256673 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.256528 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-openshift-service-ca\") pod \"maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:52.358089 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.357968 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-maas-api-tls\") pod \"maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:52.358089 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.358032 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwf4k\" (UniqueName: \"kubernetes.io/projected/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-kube-api-access-qwf4k\") pod \"maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:52.358089 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.358060 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-openshift-service-ca\") pod \"maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:52.358377 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:25:52.358162 2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-serving-cert: secret "maas-api-e2e-mt-db0b0851-serving-cert" not found Jul 18 01:25:52.358377 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:25:52.358244 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-maas-api-tls podName:d0b05549-c2f7-4d67-826b-ebe8af16e7b6 nodeName:}" failed. No retries permitted until 2026-07-18 01:25:52.858225938 +0000 UTC m=+1874.597098132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-maas-api-tls") pod "maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" (UID: "d0b05549-c2f7-4d67-826b-ebe8af16e7b6") : secret "maas-api-e2e-mt-db0b0851-serving-cert" not found Jul 18 01:25:52.358863 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.358837 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-openshift-service-ca\") pod \"maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:52.370941 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.370916 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwf4k\" (UniqueName: \"kubernetes.io/projected/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-kube-api-access-qwf4k\") pod \"maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:52.863844 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.863744 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-maas-api-tls\") pod \"maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:52.866428 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:52.866403 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-maas-api-tls\") pod \"maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:53.021597 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:53.021561 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:53.174491 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:53.174468 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5"] Jul 18 01:25:53.176685 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:25:53.176653 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b05549_c2f7_4d67_826b_ebe8af16e7b6.slice/crio-515a9f1a4a0284b44fe85fd3edbbad6444e91c6a694216f2358bfaa88d55102d WatchSource:0}: Error finding container 515a9f1a4a0284b44fe85fd3edbbad6444e91c6a694216f2358bfaa88d55102d: Status 404 returned error can't find the container with id 515a9f1a4a0284b44fe85fd3edbbad6444e91c6a694216f2358bfaa88d55102d Jul 18 01:25:53.671348 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:53.671308 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" event={"ID":"d0b05549-c2f7-4d67-826b-ebe8af16e7b6","Type":"ContainerStarted","Data":"515a9f1a4a0284b44fe85fd3edbbad6444e91c6a694216f2358bfaa88d55102d"} Jul 18 01:25:54.678591 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:54.678546 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" event={"ID":"d0b05549-c2f7-4d67-826b-ebe8af16e7b6","Type":"ContainerStarted","Data":"79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262"} Jul 18 01:25:54.679121 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:54.678721 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:25:54.700162 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:25:54.700098 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" podStartSLOduration=2.181056145 podStartE2EDuration="2.700080236s" totalImagesPullingTime="519.024091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:25:54.697953894 +0000 UTC m=+1876.436826110" watchObservedRunningTime="2026-07-18 01:25:54.700080236 +0000 UTC m=+1876.438952451" Jul 18 01:26:00.689337 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:00.689262 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:26:03.695279 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:03.695248 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd"] Jul 18 01:26:03.698894 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:03.698878 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" Jul 18 01:26:03.701309 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:03.701290 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jfcsk\"" Jul 18 01:26:03.706495 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:03.706474 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd"] Jul 18 01:26:03.872901 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:03.872860 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faf1337b-6304-4e76-b44e-0885975d11f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db0b0851-qxghd\" (UID: \"faf1337b-6304-4e76-b44e-0885975d11f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" Jul 18 01:26:03.973767 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:03.973669 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faf1337b-6304-4e76-b44e-0885975d11f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db0b0851-qxghd\" (UID: \"faf1337b-6304-4e76-b44e-0885975d11f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" Jul 18 01:26:03.974394 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:03.974373 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faf1337b-6304-4e76-b44e-0885975d11f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db0b0851-qxghd\" (UID: \"faf1337b-6304-4e76-b44e-0885975d11f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" Jul 18 01:26:04.011751 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:04.011717 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" Jul 18 01:26:04.160316 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:04.160290 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd"] Jul 18 01:26:04.163374 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:26:04.163323 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf1337b_6304_4e76_b44e_0885975d11f2.slice/crio-ee60c62334b29317caeae53c99b277bfe4a9437917f60ba758b3bb4de3ff09ec WatchSource:0}: Error finding container ee60c62334b29317caeae53c99b277bfe4a9437917f60ba758b3bb4de3ff09ec: Status 404 returned error can't find the container with id ee60c62334b29317caeae53c99b277bfe4a9437917f60ba758b3bb4de3ff09ec Jul 18 01:26:04.735486 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:04.735392 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" event={"ID":"faf1337b-6304-4e76-b44e-0885975d11f2","Type":"ContainerStarted","Data":"2e14d414877ade3d5e9cb36e9f7c22b248bdcbffd2c101cf3cd0aa6b94a127ce"} Jul 18 01:26:04.735486 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:04.735443 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" event={"ID":"faf1337b-6304-4e76-b44e-0885975d11f2","Type":"ContainerStarted","Data":"ee60c62334b29317caeae53c99b277bfe4a9437917f60ba758b3bb4de3ff09ec"} Jul 18 01:26:04.750917 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:04.750869 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" podStartSLOduration=1.750852589 podStartE2EDuration="1.750852589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:26:04.750146046 +0000 UTC m=+1886.489018263" watchObservedRunningTime="2026-07-18 01:26:04.750852589 +0000 UTC m=+1886.489724804" Jul 18 01:26:05.742532 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:05.742482 2585 generic.go:356] "Generic (PLEG): container finished" podID="faf1337b-6304-4e76-b44e-0885975d11f2" containerID="2e14d414877ade3d5e9cb36e9f7c22b248bdcbffd2c101cf3cd0aa6b94a127ce" exitCode=0 Jul 18 01:26:05.742924 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:05.742571 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" event={"ID":"faf1337b-6304-4e76-b44e-0885975d11f2","Type":"ContainerDied","Data":"2e14d414877ade3d5e9cb36e9f7c22b248bdcbffd2c101cf3cd0aa6b94a127ce"} Jul 18 01:26:06.892434 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:06.892400 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" Jul 18 01:26:06.895479 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:06.895445 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faf1337b-6304-4e76-b44e-0885975d11f2-maas-api-service-ca\") pod \"faf1337b-6304-4e76-b44e-0885975d11f2\" (UID: \"faf1337b-6304-4e76-b44e-0885975d11f2\") " Jul 18 01:26:06.895758 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:06.895735 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faf1337b-6304-4e76-b44e-0885975d11f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "faf1337b-6304-4e76-b44e-0885975d11f2" (UID: "faf1337b-6304-4e76-b44e-0885975d11f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:26:06.996169 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:06.996134 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faf1337b-6304-4e76-b44e-0885975d11f2-maas-api-service-ca\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:26:07.754329 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:07.754301 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" Jul 18 01:26:07.754520 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:07.754337 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd" event={"ID":"faf1337b-6304-4e76-b44e-0885975d11f2","Type":"ContainerDied","Data":"ee60c62334b29317caeae53c99b277bfe4a9437917f60ba758b3bb4de3ff09ec"} Jul 18 01:26:07.754520 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:07.754388 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee60c62334b29317caeae53c99b277bfe4a9437917f60ba758b3bb4de3ff09ec" Jul 18 01:26:14.086869 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.086835 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5"] Jul 18 01:26:14.087308 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.087146 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" podUID="d0b05549-c2f7-4d67-826b-ebe8af16e7b6" containerName="maas-api" containerID="cri-o://79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262" gracePeriod=30 Jul 18 01:26:14.346957 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.346932 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:26:14.351525 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.351497 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwf4k\" (UniqueName: \"kubernetes.io/projected/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-kube-api-access-qwf4k\") pod \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " Jul 18 01:26:14.351641 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.351582 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-openshift-service-ca\") pod \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " Jul 18 01:26:14.351641 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.351623 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-maas-api-tls\") pod \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\" (UID: \"d0b05549-c2f7-4d67-826b-ebe8af16e7b6\") " Jul 18 01:26:14.351905 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.351884 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d0b05549-c2f7-4d67-826b-ebe8af16e7b6" (UID: "d0b05549-c2f7-4d67-826b-ebe8af16e7b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:26:14.352013 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.351974 2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-openshift-service-ca\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:26:14.353720 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.353691 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d0b05549-c2f7-4d67-826b-ebe8af16e7b6" (UID: "d0b05549-c2f7-4d67-826b-ebe8af16e7b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:26:14.353818 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.353773 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-kube-api-access-qwf4k" (OuterVolumeSpecName: "kube-api-access-qwf4k") pod "d0b05549-c2f7-4d67-826b-ebe8af16e7b6" (UID: "d0b05549-c2f7-4d67-826b-ebe8af16e7b6"). InnerVolumeSpecName "kube-api-access-qwf4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:26:14.453061 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.453026 2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-maas-api-tls\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:26:14.453215 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.453063 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwf4k\" (UniqueName: \"kubernetes.io/projected/d0b05549-c2f7-4d67-826b-ebe8af16e7b6-kube-api-access-qwf4k\") on node \"ip-10-0-132-32.ec2.internal\" DevicePath \"\"" Jul 18 01:26:14.793241 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.793152 2585 generic.go:356] "Generic (PLEG): container finished" podID="d0b05549-c2f7-4d67-826b-ebe8af16e7b6" containerID="79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262" exitCode=0 Jul 18 01:26:14.793387 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.793253 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" Jul 18 01:26:14.797277 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.797249 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" event={"ID":"d0b05549-c2f7-4d67-826b-ebe8af16e7b6","Type":"ContainerDied","Data":"79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262"} Jul 18 01:26:14.797404 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.797298 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5" event={"ID":"d0b05549-c2f7-4d67-826b-ebe8af16e7b6","Type":"ContainerDied","Data":"515a9f1a4a0284b44fe85fd3edbbad6444e91c6a694216f2358bfaa88d55102d"} Jul 18 01:26:14.797404 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.797330 2585 scope.go:117] "RemoveContainer" containerID="79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262" Jul 18 01:26:14.807139 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.807122 2585 scope.go:117] "RemoveContainer" containerID="79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262" Jul 18 01:26:14.807370 ip-10-0-132-32 kubenswrapper[2585]: E0718 01:26:14.807352 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262\": container with ID starting with 79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262 not found: ID does not exist" containerID="79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262" Jul 18 01:26:14.807419 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.807378 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262"} err="failed to get container status \"79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262\": rpc error: code = NotFound desc = could not find container \"79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262\": container with ID starting with 79141fe6200865e6b1d41d1ad0b04b39c3a9a6e09fb0bfd392554b5034275262 not found: ID does not exist" Jul 18 01:26:14.817591 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.817569 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5"] Jul 18 01:26:14.821409 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:14.821388 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db0b0851-7995b9dc65-f65q5"] Jul 18 01:26:16.797321 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:16.797286 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0b05549-c2f7-4d67-826b-ebe8af16e7b6" path="/var/lib/kubelet/pods/d0b05549-c2f7-4d67-826b-ebe8af16e7b6/volumes" Jul 18 01:26:18.765870 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:18.765833 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd"] Jul 18 01:26:18.768157 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:18.768131 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db0b0851-qxghd"] Jul 18 01:26:18.796969 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:18.796939 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faf1337b-6304-4e76-b44e-0885975d11f2" path="/var/lib/kubelet/pods/faf1337b-6304-4e76-b44e-0885975d11f2/volumes" Jul 18 01:26:43.864579 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:43.864543 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-krwwt_abd76acf-a921-44f9-a9e5-23f678e38861/manager/0.log" Jul 18 01:26:44.098628 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:44.098591 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cb9884d8c-vz8jd_b2572a31-8506-4e8e-89b8-a19b855e6357/manager/0.log" Jul 18 01:26:44.212640 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:44.212563 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-h8k6g_18226653-4f58-4fe4-81d7-de0d74914dfc/server/0.log" Jul 18 01:26:44.328213 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:44.328182 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tpbq9_a7db99db-c28d-41ee-b7f5-b97da7663858/manager/0.log" Jul 18 01:26:44.576860 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:44.576781 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdb8f5f6-k7z65_cab29cdb-6f02-4621-9a55-45b20a596059/copy-manifests/0.log" Jul 18 01:26:44.582623 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:44.582603 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdb8f5f6-k7z65_cab29cdb-6f02-4621-9a55-45b20a596059/manager/0.log" Jul 18 01:26:45.032870 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:45.032836 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-64f985c967-cc9th_e21532a4-b7a9-4b26-bb06-5f12f9fa6cbe/maas-api/0.log" Jul 18 01:26:45.140479 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:45.140446 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29738955-vvvxn_b0da4aac-c754-4066-a818-d52901945bbf/cleanup/0.log" Jul 18 01:26:45.242470 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:45.242443 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-mzmtz_ebd68fc3-5dda-4ee2-bb6a-24b2c1cb0e0a/postgres/0.log" Jul 18 01:26:46.611889 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:46.611858 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rchnf_1e9850ae-9d19-46ef-8efd-fe975895e7b6/manager/0.log" Jul 18 01:26:46.721215 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:46.721189 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-44nsv_709d3ef2-048a-4de2-8128-7a8756fc0062/manager/0.log" Jul 18 01:26:46.829210 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:46.829181 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r45wv_f76dd0ac-59eb-4e73-8a21-d390b850ac33/kuadrant-console-plugin/0.log" Jul 18 01:26:46.937695 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:46.937617 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kn6cs_70a22d90-bca9-4af2-ae5f-4c7b092ab9a4/registry-server/0.log" Jul 18 01:26:47.059366 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:47.059339 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rfv8h_32537d9e-8156-4542-a5da-c65f8e30f674/manager/0.log" Jul 18 01:26:47.903169 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:47.903139 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc9c468c9-ftwd4_6ab382bd-bf1b-4275-aebb-fc0d1514b3e6/kube-auth-proxy/0.log" Jul 18 01:26:48.139466 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:48.139426 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9m48k_e0605587-0bc3-4641-8704-798f6de1eb79/istio-proxy/1.log" Jul 18 01:26:48.255416 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:48.255331 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qp9q9_c1e70c4b-7de6-4640-a6e6-d34df94b5067/payload-pre-processing/0.log" Jul 18 01:26:48.367502 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:48.367472 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-qk44p_71d2e4d5-5700-41f6-9269-1646d092d6de/payload-processing/0.log" Jul 18 01:26:48.479562 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:48.479536 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc696d8b6-hwmrm_f3333e0b-8a2c-460a-a8da-081382fdc27a/router/0.log" Jul 18 01:26:48.812041 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:48.812011 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-psgwl_e3599b29-1c7b-4e9b-85f8-6e7ed888859d/main/0.log" Jul 18 01:26:49.036391 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:49.036359 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-srqgk_4b21069c-e22f-4ab9-ada2-463597839df5/main/0.log" Jul 18 01:26:54.717668 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.717635 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88kbb/must-gather-nnvkh"] Jul 18 01:26:54.718105 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.718091 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faf1337b-6304-4e76-b44e-0885975d11f2" containerName="revoke-keys" Jul 18 01:26:54.718164 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.718107 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="faf1337b-6304-4e76-b44e-0885975d11f2" containerName="revoke-keys" Jul 18 01:26:54.718164 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.718138 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b05549-c2f7-4d67-826b-ebe8af16e7b6" containerName="maas-api" Jul 18 01:26:54.718164 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.718146 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b05549-c2f7-4d67-826b-ebe8af16e7b6" containerName="maas-api" Jul 18 01:26:54.718260 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.718239 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b05549-c2f7-4d67-826b-ebe8af16e7b6" containerName="maas-api" Jul 18 01:26:54.718260 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.718251 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="faf1337b-6304-4e76-b44e-0885975d11f2" containerName="revoke-keys" Jul 18 01:26:54.721620 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.721599 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88kbb/must-gather-nnvkh" Jul 18 01:26:54.724264 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.724241 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-88kbb\"/\"default-dockercfg-2f44p\"" Jul 18 01:26:54.724371 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.724239 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88kbb\"/\"openshift-service-ca.crt\"" Jul 18 01:26:54.724910 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.724895 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88kbb\"/\"kube-root-ca.crt\"" Jul 18 01:26:54.733254 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.733226 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88kbb/must-gather-nnvkh"] Jul 18 01:26:54.818217 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.818188 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/82ef22a5-e846-4376-840d-c3d97e1e0c2a-must-gather-output\") pod \"must-gather-nnvkh\" (UID: \"82ef22a5-e846-4376-840d-c3d97e1e0c2a\") " pod="openshift-must-gather-88kbb/must-gather-nnvkh" Jul 18 01:26:54.818217 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.818221 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqq2k\" (UniqueName: \"kubernetes.io/projected/82ef22a5-e846-4376-840d-c3d97e1e0c2a-kube-api-access-kqq2k\") pod \"must-gather-nnvkh\" (UID: \"82ef22a5-e846-4376-840d-c3d97e1e0c2a\") " pod="openshift-must-gather-88kbb/must-gather-nnvkh" Jul 18 01:26:54.918733 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.918699 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/82ef22a5-e846-4376-840d-c3d97e1e0c2a-must-gather-output\") pod \"must-gather-nnvkh\" (UID: \"82ef22a5-e846-4376-840d-c3d97e1e0c2a\") " pod="openshift-must-gather-88kbb/must-gather-nnvkh" Jul 18 01:26:54.918733 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.918731 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqq2k\" (UniqueName: \"kubernetes.io/projected/82ef22a5-e846-4376-840d-c3d97e1e0c2a-kube-api-access-kqq2k\") pod \"must-gather-nnvkh\" (UID: \"82ef22a5-e846-4376-840d-c3d97e1e0c2a\") " pod="openshift-must-gather-88kbb/must-gather-nnvkh" Jul 18 01:26:54.919087 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.919064 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/82ef22a5-e846-4376-840d-c3d97e1e0c2a-must-gather-output\") pod \"must-gather-nnvkh\" (UID: \"82ef22a5-e846-4376-840d-c3d97e1e0c2a\") " pod="openshift-must-gather-88kbb/must-gather-nnvkh" Jul 18 01:26:54.926790 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:54.926766 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqq2k\" (UniqueName: \"kubernetes.io/projected/82ef22a5-e846-4376-840d-c3d97e1e0c2a-kube-api-access-kqq2k\") pod \"must-gather-nnvkh\" (UID: \"82ef22a5-e846-4376-840d-c3d97e1e0c2a\") " pod="openshift-must-gather-88kbb/must-gather-nnvkh" Jul 18 01:26:55.030865 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:55.030787 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88kbb/must-gather-nnvkh" Jul 18 01:26:55.171156 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:55.171123 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88kbb/must-gather-nnvkh"] Jul 18 01:26:55.172659 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:26:55.172632 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82ef22a5_e846_4376_840d_c3d97e1e0c2a.slice/crio-cbd54dc2481990fd6e8dcf760dbee0d96adf8219f01c743bb8f847eec4b64f1a WatchSource:0}: Error finding container cbd54dc2481990fd6e8dcf760dbee0d96adf8219f01c743bb8f847eec4b64f1a: Status 404 returned error can't find the container with id cbd54dc2481990fd6e8dcf760dbee0d96adf8219f01c743bb8f847eec4b64f1a Jul 18 01:26:55.174575 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:55.174557 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 01:26:56.022247 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:56.022210 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88kbb/must-gather-nnvkh" event={"ID":"82ef22a5-e846-4376-840d-c3d97e1e0c2a","Type":"ContainerStarted","Data":"cbd54dc2481990fd6e8dcf760dbee0d96adf8219f01c743bb8f847eec4b64f1a"} Jul 18 01:26:57.034015 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:57.033961 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88kbb/must-gather-nnvkh" event={"ID":"82ef22a5-e846-4376-840d-c3d97e1e0c2a","Type":"ContainerStarted","Data":"2e3d38478c1a53a757be0ae8fbc299d9ebf7841a5081820ef164204f8e8e9c8c"} Jul 18 01:26:57.034437 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:57.034027 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88kbb/must-gather-nnvkh" event={"ID":"82ef22a5-e846-4376-840d-c3d97e1e0c2a","Type":"ContainerStarted","Data":"07b19134abd55f4277ae2f964f927c3847b69df5c47180aa9de46c811c79ad5f"} Jul 18 01:26:57.049694 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:57.049626 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88kbb/must-gather-nnvkh" podStartSLOduration=2.209798697 podStartE2EDuration="3.049606056s" totalImagesPullingTime="839.807359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:26:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:26:57.047674423 +0000 UTC m=+1938.786546639" watchObservedRunningTime="2026-07-18 01:26:57.049606056 +0000 UTC m=+1938.788478273" Jul 18 01:26:57.584778 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:57.584749 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8nphz_64302c11-8b83-4992-bf49-089c75a48e2e/global-pull-secret-syncer/0.log" Jul 18 01:26:57.695250 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:57.695218 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rzpmd_b09f54df-61eb-4b1b-bef8-06f18f9a5944/konnectivity-agent/0.log" Jul 18 01:26:57.775755 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:26:57.775732 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-32.ec2.internal_c304919a739b1d1733f194b8c3cd0ceb/haproxy/0.log" Jul 18 01:27:03.615943 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:03.615912 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rchnf_1e9850ae-9d19-46ef-8efd-fe975895e7b6/manager/0.log" Jul 18 01:27:03.643166 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:03.643138 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-44nsv_709d3ef2-048a-4de2-8128-7a8756fc0062/manager/0.log" Jul 18 01:27:03.669880 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:03.669778 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-r45wv_f76dd0ac-59eb-4e73-8a21-d390b850ac33/kuadrant-console-plugin/0.log" Jul 18 01:27:03.711429 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:03.711302 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kn6cs_70a22d90-bca9-4af2-ae5f-4c7b092ab9a4/registry-server/0.log" Jul 18 01:27:03.856006 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:03.854243 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rfv8h_32537d9e-8156-4542-a5da-c65f8e30f674/manager/0.log" Jul 18 01:27:05.863417 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:05.863382 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-wvx2k_64c69592-b833-4669-99a0-1926e6421f08/cluster-monitoring-operator/0.log" Jul 18 01:27:06.190799 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:06.190718 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pncfp_51f09d04-e9f8-4cd0-a52f-fa27356f0268/node-exporter/0.log" Jul 18 01:27:06.211185 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:06.211152 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pncfp_51f09d04-e9f8-4cd0-a52f-fa27356f0268/kube-rbac-proxy/0.log" Jul 18 01:27:06.231579 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:06.231549 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pncfp_51f09d04-e9f8-4cd0-a52f-fa27356f0268/init-textfile/0.log" Jul 18 01:27:07.769720 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.769680 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r"] Jul 18 01:27:07.775498 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.775467 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.780136 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.780097 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r"] Jul 18 01:27:07.859006 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.858428 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-proc\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.859006 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.858490 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-lib-modules\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.859006 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.858515 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-podres\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.859006 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.858540 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k5fh\" (UniqueName: \"kubernetes.io/projected/dfb15f98-117a-484d-98ab-cc3166819990-kube-api-access-4k5fh\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.859006 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.858590 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-sys\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.945667 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.945639 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-pqgqr_39c30f4c-bde7-4bae-8d45-fb53dc458a0d/networking-console-plugin/0.log" Jul 18 01:27:07.959356 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.959325 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-proc\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.959550 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.959381 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-lib-modules\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.959550 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.959405 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-podres\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.959550 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.959428 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5fh\" (UniqueName: \"kubernetes.io/projected/dfb15f98-117a-484d-98ab-cc3166819990-kube-api-access-4k5fh\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.959550 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.959442 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-proc\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.959550 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.959498 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-sys\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.959786 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.959564 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-lib-modules\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.959786 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.959592 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-podres\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.959786 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.959595 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfb15f98-117a-484d-98ab-cc3166819990-sys\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:07.967137 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:07.967113 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5fh\" (UniqueName: \"kubernetes.io/projected/dfb15f98-117a-484d-98ab-cc3166819990-kube-api-access-4k5fh\") pod \"perf-node-gather-daemonset-28t5r\" (UID: \"dfb15f98-117a-484d-98ab-cc3166819990\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:08.089831 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:08.089728 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:08.303399 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:08.303362 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r"] Jul 18 01:27:08.309316 ip-10-0-132-32 kubenswrapper[2585]: W0718 01:27:08.309276 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddfb15f98_117a_484d_98ab_cc3166819990.slice/crio-903ba005ec3975d5835a490ec68305aa02f2cf227bd7dafb63711176e943ebea WatchSource:0}: Error finding container 903ba005ec3975d5835a490ec68305aa02f2cf227bd7dafb63711176e943ebea: Status 404 returned error can't find the container with id 903ba005ec3975d5835a490ec68305aa02f2cf227bd7dafb63711176e943ebea Jul 18 01:27:08.554373 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:08.554331 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/1.log" Jul 18 01:27:08.561464 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:08.561424 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-c5xzb_2acdbbb6-f965-408b-a4e1-525354af72c7/console-operator/2.log" Jul 18 01:27:09.048129 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:09.048094 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-9phgq_522e9581-bd77-498e-adfd-b78048c17673/download-server/0.log" Jul 18 01:27:09.134863 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:09.134826 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" event={"ID":"dfb15f98-117a-484d-98ab-cc3166819990","Type":"ContainerStarted","Data":"a7a9ab7c0a5ed48e64c25cdf5f963bde9f8d36b66db94ef33827e807871df518"} Jul 18 01:27:09.135092 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:09.134893 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:09.135092 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:09.134918 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" event={"ID":"dfb15f98-117a-484d-98ab-cc3166819990","Type":"ContainerStarted","Data":"903ba005ec3975d5835a490ec68305aa02f2cf227bd7dafb63711176e943ebea"} Jul 18 01:27:09.150664 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:09.149530 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" podStartSLOduration=2.149509076 podStartE2EDuration="2.149509076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:27:09.148746866 +0000 UTC m=+1950.887619086" watchObservedRunningTime="2026-07-18 01:27:09.149509076 +0000 UTC m=+1950.888381293" Jul 18 01:27:09.597883 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:09.597855 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-p7cxb_32a7ad20-f52b-4b29-911b-28ec26b6e752/volume-data-source-validator/0.log" Jul 18 01:27:10.686831 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:10.686802 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2rgw_8e5e186f-bc53-4ddb-820e-78bb5eb24953/dns/0.log" Jul 18 01:27:10.710647 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:10.710615 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2rgw_8e5e186f-bc53-4ddb-820e-78bb5eb24953/kube-rbac-proxy/0.log" Jul 18 01:27:10.780541 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:10.780510 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zdrj5_9f675299-7395-4d54-8b9b-7bb19ffd11d9/dns-node-resolver/0.log" Jul 18 01:27:11.417031 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:11.416978 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j8lkk_b9474dba-cf39-4e3d-b0af-e7efbdfdb495/node-ca/0.log" Jul 18 01:27:12.479273 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:12.479247 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc9c468c9-ftwd4_6ab382bd-bf1b-4275-aebb-fc0d1514b3e6/kube-auth-proxy/0.log" Jul 18 01:27:12.534448 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:12.534408 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9m48k_e0605587-0bc3-4641-8704-798f6de1eb79/istio-proxy/0.log" Jul 18 01:27:12.574501 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:12.574469 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9m48k_e0605587-0bc3-4641-8704-798f6de1eb79/istio-proxy/1.log" Jul 18 01:27:12.605372 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:12.605337 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qp9q9_c1e70c4b-7de6-4640-a6e6-d34df94b5067/payload-pre-processing/0.log" Jul 18 01:27:12.634675 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:12.634642 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-qk44p_71d2e4d5-5700-41f6-9269-1646d092d6de/payload-processing/0.log" Jul 18 01:27:12.655903 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:12.655880 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc696d8b6-hwmrm_f3333e0b-8a2c-460a-a8da-081382fdc27a/router/0.log" Jul 18 01:27:13.282416 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:13.282389 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7n6hg_285d4b11-9773-491e-b59a-cb07038656bb/serve-healthcheck-canary/0.log" Jul 18 01:27:13.806036 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:13.806005 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-h75lr_9c10beb1-5448-44d2-ade8-c67b60764c62/insights-operator/0.log" Jul 18 01:27:13.892976 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:13.892932 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r2vxp_38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8/kube-rbac-proxy/0.log" Jul 18 01:27:13.913603 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:13.913563 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r2vxp_38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8/exporter/0.log" Jul 18 01:27:13.937184 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:13.937153 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r2vxp_38493889-3fa5-4ab7-8e5c-6ebdf98f4ac8/extractor/0.log" Jul 18 01:27:15.158266 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:15.158241 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-28t5r" Jul 18 01:27:16.060695 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:16.060658 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-krwwt_abd76acf-a921-44f9-a9e5-23f678e38861/manager/0.log" Jul 18 01:27:16.279579 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:16.279538 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cb9884d8c-vz8jd_b2572a31-8506-4e8e-89b8-a19b855e6357/manager/0.log" Jul 18 01:27:16.300358 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:16.300333 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-h8k6g_18226653-4f58-4fe4-81d7-de0d74914dfc/server/0.log" Jul 18 01:27:16.361485 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:16.361441 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tpbq9_a7db99db-c28d-41ee-b7f5-b97da7663858/manager/0.log" Jul 18 01:27:16.503200 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:16.503175 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdb8f5f6-k7z65_cab29cdb-6f02-4621-9a55-45b20a596059/manager/0.log" Jul 18 01:27:16.523712 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:16.523688 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdb8f5f6-k7z65_cab29cdb-6f02-4621-9a55-45b20a596059/copy-manifests/0.log" Jul 18 01:27:18.688877 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:18.688838 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc9c468c9-ftwd4_6ab382bd-bf1b-4275-aebb-fc0d1514b3e6/kube-auth-proxy/0.log" Jul 18 01:27:18.722819 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:18.722787 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9m48k_e0605587-0bc3-4641-8704-798f6de1eb79/istio-proxy/0.log" Jul 18 01:27:18.760338 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:18.760308 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9m48k_e0605587-0bc3-4641-8704-798f6de1eb79/istio-proxy/1.log" Jul 18 01:27:18.786720 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:18.786688 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qp9q9_c1e70c4b-7de6-4640-a6e6-d34df94b5067/payload-pre-processing/0.log" Jul 18 01:27:18.809464 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:18.809397 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-qk44p_71d2e4d5-5700-41f6-9269-1646d092d6de/payload-processing/0.log" Jul 18 01:27:18.824130 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:18.824098 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc696d8b6-hwmrm_f3333e0b-8a2c-460a-a8da-081382fdc27a/router/0.log" Jul 18 01:27:20.136849 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:20.136825 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dc9c468c9-ftwd4_6ab382bd-bf1b-4275-aebb-fc0d1514b3e6/kube-auth-proxy/0.log" Jul 18 01:27:20.176746 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:20.176700 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9m48k_e0605587-0bc3-4641-8704-798f6de1eb79/istio-proxy/0.log" Jul 18 01:27:20.220152 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:20.220121 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9m48k_e0605587-0bc3-4641-8704-798f6de1eb79/istio-proxy/1.log" Jul 18 01:27:20.245775 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:20.245748 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-qp9q9_c1e70c4b-7de6-4640-a6e6-d34df94b5067/payload-pre-processing/0.log" Jul 18 01:27:20.270375 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:20.270335 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-qk44p_71d2e4d5-5700-41f6-9269-1646d092d6de/payload-processing/0.log" Jul 18 01:27:20.291970 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:20.291932 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc696d8b6-hwmrm_f3333e0b-8a2c-460a-a8da-081382fdc27a/router/0.log" Jul 18 01:27:22.954794 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:22.954758 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ttnt7_b778939c-7796-4f3e-8f54-5b4676b0d8df/migrator/0.log" Jul 18 01:27:22.976632 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:22.976607 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ttnt7_b778939c-7796-4f3e-8f54-5b4676b0d8df/graceful-termination/0.log" Jul 18 01:27:23.315828 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:23.315744 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-c64lf_4ccd3551-04ec-4cc3-bb2e-44987fe5370f/kube-storage-version-migrator-operator/1.log" Jul 18 01:27:23.316697 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:23.316671 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-c64lf_4ccd3551-04ec-4cc3-bb2e-44987fe5370f/kube-storage-version-migrator-operator/0.log" Jul 18 01:27:24.263631 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:24.263604 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2984k_b4af8641-1c51-4e5a-baa5-8c634b2c7b4f/kube-multus-additional-cni-plugins/0.log" Jul 18 01:27:24.284256 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:24.284228 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2984k_b4af8641-1c51-4e5a-baa5-8c634b2c7b4f/egress-router-binary-copy/0.log" Jul 18 01:27:24.305165 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:24.305142 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2984k_b4af8641-1c51-4e5a-baa5-8c634b2c7b4f/cni-plugins/0.log" Jul 18 01:27:24.327599 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:24.327571 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2984k_b4af8641-1c51-4e5a-baa5-8c634b2c7b4f/bond-cni-plugin/0.log" Jul 18 01:27:24.348177 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:24.348145 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2984k_b4af8641-1c51-4e5a-baa5-8c634b2c7b4f/routeoverride-cni/0.log" Jul 18 01:27:24.368879 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:24.368851 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2984k_b4af8641-1c51-4e5a-baa5-8c634b2c7b4f/whereabouts-cni-bincopy/0.log" Jul 18 01:27:24.390883 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:24.390852 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2984k_b4af8641-1c51-4e5a-baa5-8c634b2c7b4f/whereabouts-cni/0.log" Jul 18 01:27:24.732637 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:24.732612 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dvg9j_6cfa5075-7004-43bd-8c6a-da34cff6a4d2/kube-multus/0.log" Jul 18 01:27:24.889836 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:24.889806 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rhg65_c29e5d41-e606-437c-8a87-3b5b002ead5d/network-metrics-daemon/0.log" Jul 18 01:27:24.907361 ip-10-0-132-32 kubenswrapper[2585]: I0718 01:27:24.907334 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rhg65_c29e5d41-e606-437c-8a87-3b5b002ead5d/kube-rbac-proxy/0.log"