Jul 23 17:05:05.070608 ip-10-0-133-26 systemd[1]: Starting Kubernetes Kubelet... Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.461376 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465185 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465200 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465203 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465206 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465209 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465212 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465216 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 17:05:05.508486 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465219 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465222 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465224 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465228 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465232 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465243 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465245 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465248 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465252 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465256 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465261 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465265 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465269 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465272 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465275 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465278 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465281 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465284 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465286 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465289 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 17:05:05.509797 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465292 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465296 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465299 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465302 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465305 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465308 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465311 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465327 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465331 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465334 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465337 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465340 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465342 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465345 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465348 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465350 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465353 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465355 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465359 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 17:05:05.510479 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465362 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465365 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465367 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465370 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465372 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465375 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465378 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465381 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465384 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465844 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465849 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465853 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465856 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465859 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465862 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465866 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465870 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465873 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465877 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465879 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 17:05:05.511075 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465884 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465887 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465890 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465893 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465896 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465898 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465901 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465903 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465906 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465909 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465911 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465915 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465918 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465921 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465923 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465926 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465928 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465931 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465934 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465936 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 17:05:05.511673 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465939 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465942 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465945 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465947 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465950 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465952 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465954 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465957 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465959 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465962 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465964 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465968 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.465970 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467350 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467359 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467363 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467367 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467370 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467374 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467378 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 17:05:05.512305 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467381 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467384 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467387 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467389 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467392 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467401 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467404 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467406 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467409 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467412 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467414 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467417 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467419 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467422 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467424 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467426 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467429 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467431 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467434 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467436 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 17:05:05.512926 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467439 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467441 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467444 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467446 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467449 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467451 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467454 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467456 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467459 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467461 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467464 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467466 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467468 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467471 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467474 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467477 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467479 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467481 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467521 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467542 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 17:05:05.513603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467546 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467550 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467552 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467556 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467559 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467562 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467565 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467568 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467571 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467575 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467582 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467585 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467587 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467590 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467593 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467595 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467599 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467602 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467604 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467607 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 17:05:05.514184 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467609 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467612 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467615 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467618 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467621 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467624 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467627 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467632 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467636 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467640 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467644 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467647 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467649 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467652 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467655 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467658 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467660 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467663 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467666 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467668 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 17:05:05.514766 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467671 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467673 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467677 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467680 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467683 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467690 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467692 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467695 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467698 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467700 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467703 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.467706 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468217 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468223 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468226 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468229 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468232 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468234 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468237 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468250 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 17:05:05.515457 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468253 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468255 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468258 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468261 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468263 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468265 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468269 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468273 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468277 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468280 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468283 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468286 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468288 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468291 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468293 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468296 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468298 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468303 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468306 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 17:05:05.516067 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468308 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468311 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468314 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468356 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468371 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468375 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468378 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468384 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468387 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468390 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468395 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468400 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468404 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468417 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468420 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468423 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468426 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468429 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468432 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 17:05:05.516630 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468435 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468437 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468440 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468442 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468445 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468447 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468451 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468454 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468456 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468459 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468461 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468464 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468467 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468470 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468472 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468475 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468479 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468482 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468485 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468487 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 17:05:05.517227 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468490 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468492 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468495 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468498 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468500 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468503 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468505 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468514 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468517 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468519 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468522 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468525 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468527 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468530 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468533 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468535 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468538 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468541 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468543 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 17:05:05.517810 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468547 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468549 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468552 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468554 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468557 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468559 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468562 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468565 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468571 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468573 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468576 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468578 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468581 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.468583 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468684 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468694 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468704 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468709 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468713 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468716 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468721 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 17:05:05.518352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468733 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468737 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468739 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468743 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468746 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468749 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468753 2581 flags.go:64] FLAG: --cgroup-root="" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468756 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468759 2581 flags.go:64] FLAG: --client-ca-file="" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468762 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468764 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468771 2581 flags.go:64] FLAG: --cluster-domain="" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468773 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468776 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468780 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468783 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468787 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468790 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468793 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468798 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468802 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468805 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468808 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468811 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 17:05:05.519020 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468814 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468819 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468822 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468824 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468827 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468832 2581 flags.go:64] FLAG: --enable-server="true" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468835 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468843 2581 flags.go:64] FLAG: --event-burst="100" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468846 2581 flags.go:64] FLAG: --event-qps="50" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468854 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468857 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468860 2581 flags.go:64] FLAG: --eviction-hard="" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468864 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468867 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468870 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468873 2581 flags.go:64] FLAG: --eviction-soft="" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468876 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468879 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468882 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468884 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468887 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468890 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468893 2581 flags.go:64] FLAG: --feature-gates="" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468897 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468900 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 17:05:05.519760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468903 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468906 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468910 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468913 2581 flags.go:64] FLAG: --help="false" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468916 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-133-26.ec2.internal" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468919 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468922 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468925 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468928 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468932 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468934 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468937 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468941 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468945 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468947 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468951 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468954 2581 flags.go:64] FLAG: --kube-reserved="" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468975 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468978 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468981 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468984 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468986 2581 flags.go:64] FLAG: --lock-file="" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468989 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468992 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 17:05:05.520715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.468995 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469001 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469004 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469007 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469009 2581 flags.go:64] FLAG: --logging-format="text" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469012 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469015 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469018 2581 flags.go:64] FLAG: --manifest-url="" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469021 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469025 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469030 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469034 2581 flags.go:64] FLAG: --max-pods="110" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469037 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469039 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469042 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469045 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469048 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469051 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469053 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469061 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469066 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469069 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469072 2581 flags.go:64] FLAG: --pod-cidr="" Jul 23 17:05:05.521588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469075 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469081 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469089 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469101 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469104 2581 flags.go:64] FLAG: --port="10250" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469107 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469110 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f8a126d58526b4b0" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469113 2581 flags.go:64] FLAG: --qos-reserved="" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469116 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469119 2581 flags.go:64] FLAG: --register-node="true" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469121 2581 flags.go:64] FLAG: --register-with-taints="" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469125 2581 flags.go:64] FLAG: --registry-burst="10" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469128 2581 flags.go:64] FLAG: --registry-qps="5" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469130 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469133 2581 flags.go:64] FLAG: --reserved-memory="" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469137 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469139 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469142 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469145 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469149 2581 flags.go:64] FLAG: --runonce="false" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469152 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469154 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469157 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469160 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469163 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469165 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 17:05:05.603093 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469168 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 17:05:05.549209 ip-10-0-133-26 systemd[1]: Started Kubernetes Kubelet. Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469171 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469174 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469177 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469181 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469183 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469186 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469189 2581 flags.go:64] FLAG: --system-cgroups="" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469192 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469197 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469208 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469211 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469218 2581 flags.go:64] FLAG: --tls-min-version="" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469221 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469223 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469226 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469229 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469232 2581 flags.go:64] FLAG: --v="2" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469236 2581 flags.go:64] FLAG: --version="false" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469240 2581 flags.go:64] FLAG: --vmodule="" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469243 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.469246 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469417 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469421 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469424 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 17:05:05.604226 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469428 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469431 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469434 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469437 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469439 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469442 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469445 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469447 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469450 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469453 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469455 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469459 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469462 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469464 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469467 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469469 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469474 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469477 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469485 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 17:05:05.605908 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469489 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469491 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469494 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469497 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469499 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469502 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469505 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469508 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469511 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469513 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469515 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469518 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469520 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469524 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469526 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469530 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469534 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469537 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469539 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 17:05:05.606699 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469542 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469544 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469546 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469549 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469551 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469555 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469557 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469560 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469562 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469565 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469568 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469570 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469572 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469583 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469586 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469588 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469591 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469593 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469597 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 17:05:05.607722 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469600 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469603 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469606 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469608 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469611 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469614 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469617 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469620 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469623 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469625 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469628 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469630 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469633 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469635 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469638 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469640 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469643 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469645 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469649 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469651 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469654 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 17:05:05.608370 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469657 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469659 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469662 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469664 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469666 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469669 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469677 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469679 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469682 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469684 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469687 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469689 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469692 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469694 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469696 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469699 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469702 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 17:05:05.609877 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.469704 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.470332 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.484001 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.484025 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.484047 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.484057 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484114 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484119 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484123 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484126 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484128 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484131 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484134 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484137 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484139 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 17:05:05.610404 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484142 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484144 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484147 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484150 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484153 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484155 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484158 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484161 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484164 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484166 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484169 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484172 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484174 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484177 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484180 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484183 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484186 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484188 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484191 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484194 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 17:05:05.610976 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484196 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484199 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484202 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484204 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484207 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484210 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484213 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484216 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484220 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484223 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484226 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484229 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484232 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484235 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484237 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484240 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484242 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484245 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484249 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 17:05:05.611561 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484253 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484257 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484259 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484262 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484264 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484267 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484270 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484273 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484275 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484278 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484281 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484284 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484286 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484289 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484291 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484294 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484297 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484300 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484302 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 17:05:05.612228 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484306 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484310 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484313 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484331 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484334 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484337 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484340 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484343 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484345 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484348 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484350 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484353 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484357 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484360 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484363 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484365 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484368 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484371 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484373 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484376 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 17:05:05.742494 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484379 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484381 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484384 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484387 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484394 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484396 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484399 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484401 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484404 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484407 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484410 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484412 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.484417 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484533 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484538 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 17:05:05.744099 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484541 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484544 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484549 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484552 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484555 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484558 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484561 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484565 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484567 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484576 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484581 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484584 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484587 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484590 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484593 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484596 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484599 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484601 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484604 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 17:05:05.744901 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484607 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484610 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484613 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484617 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484620 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484623 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484626 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484628 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484631 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484634 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484637 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484639 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484642 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484645 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484647 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484650 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484653 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484656 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484659 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484661 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 17:05:05.746743 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484664 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484666 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484671 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484673 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484677 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484679 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484682 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484685 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484687 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484689 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484692 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484694 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484697 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484699 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484702 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484705 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484708 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484711 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484713 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484716 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 17:05:05.747870 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484718 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484720 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484723 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484726 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484728 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484731 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484733 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484736 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484738 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484741 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484745 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484748 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484751 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484754 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484758 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484761 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484764 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484767 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484770 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 17:05:05.749038 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484772 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484775 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484777 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484780 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484782 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484784 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484787 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484789 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484793 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484796 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484799 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484801 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484804 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484806 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484808 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484811 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484815 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484817 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 17:05:05.751111 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:05.484820 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.484825 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.484943 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.487196 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.488707 2581 server.go:1019] "Starting client certificate rotation" Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.488821 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.488859 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.491498 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.493234 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.502861 2581 log.go:25] "Validated CRI v1 runtime API" Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.511935 2581 log.go:25] "Validated CRI v1 image API" Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.514081 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 17:05:05.752022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.516362 2581 fs.go:135] Filesystem UUIDs: map[28fa7862-f019-4a4c-a187-08a7723d536a:/dev/nvme0n1p4 557b3492-ef57-48f0-9e61-3cfc89a709a0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 23 17:05:05.753698 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.516378 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 17:05:05.753698 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.521388 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.524425 2581 manager.go:216] Machine: {Timestamp:2026-07-23 17:05:05.523186991 +0000 UTC m=+0.327831879 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114592 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24e02ad76dd3dfa6875bb1dbae88e2 SystemUUID:ec24e02a-d76d-d3df-a687-5bb1dbae88e2 BootID:7c162154-c478-4e55-b255-ed52dd5713e2 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:36:69:30:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:36:69:30:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:4a:a6:de:93:32 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.524545 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.524646 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.527201 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.527228 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.527898 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.527908 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.527916 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.528624 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.530270 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.533495 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.533606 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.533632 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.533641 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.533655 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.533663 2581 kubelet.go:398] "Adding apiserver pod source" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.533673 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 17:05:05.755289 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.533986 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.534000 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.536650 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.538238 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.543606 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544354 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544373 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544383 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544390 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544402 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544410 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544418 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544424 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544433 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544439 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544447 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.544452 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.545128 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.545135 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.548274 2581 server.go:1268] "Started kubelet" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.548378 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.548404 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.548470 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.550198 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.550212 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k8gzm" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.550476 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.550494 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.552120 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.554117 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.556308 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.560903 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.561131 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.562888 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.562925 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.563351 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.563361 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.563662 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.563673 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.566854 2581 factory.go:55] Registering systemd factory Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.566900 2581 factory.go:223] Registration of the systemd container factory successfully Jul 23 17:05:05.756220 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.564502 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-26.ec2.internal.18c4fa1187f9f091 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-26.ec2.internal,UID:ip-10-0-133-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-26.ec2.internal,},FirstTimestamp:2026-07-23 17:05:05.548251281 +0000 UTC m=+0.352896170,LastTimestamp:2026-07-23 17:05:05.548251281 +0000 UTC m=+0.352896170,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-26.ec2.internal,}" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.567080 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k8gzm" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.567216 2581 factory.go:153] Registering CRI-O factory Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.567235 2581 factory.go:223] Registration of the crio container factory successfully Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.567290 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.567327 2581 factory.go:103] Registering Raw factory Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.567343 2581 manager.go:1196] Started watching for new ooms in manager Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.568086 2581 manager.go:349] Starting recovery of all containers Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.570395 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.570510 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.578094 2581 manager.go:354] Recovery completed Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.582240 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.587512 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientMemory" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.587679 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.587693 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientPID" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.588530 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.588544 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.588555 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.588570 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.589301 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientMemory" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.589339 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.589352 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientPID" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.589652 2581 policy_none.go:49] "None policy: Start" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.589665 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.589675 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.590022 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-26.ec2.internal.18c4fa118a5343fa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-26.ec2.internal,UID:ip-10-0-133-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-26.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-26.ec2.internal,},FirstTimestamp:2026-07-23 17:05:05.58765977 +0000 UTC m=+0.392304658,LastTimestamp:2026-07-23 17:05:05.58765977 +0000 UTC m=+0.392304658,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-26.ec2.internal,}" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.590563 2581 policy_none.go:47] "Start" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.619777 2581 manager.go:337] "Starting Device Plugin manager" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.619833 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.619848 2581 server.go:87] "Starting device plugin registration server" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.620114 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.620124 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.620248 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.620373 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.620385 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.620894 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.620937 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.721174 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.722941 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientMemory" Jul 23 17:05:05.758126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.722981 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 17:05:05.759957 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.722996 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientPID" Jul 23 17:05:05.759957 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.723032 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-26.ec2.internal" Jul 23 17:05:05.759957 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.730598 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-26.ec2.internal" Jul 23 17:05:05.759957 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.730620 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-26.ec2.internal\": node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:05.759957 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.744110 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:05.877078 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.814740 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 17:05:05.877078 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.816327 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 17:05:05.877078 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.816365 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 17:05:05.877078 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.816388 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 17:05:05.877078 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.816447 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 17:05:05.877078 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.820628 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 17:05:05.877078 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.844463 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.917966 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-26.ec2.internal"] Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.918076 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.920657 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientMemory" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.920696 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.920712 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientPID" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.922050 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.922200 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.922241 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.922907 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientMemory" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.922931 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.922944 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientPID" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.922955 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientMemory" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.922981 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.922995 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientPID" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.924305 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-26.ec2.internal" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.924331 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.925048 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientMemory" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.925075 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.925088 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeHasSufficientPID" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.945357 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.950379 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-26.ec2.internal\" not found" node="ip-10-0-133-26.ec2.internal" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:05.956643 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-26.ec2.internal\" not found" node="ip-10-0-133-26.ec2.internal" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.965826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd213ca292eddf0c2794f6b5c3faa4a3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-26.ec2.internal\" (UID: \"cd213ca292eddf0c2794f6b5c3faa4a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-26.ec2.internal" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.965861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbc29de0037d9132592f3e17fa9e62a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal\" (UID: \"dbc29de0037d9132592f3e17fa9e62a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" Jul 23 17:05:05.971285 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:05.965894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbc29de0037d9132592f3e17fa9e62a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal\" (UID: \"dbc29de0037d9132592f3e17fa9e62a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" Jul 23 17:05:06.081872 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:06.045896 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:06.081872 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.066991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd213ca292eddf0c2794f6b5c3faa4a3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-26.ec2.internal\" (UID: \"cd213ca292eddf0c2794f6b5c3faa4a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-26.ec2.internal" Jul 23 17:05:06.081872 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.067033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbc29de0037d9132592f3e17fa9e62a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal\" (UID: \"dbc29de0037d9132592f3e17fa9e62a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" Jul 23 17:05:06.081872 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.067052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbc29de0037d9132592f3e17fa9e62a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal\" (UID: \"dbc29de0037d9132592f3e17fa9e62a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" Jul 23 17:05:06.081872 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.067109 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbc29de0037d9132592f3e17fa9e62a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal\" (UID: \"dbc29de0037d9132592f3e17fa9e62a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" Jul 23 17:05:06.081872 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.067120 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd213ca292eddf0c2794f6b5c3faa4a3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-26.ec2.internal\" (UID: \"cd213ca292eddf0c2794f6b5c3faa4a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-26.ec2.internal" Jul 23 17:05:06.081872 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.067157 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbc29de0037d9132592f3e17fa9e62a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal\" (UID: \"dbc29de0037d9132592f3e17fa9e62a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" Jul 23 17:05:06.201691 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:06.146783 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:06.328088 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:06.247782 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:06.328088 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.253443 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" Jul 23 17:05:06.328088 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.261495 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-26.ec2.internal" Jul 23 17:05:06.427884 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:06.348176 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:06.521241 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:06.449165 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:06.521241 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.509173 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 17:05:06.521241 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.509400 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 17:05:06.550171 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:06.550132 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:06.575456 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.575394 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 17:00:06 +0000 UTC" deadline="2028-04-29 17:43:08.685574554 +0000 UTC" Jul 23 17:05:06.575456 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.575449 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15504h38m2.110129323s" Jul 23 17:05:06.642418 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.642326 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 17:05:06.651373 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:06.651351 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:06.711223 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.711200 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 17:05:06.751587 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:06.751553 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:06.853495 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:06.853463 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-26.ec2.internal\" not found" Jul 23 17:05:06.904243 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.904164 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 17:05:06.963879 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.963851 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" Jul 23 17:05:06.976563 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.976542 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 17:05:06.977612 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.977597 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-26.ec2.internal" Jul 23 17:05:06.987941 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:06.987920 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 17:05:07.082724 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:07.082672 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd213ca292eddf0c2794f6b5c3faa4a3.slice/crio-55f232400ea213af8c8c54625ad3a1a329b19403afa70c0291191908a859663d WatchSource:0}: Error finding container 55f232400ea213af8c8c54625ad3a1a329b19403afa70c0291191908a859663d: Status 404 returned error can't find the container with id 55f232400ea213af8c8c54625ad3a1a329b19403afa70c0291191908a859663d Jul 23 17:05:07.083135 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:07.083110 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc29de0037d9132592f3e17fa9e62a4.slice/crio-c9b9b3cd5edc9c9f8a8ac82ed2f1922be40b06441df9556c65b74ba473a4f5bb WatchSource:0}: Error finding container c9b9b3cd5edc9c9f8a8ac82ed2f1922be40b06441df9556c65b74ba473a4f5bb: Status 404 returned error can't find the container with id c9b9b3cd5edc9c9f8a8ac82ed2f1922be40b06441df9556c65b74ba473a4f5bb Jul 23 17:05:07.088712 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.088692 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 17:05:07.534945 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.534910 2581 apiserver.go:52] "Watching apiserver" Jul 23 17:05:07.542905 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.542876 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 17:05:07.544182 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.544148 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-wrj4r","openshift-cluster-node-tuning-operator/tuned-wmrmr","openshift-multus/multus-additional-cni-plugins-d6np7","openshift-network-diagnostics/network-check-target-4dhpn","openshift-network-operator/iptables-alerter-tg94n","openshift-ovn-kubernetes/ovnkube-node-9bc2p","kube-system/global-pull-secret-syncer-9jkkx","kube-system/kube-apiserver-proxy-ip-10-0-133-26.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p","openshift-dns/node-resolver-m2wrn","openshift-image-registry/node-ca-2x4jv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal","openshift-multus/multus-wpt7k","openshift-multus/network-metrics-daemon-pkn2c"] Jul 23 17:05:07.547047 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.547025 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:07.547167 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:07.547107 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:07.549803 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.549707 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.553460 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.553438 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 17:05:07.553572 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.553531 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4q96l\"" Jul 23 17:05:07.553633 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.553437 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 17:05:07.553683 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.553441 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 17:05:07.553857 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.553840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.554152 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.554131 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 17:05:07.556880 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.556861 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:07.556971 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:07.556931 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:07.557966 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.557948 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ggqzl\"" Jul 23 17:05:07.558287 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.558267 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 17:05:07.558647 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.558627 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 17:05:07.559570 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.559551 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tg94n" Jul 23 17:05:07.562135 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.562118 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 17:05:07.562367 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.562125 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.562515 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.562487 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 17:05:07.563095 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.562770 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zmzlg\"" Jul 23 17:05:07.563095 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.563061 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 17:05:07.563553 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.563060 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 17:05:07.564432 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.564413 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.566995 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.566945 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:07.569684 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.569651 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.573892 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.573334 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m2wrn" Jul 23 17:05:07.574631 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.574461 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579270 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-run-systemd\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-etc-openvswitch\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/068419c3-d512-409e-9d03-7cd312f55176-ovnkube-script-lib\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/143e3a8b-7387-4e40-86c9-455659d49a11-kubelet-config\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-etc-kubernetes\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scrfn\" (UniqueName: \"kubernetes.io/projected/2f6b05dc-d0e8-42f3-ab51-ddae9620981e-kube-api-access-scrfn\") pod \"iptables-alerter-tg94n\" (UID: \"2f6b05dc-d0e8-42f3-ab51-ddae9620981e\") " pod="openshift-network-operator/iptables-alerter-tg94n" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579487 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/625b4209-c14c-43de-882f-eab52363748a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/143e3a8b-7387-4e40-86c9-455659d49a11-dbus\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-run-k8s-cni-cncf-io\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-var-lib-kubelet\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn4v4\" (UniqueName: \"kubernetes.io/projected/c3af84a5-d78f-4910-b755-58601d552dad-kube-api-access-qn4v4\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-os-release\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-cnibin\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-systemd-units\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.583565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/068419c3-d512-409e-9d03-7cd312f55176-env-overrides\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-socket-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579863 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktbd5\" (UniqueName: \"kubernetes.io/projected/2bb86819-22f8-447f-8a7f-e412e79289ff-kube-api-access-ktbd5\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-run-multus-certs\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/625b4209-c14c-43de-882f-eab52363748a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/068419c3-d512-409e-9d03-7cd312f55176-ovnkube-config\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.579986 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-device-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580057 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjdbs\" (UniqueName: \"kubernetes.io/projected/625b4209-c14c-43de-882f-eab52363748a-kube-api-access-gjdbs\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580086 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-cnibin\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-multus-cni-dir\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580145 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3af84a5-d78f-4910-b755-58601d552dad-multus-daemon-config\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f6b05dc-d0e8-42f3-ab51-ddae9620981e-iptables-alerter-script\") pod \"iptables-alerter-tg94n\" (UID: \"2f6b05dc-d0e8-42f3-ab51-ddae9620981e\") " pod="openshift-network-operator/iptables-alerter-tg94n" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/625b4209-c14c-43de-882f-eab52363748a-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwbsz\" (UniqueName: \"kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz\") pod \"network-check-target-4dhpn\" (UID: \"738de34f-79ac-4451-b70c-4fb110a01fa0\") " pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:07.584352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580727 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-var-lib-openvswitch\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-run-ovn\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580818 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-cni-netd\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/068419c3-d512-409e-9d03-7cd312f55176-ovn-node-metrics-cert\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580883 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-multus-socket-dir-parent\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-hostroot\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.580971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-kubelet\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-slash\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581030 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-run-netns\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-run-openvswitch\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581084 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-cni-bin\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581117 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-log-socket\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd49v\" (UniqueName: \"kubernetes.io/projected/068419c3-d512-409e-9d03-7cd312f55176-kube-api-access-kd49v\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-system-cni-dir\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.585066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-var-lib-cni-bin\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-var-lib-cni-multus\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f6b05dc-d0e8-42f3-ab51-ddae9620981e-host-slash\") pod \"iptables-alerter-tg94n\" (UID: \"2f6b05dc-d0e8-42f3-ab51-ddae9620981e\") " pod="openshift-network-operator/iptables-alerter-tg94n" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581295 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-system-cni-dir\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-run-ovn-kubernetes\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581375 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-registration-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581555 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-sys-fs\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-os-release\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3af84a5-d78f-4910-b755-58601d552dad-cni-binary-copy\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-run-netns\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-multus-conf-dir\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.581779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-node-log\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.583498 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.584416 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.584786 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.585042 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.585371 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 17:05:07.585890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.585761 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 17:05:07.586763 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.586067 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wdkhj\"" Jul 23 17:05:07.586763 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.586343 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 17:05:07.586763 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.586645 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 17:05:07.586763 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.586726 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r689f\"" Jul 23 17:05:07.588557 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.586974 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 17:05:07.588557 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.586982 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 17:05:07.588557 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.587039 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 17:05:07.588557 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.587186 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7rq6j\"" Jul 23 17:05:07.588557 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.587189 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9nkvn\"" Jul 23 17:05:07.588557 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.587220 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 17:05:07.588557 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.587298 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 17:05:07.588557 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.587576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2x4jv" Jul 23 17:05:07.588557 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.587784 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 17:05:07.588557 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.588028 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8q4fd\"" Jul 23 17:05:07.591158 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.591139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:07.591266 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:07.591211 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:07.596119 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.596072 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 17:05:07.596341 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.596320 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 17:05:07.597090 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.597069 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 17:05:07.597236 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.597218 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c5cv9\"" Jul 23 17:05:07.602183 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.602163 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 17:05:07.647957 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.647917 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x69hx" Jul 23 17:05:07.661671 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.661646 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x69hx" Jul 23 17:05:07.664862 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.664835 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 17:05:07.682419 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-run-k8s-cni-cncf-io\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.682419 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-var-lib-kubelet\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.682577 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn4v4\" (UniqueName: \"kubernetes.io/projected/c3af84a5-d78f-4910-b755-58601d552dad-kube-api-access-qn4v4\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.682577 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-os-release\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.682577 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf506efa-b074-4b87-b481-a44b1638de43-agent-certs\") pod \"konnectivity-agent-wrj4r\" (UID: \"cf506efa-b074-4b87-b481-a44b1638de43\") " pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:07.682577 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf506efa-b074-4b87-b481-a44b1638de43-konnectivity-ca\") pod \"konnectivity-agent-wrj4r\" (UID: \"cf506efa-b074-4b87-b481-a44b1638de43\") " pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:07.682577 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-systemd\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682579 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-run-k8s-cni-cncf-io\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682579 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-var-lib-kubelet\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-cnibin\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-systemd-units\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/068419c3-d512-409e-9d03-7cd312f55176-env-overrides\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682673 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-cnibin\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-socket-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682734 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59f02c49-1ffd-40ec-b7d4-9f038b855d9d-serviceca\") pod \"node-ca-2x4jv\" (UID: \"59f02c49-1ffd-40ec-b7d4-9f038b855d9d\") " pod="openshift-image-registry/node-ca-2x4jv" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktbd5\" (UniqueName: \"kubernetes.io/projected/2bb86819-22f8-447f-8a7f-e412e79289ff-kube-api-access-ktbd5\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-sysctl-d\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-run\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.682815 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:07.682817 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-run-multus-certs\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682899 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-run-multus-certs\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:07.682904 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret podName:143e3a8b-7387-4e40-86c9-455659d49a11 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:08.182870148 +0000 UTC m=+2.987515029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret") pod "global-pull-secret-syncer-9jkkx" (UID: "143e3a8b-7387-4e40-86c9-455659d49a11") : object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/625b4209-c14c-43de-882f-eab52363748a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682967 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-systemd-units\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/068419c3-d512-409e-9d03-7cd312f55176-ovnkube-config\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-device-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-host\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.682914 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-os-release\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjdbs\" (UniqueName: \"kubernetes.io/projected/625b4209-c14c-43de-882f-eab52363748a-kube-api-access-gjdbs\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vkdr\" (UniqueName: \"kubernetes.io/projected/51ab9b9c-f852-4682-8b4b-15c8660427fc-kube-api-access-8vkdr\") pod \"node-resolver-m2wrn\" (UID: \"51ab9b9c-f852-4682-8b4b-15c8660427fc\") " pod="openshift-dns/node-resolver-m2wrn" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-cnibin\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.683189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-kubernetes\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.683720 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-tuned\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.683720 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683228 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-multus-cni-dir\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.683720 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3af84a5-d78f-4910-b755-58601d552dad-multus-daemon-config\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.683720 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-lib-modules\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.683720 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683472 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/068419c3-d512-409e-9d03-7cd312f55176-env-overrides\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.683720 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683483 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.683720 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683588 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-socket-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.683720 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683654 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-cnibin\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.684102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683738 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-device-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.684102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-multus-cni-dir\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.684102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvf7n\" (UniqueName: \"kubernetes.io/projected/822c7016-9ec7-43e1-be4b-7c764274e4b2-kube-api-access-qvf7n\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.684102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683894 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c3af84a5-d78f-4910-b755-58601d552dad-multus-daemon-config\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.684102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f6b05dc-d0e8-42f3-ab51-ddae9620981e-iptables-alerter-script\") pod \"iptables-alerter-tg94n\" (UID: \"2f6b05dc-d0e8-42f3-ab51-ddae9620981e\") " pod="openshift-network-operator/iptables-alerter-tg94n" Jul 23 17:05:07.684102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/625b4209-c14c-43de-882f-eab52363748a-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.684102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.683976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbsz\" (UniqueName: \"kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz\") pod \"network-check-target-4dhpn\" (UID: \"738de34f-79ac-4451-b70c-4fb110a01fa0\") " pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:07.684102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684004 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-var-lib-openvswitch\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-run-ovn\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684110 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-cni-netd\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/068419c3-d512-409e-9d03-7cd312f55176-ovn-node-metrics-cert\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59f02c49-1ffd-40ec-b7d4-9f038b855d9d-host\") pod \"node-ca-2x4jv\" (UID: \"59f02c49-1ffd-40ec-b7d4-9f038b855d9d\") " pod="openshift-image-registry/node-ca-2x4jv" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-multus-socket-dir-parent\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-hostroot\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/625b4209-c14c-43de-882f-eab52363748a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-kubelet\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684342 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-run-ovn\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-slash\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-hostroot\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684366 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/068419c3-d512-409e-9d03-7cd312f55176-ovnkube-config\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-run-netns\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684432 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684436 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-run-openvswitch\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684471 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-run-openvswitch\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.684662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-cni-bin\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684504 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-cni-netd\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684634 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-cni-bin\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684681 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-var-lib-openvswitch\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684738 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-log-socket\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd49v\" (UniqueName: \"kubernetes.io/projected/068419c3-d512-409e-9d03-7cd312f55176-kube-api-access-kd49v\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-sys\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684869 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2f6b05dc-d0e8-42f3-ab51-ddae9620981e-iptables-alerter-script\") pod \"iptables-alerter-tg94n\" (UID: \"2f6b05dc-d0e8-42f3-ab51-ddae9620981e\") " pod="openshift-network-operator/iptables-alerter-tg94n" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684884 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-var-lib-kubelet\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/822c7016-9ec7-43e1-be4b-7c764274e4b2-tmp\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684975 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-log-socket\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.684981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-system-cni-dir\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-var-lib-cni-bin\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-var-lib-cni-multus\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685044 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-multus-socket-dir-parent\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685057 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685069 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51ab9b9c-f852-4682-8b4b-15c8660427fc-hosts-file\") pod \"node-resolver-m2wrn\" (UID: \"51ab9b9c-f852-4682-8b4b-15c8660427fc\") " pod="openshift-dns/node-resolver-m2wrn" Jul 23 17:05:07.685502 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bwnv\" (UniqueName: \"kubernetes.io/projected/95a6dc4e-bc5f-40b0-96e4-a57065d23833-kube-api-access-9bwnv\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f6b05dc-d0e8-42f3-ab51-ddae9620981e-host-slash\") pod \"iptables-alerter-tg94n\" (UID: \"2f6b05dc-d0e8-42f3-ab51-ddae9620981e\") " pod="openshift-network-operator/iptables-alerter-tg94n" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685152 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-system-cni-dir\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-run-ovn-kubernetes\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685187 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685102 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-kubelet\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-var-lib-cni-multus\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685264 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-registration-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-sys-fs\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51ab9b9c-f852-4682-8b4b-15c8660427fc-tmp-dir\") pod \"node-resolver-m2wrn\" (UID: \"51ab9b9c-f852-4682-8b4b-15c8660427fc\") " pod="openshift-dns/node-resolver-m2wrn" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685385 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-run-ovn-kubernetes\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685411 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-system-cni-dir\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685451 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-run-netns\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685458 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-host-slash\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685447 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-var-lib-cni-bin\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685483 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.686490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685486 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/625b4209-c14c-43de-882f-eab52363748a-system-cni-dir\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685500 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-registration-dir\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685501 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f6b05dc-d0e8-42f3-ab51-ddae9620981e-host-slash\") pod \"iptables-alerter-tg94n\" (UID: \"2f6b05dc-d0e8-42f3-ab51-ddae9620981e\") " pod="openshift-network-operator/iptables-alerter-tg94n" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-os-release\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685559 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2bb86819-22f8-447f-8a7f-e412e79289ff-sys-fs\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3af84a5-d78f-4910-b755-58601d552dad-cni-binary-copy\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685635 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-os-release\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-run-netns\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685797 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/625b4209-c14c-43de-882f-eab52363748a-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685848 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-host-run-netns\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-multus-conf-dir\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685913 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-multus-conf-dir\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.685958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-node-log\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686007 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-node-log\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-modprobe-d\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-run-systemd\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686124 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c3af84a5-d78f-4910-b755-58601d552dad-cni-binary-copy\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-etc-openvswitch\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.687334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686144 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-run-systemd\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686188 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/068419c3-d512-409e-9d03-7cd312f55176-ovnkube-script-lib\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686220 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/068419c3-d512-409e-9d03-7cd312f55176-etc-openvswitch\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-sysconfig\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rf5s\" (UniqueName: \"kubernetes.io/projected/59f02c49-1ffd-40ec-b7d4-9f038b855d9d-kube-api-access-2rf5s\") pod \"node-ca-2x4jv\" (UID: \"59f02c49-1ffd-40ec-b7d4-9f038b855d9d\") " pod="openshift-image-registry/node-ca-2x4jv" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/143e3a8b-7387-4e40-86c9-455659d49a11-kubelet-config\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-etc-kubernetes\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686449 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scrfn\" (UniqueName: \"kubernetes.io/projected/2f6b05dc-d0e8-42f3-ab51-ddae9620981e-kube-api-access-scrfn\") pod \"iptables-alerter-tg94n\" (UID: \"2f6b05dc-d0e8-42f3-ab51-ddae9620981e\") " pod="openshift-network-operator/iptables-alerter-tg94n" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/143e3a8b-7387-4e40-86c9-455659d49a11-kubelet-config\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/625b4209-c14c-43de-882f-eab52363748a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-sysctl-conf\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/143e3a8b-7387-4e40-86c9-455659d49a11-dbus\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686739 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/143e3a8b-7387-4e40-86c9-455659d49a11-dbus\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686744 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3af84a5-d78f-4910-b755-58601d552dad-etc-kubernetes\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.686793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/068419c3-d512-409e-9d03-7cd312f55176-ovnkube-script-lib\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.688198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.687776 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/625b4209-c14c-43de-882f-eab52363748a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.689760 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.689717 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/068419c3-d512-409e-9d03-7cd312f55176-ovn-node-metrics-cert\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.696669 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.696605 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn4v4\" (UniqueName: \"kubernetes.io/projected/c3af84a5-d78f-4910-b755-58601d552dad-kube-api-access-qn4v4\") pod \"multus-wpt7k\" (UID: \"c3af84a5-d78f-4910-b755-58601d552dad\") " pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.701942 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:07.701921 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 17:05:07.702038 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:07.701950 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 17:05:07.702038 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:07.701965 2581 projected.go:196] Error preparing data for projected volume kube-api-access-pwbsz for pod openshift-network-diagnostics/network-check-target-4dhpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:07.702038 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:07.702034 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz podName:738de34f-79ac-4451-b70c-4fb110a01fa0 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:08.202017605 +0000 UTC m=+3.006662498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pwbsz" (UniqueName: "kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz") pod "network-check-target-4dhpn" (UID: "738de34f-79ac-4451-b70c-4fb110a01fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:07.704905 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.704854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scrfn\" (UniqueName: \"kubernetes.io/projected/2f6b05dc-d0e8-42f3-ab51-ddae9620981e-kube-api-access-scrfn\") pod \"iptables-alerter-tg94n\" (UID: \"2f6b05dc-d0e8-42f3-ab51-ddae9620981e\") " pod="openshift-network-operator/iptables-alerter-tg94n" Jul 23 17:05:07.705768 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.705741 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjdbs\" (UniqueName: \"kubernetes.io/projected/625b4209-c14c-43de-882f-eab52363748a-kube-api-access-gjdbs\") pod \"multus-additional-cni-plugins-d6np7\" (UID: \"625b4209-c14c-43de-882f-eab52363748a\") " pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.707718 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.707692 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd49v\" (UniqueName: \"kubernetes.io/projected/068419c3-d512-409e-9d03-7cd312f55176-kube-api-access-kd49v\") pod \"ovnkube-node-9bc2p\" (UID: \"068419c3-d512-409e-9d03-7cd312f55176\") " pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.707960 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.707939 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktbd5\" (UniqueName: \"kubernetes.io/projected/2bb86819-22f8-447f-8a7f-e412e79289ff-kube-api-access-ktbd5\") pod \"aws-ebs-csi-driver-node-tbh4p\" (UID: \"2bb86819-22f8-447f-8a7f-e412e79289ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.787678 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59f02c49-1ffd-40ec-b7d4-9f038b855d9d-host\") pod \"node-ca-2x4jv\" (UID: \"59f02c49-1ffd-40ec-b7d4-9f038b855d9d\") " pod="openshift-image-registry/node-ca-2x4jv" Jul 23 17:05:07.787678 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:07.787678 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-sys\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.787959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-var-lib-kubelet\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.787959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/822c7016-9ec7-43e1-be4b-7c764274e4b2-tmp\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.787959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51ab9b9c-f852-4682-8b4b-15c8660427fc-hosts-file\") pod \"node-resolver-m2wrn\" (UID: \"51ab9b9c-f852-4682-8b4b-15c8660427fc\") " pod="openshift-dns/node-resolver-m2wrn" Jul 23 17:05:07.787959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bwnv\" (UniqueName: \"kubernetes.io/projected/95a6dc4e-bc5f-40b0-96e4-a57065d23833-kube-api-access-9bwnv\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:07.787959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51ab9b9c-f852-4682-8b4b-15c8660427fc-tmp-dir\") pod \"node-resolver-m2wrn\" (UID: \"51ab9b9c-f852-4682-8b4b-15c8660427fc\") " pod="openshift-dns/node-resolver-m2wrn" Jul 23 17:05:07.787959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-modprobe-d\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.787959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-sysconfig\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.787959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rf5s\" (UniqueName: \"kubernetes.io/projected/59f02c49-1ffd-40ec-b7d4-9f038b855d9d-kube-api-access-2rf5s\") pod \"node-ca-2x4jv\" (UID: \"59f02c49-1ffd-40ec-b7d4-9f038b855d9d\") " pod="openshift-image-registry/node-ca-2x4jv" Jul 23 17:05:07.787959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.787900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-sysctl-conf\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.788578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf506efa-b074-4b87-b481-a44b1638de43-agent-certs\") pod \"konnectivity-agent-wrj4r\" (UID: \"cf506efa-b074-4b87-b481-a44b1638de43\") " pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.788784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf506efa-b074-4b87-b481-a44b1638de43-konnectivity-ca\") pod \"konnectivity-agent-wrj4r\" (UID: \"cf506efa-b074-4b87-b481-a44b1638de43\") " pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.788823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-systemd\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.792460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59f02c49-1ffd-40ec-b7d4-9f038b855d9d-serviceca\") pod \"node-ca-2x4jv\" (UID: \"59f02c49-1ffd-40ec-b7d4-9f038b855d9d\") " pod="openshift-image-registry/node-ca-2x4jv" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.792518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-sysctl-d\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.792553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-run\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.792588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-host\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.792616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vkdr\" (UniqueName: \"kubernetes.io/projected/51ab9b9c-f852-4682-8b4b-15c8660427fc-kube-api-access-8vkdr\") pod \"node-resolver-m2wrn\" (UID: \"51ab9b9c-f852-4682-8b4b-15c8660427fc\") " pod="openshift-dns/node-resolver-m2wrn" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.792649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-kubernetes\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.792680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-tuned\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.792717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-lib-modules\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.792742 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvf7n\" (UniqueName: \"kubernetes.io/projected/822c7016-9ec7-43e1-be4b-7c764274e4b2-kube-api-access-qvf7n\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.793613 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59f02c49-1ffd-40ec-b7d4-9f038b855d9d-serviceca\") pod \"node-ca-2x4jv\" (UID: \"59f02c49-1ffd-40ec-b7d4-9f038b855d9d\") " pod="openshift-image-registry/node-ca-2x4jv" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.793823 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-sysctl-d\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.793886 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-run\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.793939 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-host\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.794244 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-kubernetes\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.795600 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.794773 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-sys\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.794808 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-lib-modules\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.794865 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59f02c49-1ffd-40ec-b7d4-9f038b855d9d-host\") pod \"node-ca-2x4jv\" (UID: \"59f02c49-1ffd-40ec-b7d4-9f038b855d9d\") " pod="openshift-image-registry/node-ca-2x4jv" Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.794965 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-sysctl-conf\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:07.794970 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:07.795050 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs podName:95a6dc4e-bc5f-40b0-96e4-a57065d23833 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:08.295030159 +0000 UTC m=+3.099675040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs") pod "network-metrics-daemon-pkn2c" (UID: "95a6dc4e-bc5f-40b0-96e4-a57065d23833") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.795148 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-var-lib-kubelet\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.795157 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-modprobe-d\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.795249 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51ab9b9c-f852-4682-8b4b-15c8660427fc-hosts-file\") pod \"node-resolver-m2wrn\" (UID: \"51ab9b9c-f852-4682-8b4b-15c8660427fc\") " pod="openshift-dns/node-resolver-m2wrn" Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.795313 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-sysconfig\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.795486 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51ab9b9c-f852-4682-8b4b-15c8660427fc-tmp-dir\") pod \"node-resolver-m2wrn\" (UID: \"51ab9b9c-f852-4682-8b4b-15c8660427fc\") " pod="openshift-dns/node-resolver-m2wrn" Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.795803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf506efa-b074-4b87-b481-a44b1638de43-konnectivity-ca\") pod \"konnectivity-agent-wrj4r\" (UID: \"cf506efa-b074-4b87-b481-a44b1638de43\") " pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:07.796540 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.796378 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-systemd\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.799008 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.798983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/822c7016-9ec7-43e1-be4b-7c764274e4b2-etc-tuned\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.800997 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.800946 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf506efa-b074-4b87-b481-a44b1638de43-agent-certs\") pod \"konnectivity-agent-wrj4r\" (UID: \"cf506efa-b074-4b87-b481-a44b1638de43\") " pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:07.802449 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.802385 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/822c7016-9ec7-43e1-be4b-7c764274e4b2-tmp\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.805287 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.805263 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rf5s\" (UniqueName: \"kubernetes.io/projected/59f02c49-1ffd-40ec-b7d4-9f038b855d9d-kube-api-access-2rf5s\") pod \"node-ca-2x4jv\" (UID: \"59f02c49-1ffd-40ec-b7d4-9f038b855d9d\") " pod="openshift-image-registry/node-ca-2x4jv" Jul 23 17:05:07.805898 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.805854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bwnv\" (UniqueName: \"kubernetes.io/projected/95a6dc4e-bc5f-40b0-96e4-a57065d23833-kube-api-access-9bwnv\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:07.806283 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.806205 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvf7n\" (UniqueName: \"kubernetes.io/projected/822c7016-9ec7-43e1-be4b-7c764274e4b2-kube-api-access-qvf7n\") pod \"tuned-wmrmr\" (UID: \"822c7016-9ec7-43e1-be4b-7c764274e4b2\") " pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.807127 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.807082 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vkdr\" (UniqueName: \"kubernetes.io/projected/51ab9b9c-f852-4682-8b4b-15c8660427fc-kube-api-access-8vkdr\") pod \"node-resolver-m2wrn\" (UID: \"51ab9b9c-f852-4682-8b4b-15c8660427fc\") " pod="openshift-dns/node-resolver-m2wrn" Jul 23 17:05:07.822976 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.822881 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-26.ec2.internal" event={"ID":"cd213ca292eddf0c2794f6b5c3faa4a3","Type":"ContainerStarted","Data":"55f232400ea213af8c8c54625ad3a1a329b19403afa70c0291191908a859663d"} Jul 23 17:05:07.826546 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.826515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" event={"ID":"dbc29de0037d9132592f3e17fa9e62a4","Type":"ContainerStarted","Data":"c9b9b3cd5edc9c9f8a8ac82ed2f1922be40b06441df9556c65b74ba473a4f5bb"} Jul 23 17:05:07.864708 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.864673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wpt7k" Jul 23 17:05:07.872809 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.872785 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d6np7" Jul 23 17:05:07.876037 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:07.875995 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3af84a5_d78f_4910_b755_58601d552dad.slice/crio-c03f0a76c99ab28b6d5653c2b95383da27fcc1f67edbf908e61a85584d3784f6 WatchSource:0}: Error finding container c03f0a76c99ab28b6d5653c2b95383da27fcc1f67edbf908e61a85584d3784f6: Status 404 returned error can't find the container with id c03f0a76c99ab28b6d5653c2b95383da27fcc1f67edbf908e61a85584d3784f6 Jul 23 17:05:07.882603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:07.882569 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625b4209_c14c_43de_882f_eab52363748a.slice/crio-640283fbb96f256137299047bfdc606cf72610d00417f50dbb14a12f2b1487a5 WatchSource:0}: Error finding container 640283fbb96f256137299047bfdc606cf72610d00417f50dbb14a12f2b1487a5: Status 404 returned error can't find the container with id 640283fbb96f256137299047bfdc606cf72610d00417f50dbb14a12f2b1487a5 Jul 23 17:05:07.893736 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.893708 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tg94n" Jul 23 17:05:07.903966 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.903939 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:07.905280 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:07.905245 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6b05dc_d0e8_42f3_ab51_ddae9620981e.slice/crio-cfadf5150f40ad87d9d25679b22ba4c9f38a932f18add577916083691d8924dc WatchSource:0}: Error finding container cfadf5150f40ad87d9d25679b22ba4c9f38a932f18add577916083691d8924dc: Status 404 returned error can't find the container with id cfadf5150f40ad87d9d25679b22ba4c9f38a932f18add577916083691d8924dc Jul 23 17:05:07.912981 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.912777 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" Jul 23 17:05:07.915248 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:07.915217 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068419c3_d512_409e_9d03_7cd312f55176.slice/crio-fc5c43d9e746be59120e42fb0cb23678a1b3a168d2cb37d48e71f1eee3b8090f WatchSource:0}: Error finding container fc5c43d9e746be59120e42fb0cb23678a1b3a168d2cb37d48e71f1eee3b8090f: Status 404 returned error can't find the container with id fc5c43d9e746be59120e42fb0cb23678a1b3a168d2cb37d48e71f1eee3b8090f Jul 23 17:05:07.922700 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.922675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:07.933003 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.932976 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" Jul 23 17:05:07.934505 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:07.934464 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf506efa_b074_4b87_b481_a44b1638de43.slice/crio-02c77a733d8fd3a518f52cdc82d56d85324e1001cfe86d7388faee9096bd9b76 WatchSource:0}: Error finding container 02c77a733d8fd3a518f52cdc82d56d85324e1001cfe86d7388faee9096bd9b76: Status 404 returned error can't find the container with id 02c77a733d8fd3a518f52cdc82d56d85324e1001cfe86d7388faee9096bd9b76 Jul 23 17:05:07.943677 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.943478 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m2wrn" Jul 23 17:05:07.944361 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:07.944317 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822c7016_9ec7_43e1_be4b_7c764274e4b2.slice/crio-2f1e234df63b78edac04dc58cb5745ca615ecfac107ff950dc4682ff6bd2a7a6 WatchSource:0}: Error finding container 2f1e234df63b78edac04dc58cb5745ca615ecfac107ff950dc4682ff6bd2a7a6: Status 404 returned error can't find the container with id 2f1e234df63b78edac04dc58cb5745ca615ecfac107ff950dc4682ff6bd2a7a6 Jul 23 17:05:07.952208 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.952166 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2x4jv" Jul 23 17:05:07.956884 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:07.956853 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ab9b9c_f852_4682_8b4b_15c8660427fc.slice/crio-c158ece6fde21d623697b8145f3bf783dedf02d239bdc9732cc32b11b4ce36f1 WatchSource:0}: Error finding container c158ece6fde21d623697b8145f3bf783dedf02d239bdc9732cc32b11b4ce36f1: Status 404 returned error can't find the container with id c158ece6fde21d623697b8145f3bf783dedf02d239bdc9732cc32b11b4ce36f1 Jul 23 17:05:07.964603 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:05:07.964576 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f02c49_1ffd_40ec_b7d4_9f038b855d9d.slice/crio-8914aa98b8675302c348e66a20085c02125c60c29c595ac6a33ebeb480cb2474 WatchSource:0}: Error finding container 8914aa98b8675302c348e66a20085c02125c60c29c595ac6a33ebeb480cb2474: Status 404 returned error can't find the container with id 8914aa98b8675302c348e66a20085c02125c60c29c595ac6a33ebeb480cb2474 Jul 23 17:05:07.976551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:07.976528 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 17:05:08.196788 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.196723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:08.196985 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:08.196901 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:08.196985 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:08.196965 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret podName:143e3a8b-7387-4e40-86c9-455659d49a11 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:09.196949023 +0000 UTC m=+4.001593904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret") pod "global-pull-secret-syncer-9jkkx" (UID: "143e3a8b-7387-4e40-86c9-455659d49a11") : object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:08.298086 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.298055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbsz\" (UniqueName: \"kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz\") pod \"network-check-target-4dhpn\" (UID: \"738de34f-79ac-4451-b70c-4fb110a01fa0\") " pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:08.298086 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.298093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:08.298355 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:08.298225 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:08.298355 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:08.298244 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 17:05:08.298355 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:08.298266 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 17:05:08.298355 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:08.298277 2581 projected.go:196] Error preparing data for projected volume kube-api-access-pwbsz for pod openshift-network-diagnostics/network-check-target-4dhpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:08.298355 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:08.298282 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs podName:95a6dc4e-bc5f-40b0-96e4-a57065d23833 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:09.298267182 +0000 UTC m=+4.102912070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs") pod "network-metrics-daemon-pkn2c" (UID: "95a6dc4e-bc5f-40b0-96e4-a57065d23833") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:08.298624 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:08.298381 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz podName:738de34f-79ac-4451-b70c-4fb110a01fa0 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:09.298346903 +0000 UTC m=+4.102991805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwbsz" (UniqueName: "kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz") pod "network-check-target-4dhpn" (UID: "738de34f-79ac-4451-b70c-4fb110a01fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:08.666548 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.666494 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:00:08 +0000 UTC" deadline="2028-03-10 22:53:15.856859099 +0000 UTC" Jul 23 17:05:08.666548 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.666540 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14309h48m7.190325513s" Jul 23 17:05:08.817011 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.816979 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:08.817180 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:08.817112 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:08.830661 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.830616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tg94n" event={"ID":"2f6b05dc-d0e8-42f3-ab51-ddae9620981e","Type":"ContainerStarted","Data":"cfadf5150f40ad87d9d25679b22ba4c9f38a932f18add577916083691d8924dc"} Jul 23 17:05:08.832644 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.832606 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6np7" event={"ID":"625b4209-c14c-43de-882f-eab52363748a","Type":"ContainerStarted","Data":"640283fbb96f256137299047bfdc606cf72610d00417f50dbb14a12f2b1487a5"} Jul 23 17:05:08.834387 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.834319 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wpt7k" event={"ID":"c3af84a5-d78f-4910-b755-58601d552dad","Type":"ContainerStarted","Data":"c03f0a76c99ab28b6d5653c2b95383da27fcc1f67edbf908e61a85584d3784f6"} Jul 23 17:05:08.836269 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.836241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2x4jv" event={"ID":"59f02c49-1ffd-40ec-b7d4-9f038b855d9d","Type":"ContainerStarted","Data":"8914aa98b8675302c348e66a20085c02125c60c29c595ac6a33ebeb480cb2474"} Jul 23 17:05:08.838420 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.838392 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wrj4r" event={"ID":"cf506efa-b074-4b87-b481-a44b1638de43","Type":"ContainerStarted","Data":"02c77a733d8fd3a518f52cdc82d56d85324e1001cfe86d7388faee9096bd9b76"} Jul 23 17:05:08.840758 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.840709 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m2wrn" event={"ID":"51ab9b9c-f852-4682-8b4b-15c8660427fc","Type":"ContainerStarted","Data":"c158ece6fde21d623697b8145f3bf783dedf02d239bdc9732cc32b11b4ce36f1"} Jul 23 17:05:08.842675 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.842600 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" event={"ID":"822c7016-9ec7-43e1-be4b-7c764274e4b2","Type":"ContainerStarted","Data":"2f1e234df63b78edac04dc58cb5745ca615ecfac107ff950dc4682ff6bd2a7a6"} Jul 23 17:05:08.844083 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.843979 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" event={"ID":"2bb86819-22f8-447f-8a7f-e412e79289ff","Type":"ContainerStarted","Data":"bd8db9eee7b946083d0088c6ee1ae28dea083938b608d84382017cbd675749d6"} Jul 23 17:05:08.845528 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:08.845432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" event={"ID":"068419c3-d512-409e-9d03-7cd312f55176","Type":"ContainerStarted","Data":"fc5c43d9e746be59120e42fb0cb23678a1b3a168d2cb37d48e71f1eee3b8090f"} Jul 23 17:05:09.206422 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:09.205795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:09.206422 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:09.205947 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:09.206422 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:09.206010 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret podName:143e3a8b-7387-4e40-86c9-455659d49a11 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:11.205988798 +0000 UTC m=+6.010633679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret") pod "global-pull-secret-syncer-9jkkx" (UID: "143e3a8b-7387-4e40-86c9-455659d49a11") : object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:09.307813 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:09.306718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbsz\" (UniqueName: \"kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz\") pod \"network-check-target-4dhpn\" (UID: \"738de34f-79ac-4451-b70c-4fb110a01fa0\") " pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:09.307813 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:09.306777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:09.307813 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:09.306899 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:09.307813 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:09.306963 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs podName:95a6dc4e-bc5f-40b0-96e4-a57065d23833 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:11.306942246 +0000 UTC m=+6.111587122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs") pod "network-metrics-daemon-pkn2c" (UID: "95a6dc4e-bc5f-40b0-96e4-a57065d23833") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:09.307813 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:09.307062 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 17:05:09.307813 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:09.307077 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 17:05:09.307813 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:09.307090 2581 projected.go:196] Error preparing data for projected volume kube-api-access-pwbsz for pod openshift-network-diagnostics/network-check-target-4dhpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:09.307813 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:09.307130 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz podName:738de34f-79ac-4451-b70c-4fb110a01fa0 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:11.307117307 +0000 UTC m=+6.111762191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwbsz" (UniqueName: "kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz") pod "network-check-target-4dhpn" (UID: "738de34f-79ac-4451-b70c-4fb110a01fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:09.667212 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:09.666892 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:00:08 +0000 UTC" deadline="2028-01-04 04:13:00.477591735 +0000 UTC" Jul 23 17:05:09.667212 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:09.666948 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12707h7m50.81064804s" Jul 23 17:05:09.817266 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:09.817232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:09.817474 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:09.817446 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:09.817672 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:09.817648 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:09.817803 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:09.817775 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:09.854232 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:09.854189 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-26.ec2.internal" event={"ID":"cd213ca292eddf0c2794f6b5c3faa4a3","Type":"ContainerStarted","Data":"3fd5fe2b281f20b35ad6c2644f7cfa2a2ada19f60b6d03ad11db6819c7895e0d"} Jul 23 17:05:10.816624 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:10.816587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:10.817120 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:10.816731 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:10.868964 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:10.868921 2581 generic.go:356] "Generic (PLEG): container finished" podID="dbc29de0037d9132592f3e17fa9e62a4" containerID="1c0171cc42763e1c3c979c627a92bb97961a01abc45f0f8fc92e80150b90c5e6" exitCode=0 Jul 23 17:05:10.869522 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:10.869497 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" event={"ID":"dbc29de0037d9132592f3e17fa9e62a4","Type":"ContainerDied","Data":"1c0171cc42763e1c3c979c627a92bb97961a01abc45f0f8fc92e80150b90c5e6"} Jul 23 17:05:10.888087 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:10.888002 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-26.ec2.internal" podStartSLOduration=3.887979307 podStartE2EDuration="3.887979307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:05:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:05:09.870208282 +0000 UTC m=+4.674853186" watchObservedRunningTime="2026-07-23 17:05:10.887979307 +0000 UTC m=+5.692624209" Jul 23 17:05:11.239371 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:11.238774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:11.239371 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:11.238931 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:11.239371 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:11.239003 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret podName:143e3a8b-7387-4e40-86c9-455659d49a11 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:15.238981176 +0000 UTC m=+10.043626054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret") pod "global-pull-secret-syncer-9jkkx" (UID: "143e3a8b-7387-4e40-86c9-455659d49a11") : object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:11.339880 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:11.339789 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbsz\" (UniqueName: \"kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz\") pod \"network-check-target-4dhpn\" (UID: \"738de34f-79ac-4451-b70c-4fb110a01fa0\") " pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:11.339880 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:11.339854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:11.340118 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:11.340010 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:11.340118 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:11.340073 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs podName:95a6dc4e-bc5f-40b0-96e4-a57065d23833 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:15.340052162 +0000 UTC m=+10.144697042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs") pod "network-metrics-daemon-pkn2c" (UID: "95a6dc4e-bc5f-40b0-96e4-a57065d23833") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:11.340560 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:11.340533 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 17:05:11.340560 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:11.340559 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 17:05:11.340737 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:11.340573 2581 projected.go:196] Error preparing data for projected volume kube-api-access-pwbsz for pod openshift-network-diagnostics/network-check-target-4dhpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:11.340737 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:11.340625 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz podName:738de34f-79ac-4451-b70c-4fb110a01fa0 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:15.340607567 +0000 UTC m=+10.145252449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwbsz" (UniqueName: "kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz") pod "network-check-target-4dhpn" (UID: "738de34f-79ac-4451-b70c-4fb110a01fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:11.817328 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:11.817291 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:11.817813 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:11.817526 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:11.817980 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:11.817960 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:11.818088 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:11.818067 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:11.876377 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:11.876338 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" event={"ID":"dbc29de0037d9132592f3e17fa9e62a4","Type":"ContainerStarted","Data":"a5b79d01e1377a9973651e94edea2455b1480f5771b0c25d9e8e754f8893c30b"} Jul 23 17:05:12.817699 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:12.817632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:12.818198 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:12.817775 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:13.817407 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:13.817009 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:13.817407 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:13.817009 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:13.817407 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:13.817185 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:13.817407 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:13.817252 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:14.816884 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:14.816850 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:14.817076 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:14.816957 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:15.282208 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:15.282120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:15.282775 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:15.282310 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:15.282775 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:15.282398 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret podName:143e3a8b-7387-4e40-86c9-455659d49a11 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:23.28237608 +0000 UTC m=+18.087020975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret") pod "global-pull-secret-syncer-9jkkx" (UID: "143e3a8b-7387-4e40-86c9-455659d49a11") : object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:15.382699 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:15.382587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbsz\" (UniqueName: \"kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz\") pod \"network-check-target-4dhpn\" (UID: \"738de34f-79ac-4451-b70c-4fb110a01fa0\") " pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:15.382699 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:15.382653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:15.382954 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:15.382825 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:15.382954 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:15.382900 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 17:05:15.382954 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:15.382928 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 17:05:15.382954 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:15.382948 2581 projected.go:196] Error preparing data for projected volume kube-api-access-pwbsz for pod openshift-network-diagnostics/network-check-target-4dhpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:15.383202 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:15.382909 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs podName:95a6dc4e-bc5f-40b0-96e4-a57065d23833 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:23.382885793 +0000 UTC m=+18.187530687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs") pod "network-metrics-daemon-pkn2c" (UID: "95a6dc4e-bc5f-40b0-96e4-a57065d23833") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:15.383202 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:15.383031 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz podName:738de34f-79ac-4451-b70c-4fb110a01fa0 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:23.38299628 +0000 UTC m=+18.187641164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwbsz" (UniqueName: "kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz") pod "network-check-target-4dhpn" (UID: "738de34f-79ac-4451-b70c-4fb110a01fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:15.819193 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:15.818475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:15.819193 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:15.818604 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:15.819193 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:15.819010 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:15.819193 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:15.819141 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:16.817194 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:16.817043 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:16.817194 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:16.817187 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:17.817263 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:17.817228 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:17.817715 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:17.817383 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:17.817715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:17.817486 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:17.817715 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:17.817614 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:18.816879 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:18.816847 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:18.817076 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:18.816959 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:19.816738 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:19.816702 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:19.817171 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:19.816710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:19.817171 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:19.816860 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:19.817171 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:19.816919 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:20.816779 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:20.816743 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:20.817231 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:20.816849 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:21.817644 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:21.817605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:21.818082 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:21.817613 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:21.818082 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:21.817746 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:21.818082 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:21.817803 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:22.816987 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:22.816941 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:22.817205 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:22.817063 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:23.337443 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:23.337409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:23.337823 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:23.337565 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:23.337823 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:23.337637 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret podName:143e3a8b-7387-4e40-86c9-455659d49a11 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:39.337620602 +0000 UTC m=+34.142265481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret") pod "global-pull-secret-syncer-9jkkx" (UID: "143e3a8b-7387-4e40-86c9-455659d49a11") : object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:23.438812 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:23.438777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbsz\" (UniqueName: \"kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz\") pod \"network-check-target-4dhpn\" (UID: \"738de34f-79ac-4451-b70c-4fb110a01fa0\") " pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:23.438812 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:23.438823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:23.439003 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:23.438935 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:23.439003 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:23.438940 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 17:05:23.439003 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:23.438961 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 17:05:23.439003 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:23.438972 2581 projected.go:196] Error preparing data for projected volume kube-api-access-pwbsz for pod openshift-network-diagnostics/network-check-target-4dhpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:23.439003 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:23.438991 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs podName:95a6dc4e-bc5f-40b0-96e4-a57065d23833 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:39.438976216 +0000 UTC m=+34.243621091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs") pod "network-metrics-daemon-pkn2c" (UID: "95a6dc4e-bc5f-40b0-96e4-a57065d23833") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:23.439152 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:23.439012 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz podName:738de34f-79ac-4451-b70c-4fb110a01fa0 nodeName:}" failed. No retries permitted until 2026-07-23 17:05:39.438999536 +0000 UTC m=+34.243644411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwbsz" (UniqueName: "kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz") pod "network-check-target-4dhpn" (UID: "738de34f-79ac-4451-b70c-4fb110a01fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:23.817101 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:23.817062 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:23.817299 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:23.817062 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:23.817299 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:23.817225 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:23.817425 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:23.817393 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:24.816901 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:24.816868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:24.817274 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:24.817002 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:25.818162 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:25.818129 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:25.818642 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:25.818261 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:25.818642 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:25.818308 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:25.818642 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:25.818449 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:26.817212 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:26.817172 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:26.817417 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:26.817310 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:27.816673 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:27.816643 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:27.817027 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:27.816775 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:27.817027 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:27.816807 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:27.817027 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:27.816881 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:28.817559 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.817200 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:28.818282 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:28.817671 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:28.912606 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.912570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m2wrn" event={"ID":"51ab9b9c-f852-4682-8b4b-15c8660427fc","Type":"ContainerStarted","Data":"2b78f9e5139c700dac9833ef7777dd441fcd5bd74955ee4c9e46bb34de000b08"} Jul 23 17:05:28.914348 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.914304 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" event={"ID":"822c7016-9ec7-43e1-be4b-7c764274e4b2","Type":"ContainerStarted","Data":"32f129bd77e18967d8e769a46d00dc48b01dc974616ec435d450daabb540d589"} Jul 23 17:05:28.915896 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.915864 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" event={"ID":"2bb86819-22f8-447f-8a7f-e412e79289ff","Type":"ContainerStarted","Data":"fe375ed42768708a90dde38a498429c1571e0abe88fc67095bb12483800a81f2"} Jul 23 17:05:28.922690 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.922669 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:05:28.923125 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.923096 2581 generic.go:356] "Generic (PLEG): container finished" podID="068419c3-d512-409e-9d03-7cd312f55176" containerID="b0353a58bc97ca445e05cd3db30a387b7a15fb172e94ba414ddb40d72333c9ac" exitCode=1 Jul 23 17:05:28.923209 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.923130 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" event={"ID":"068419c3-d512-409e-9d03-7cd312f55176","Type":"ContainerStarted","Data":"50da7ac40c905b320bbeecccff69c0c907471ce5954472eb53c94d61a5b3c430"} Jul 23 17:05:28.923256 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.923235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" event={"ID":"068419c3-d512-409e-9d03-7cd312f55176","Type":"ContainerStarted","Data":"68b39b2a49bed14865f176c4357d815acd7823ff48e5f8798af68e9a49b6d29f"} Jul 23 17:05:28.923308 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.923282 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" event={"ID":"068419c3-d512-409e-9d03-7cd312f55176","Type":"ContainerStarted","Data":"c579d9747d54b941e0e12d9d40dddcd25a34a84132c2ed85ac4d249e7f9b38a9"} Jul 23 17:05:28.923386 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.923347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" event={"ID":"068419c3-d512-409e-9d03-7cd312f55176","Type":"ContainerStarted","Data":"a4c854d2069789fa53d627052155588d18539a5e65862d337224bc02da7750f2"} Jul 23 17:05:28.923441 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.923392 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" event={"ID":"068419c3-d512-409e-9d03-7cd312f55176","Type":"ContainerDied","Data":"b0353a58bc97ca445e05cd3db30a387b7a15fb172e94ba414ddb40d72333c9ac"} Jul 23 17:05:28.923490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.923439 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" event={"ID":"068419c3-d512-409e-9d03-7cd312f55176","Type":"ContainerStarted","Data":"6034cc28953c2e5cbe2e457ba95484b0dc7dbd3a11d4ed6d11dc349492505949"} Jul 23 17:05:28.924834 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.924813 2581 generic.go:356] "Generic (PLEG): container finished" podID="625b4209-c14c-43de-882f-eab52363748a" containerID="6bf8f93b58b440b802b2399c02dcd15a2eb2ca7f33af6fac767e84714f9abe29" exitCode=0 Jul 23 17:05:28.924952 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.924841 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6np7" event={"ID":"625b4209-c14c-43de-882f-eab52363748a","Type":"ContainerDied","Data":"6bf8f93b58b440b802b2399c02dcd15a2eb2ca7f33af6fac767e84714f9abe29"} Jul 23 17:05:28.926715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.926687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wpt7k" event={"ID":"c3af84a5-d78f-4910-b755-58601d552dad","Type":"ContainerStarted","Data":"78fe9bdd772b442b81f84b8dc657d5c5b435950de80ff9f697d0ca47bed94837"} Jul 23 17:05:28.927874 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.927826 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m2wrn" podStartSLOduration=3.088122661 podStartE2EDuration="22.927813249s" totalImagesPullingTime="19.839690588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:05:28.92720982 +0000 UTC m=+23.731854716" watchObservedRunningTime="2026-07-23 17:05:28.927813249 +0000 UTC m=+23.732458146" Jul 23 17:05:28.927985 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.927950 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-26.ec2.internal" podStartSLOduration=21.927942124 podStartE2EDuration="21.927942124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:05:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:05:11.894106992 +0000 UTC m=+6.698751894" watchObservedRunningTime="2026-07-23 17:05:28.927942124 +0000 UTC m=+23.732587024" Jul 23 17:05:28.928287 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.928259 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2x4jv" event={"ID":"59f02c49-1ffd-40ec-b7d4-9f038b855d9d","Type":"ContainerStarted","Data":"721d8e0f724054e5615cf25cf2ddee88e9d76af024a5952bedaff3710faa90df"} Jul 23 17:05:28.929801 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.929782 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wrj4r" event={"ID":"cf506efa-b074-4b87-b481-a44b1638de43","Type":"ContainerStarted","Data":"380723acae20cabe2e3b9792a31e031b6fac4ae25d58107577e55e9ab508f610"} Jul 23 17:05:28.962798 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.962754 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wpt7k" podStartSLOduration=3.020242671 podStartE2EDuration="22.962739723s" totalImagesPullingTime="19.942497052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:05:28.962674465 +0000 UTC m=+23.767319360" watchObservedRunningTime="2026-07-23 17:05:28.962739723 +0000 UTC m=+23.767384618" Jul 23 17:05:28.962939 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:28.962914 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wmrmr" podStartSLOduration=3.107664577 podStartE2EDuration="22.962907917s" totalImagesPullingTime="19.85524334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:05:28.945348378 +0000 UTC m=+23.749993293" watchObservedRunningTime="2026-07-23 17:05:28.962907917 +0000 UTC m=+23.767552877" Jul 23 17:05:29.006462 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.006419 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wrj4r" podStartSLOduration=3.142946101 podStartE2EDuration="23.0064054s" totalImagesPullingTime="19.863459299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:05:29.005461774 +0000 UTC m=+23.810106673" watchObservedRunningTime="2026-07-23 17:05:29.0064054 +0000 UTC m=+23.811050295" Jul 23 17:05:29.023625 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.023574 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2x4jv" podStartSLOduration=3.19111906 podStartE2EDuration="23.023557729s" totalImagesPullingTime="19.832438669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:05:29.023049745 +0000 UTC m=+23.827694644" watchObservedRunningTime="2026-07-23 17:05:29.023557729 +0000 UTC m=+23.828202623" Jul 23 17:05:29.023854 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.023833 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m2wrn_51ab9b9c-f852-4682-8b4b-15c8660427fc/dns-node-resolver/0.log" Jul 23 17:05:29.596733 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.596705 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 17:05:29.634913 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.634806 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T17:05:29.596727625Z","UUID":"e138f181-05f7-4645-88bc-8d29b2cd8ef4","Handler":null,"Name":"","Endpoint":""} Jul 23 17:05:29.636154 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.636135 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 17:05:29.636277 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.636171 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 17:05:29.792351 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.792266 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2x4jv_59f02c49-1ffd-40ec-b7d4-9f038b855d9d/node-ca/0.log" Jul 23 17:05:29.816628 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.816591 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:29.816792 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.816641 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:29.816792 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:29.816712 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:29.816901 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:29.816854 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:29.934416 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.934372 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" event={"ID":"2bb86819-22f8-447f-8a7f-e412e79289ff","Type":"ContainerStarted","Data":"3dcdf210abc58b423e8daf09bc2e9b60b9b3e2fa36d01d81486f58ab9a9e298c"} Jul 23 17:05:29.935932 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.935899 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tg94n" event={"ID":"2f6b05dc-d0e8-42f3-ab51-ddae9620981e","Type":"ContainerStarted","Data":"1043b1e5685062c9225ace33d3dbc3db4cf7d6333f6619845ecd2f5e1505fba7"} Jul 23 17:05:29.950800 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:29.950756 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tg94n" podStartSLOduration=4.058776527 podStartE2EDuration="23.950744368s" totalImagesPullingTime="19.891967841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:05:29.950720464 +0000 UTC m=+24.755365383" watchObservedRunningTime="2026-07-23 17:05:29.950744368 +0000 UTC m=+24.755389263" Jul 23 17:05:30.816806 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:30.816632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:30.817030 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:30.816908 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:30.941885 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:30.941800 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" event={"ID":"2bb86819-22f8-447f-8a7f-e412e79289ff","Type":"ContainerStarted","Data":"5124b9755a19e3d1324055c52e00abbdf06a0e53b6143d88dc72d5182d66afa5"} Jul 23 17:05:30.945454 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:30.945432 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:05:30.945940 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:30.945909 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" event={"ID":"068419c3-d512-409e-9d03-7cd312f55176","Type":"ContainerStarted","Data":"13fff6dfd486f6cb96ce0e9c1c104019a6d7106550e8e2204d9c570a90a47bf6"} Jul 23 17:05:30.966181 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:30.966135 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbh4p" podStartSLOduration=10.744300117 podStartE2EDuration="24.966121426s" totalImagesPullingTime="14.221821309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:05:30.965963149 +0000 UTC m=+25.770608044" watchObservedRunningTime="2026-07-23 17:05:30.966121426 +0000 UTC m=+25.770766323" Jul 23 17:05:31.817609 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:31.817569 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:31.817609 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:31.817602 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:31.817960 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:31.817732 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:31.817960 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:31.817837 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:32.816581 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:32.816548 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:32.817259 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:32.816704 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:33.816911 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.816722 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:33.817534 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.816803 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:33.817534 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:33.817005 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:33.817534 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:33.817130 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:33.896700 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.896658 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:33.897297 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.897280 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:33.955591 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.955563 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:05:33.955946 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.955920 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" event={"ID":"068419c3-d512-409e-9d03-7cd312f55176","Type":"ContainerStarted","Data":"754e4d42f3620ea02bfd5c68de372f399378d949138148081ac0a92d1d5087fa"} Jul 23 17:05:33.956190 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.956157 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:33.956424 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.956402 2581 scope.go:117] "RemoveContainer" containerID="b0353a58bc97ca445e05cd3db30a387b7a15fb172e94ba414ddb40d72333c9ac" Jul 23 17:05:33.957912 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.957885 2581 generic.go:356] "Generic (PLEG): container finished" podID="625b4209-c14c-43de-882f-eab52363748a" containerID="c80af1ffba50a2eb48cc5baa7619cffd3f7ec6f93342da19924541daca9b546f" exitCode=0 Jul 23 17:05:33.958019 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.957951 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6np7" event={"ID":"625b4209-c14c-43de-882f-eab52363748a","Type":"ContainerDied","Data":"c80af1ffba50a2eb48cc5baa7619cffd3f7ec6f93342da19924541daca9b546f"} Jul 23 17:05:33.958181 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.958166 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:33.958715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.958700 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wrj4r" Jul 23 17:05:33.973383 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:33.973359 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:34.816783 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:34.816760 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:34.816921 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:34.816888 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:34.963498 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:34.963468 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:05:34.963949 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:34.963861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" event={"ID":"068419c3-d512-409e-9d03-7cd312f55176","Type":"ContainerStarted","Data":"0f4b694e84441b3a54ddab26ce19ddea765144ade97d4b37dd22e99e8b4c5a35"} Jul 23 17:05:34.964173 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:34.964158 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:34.964262 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:34.964233 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:34.966204 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:34.966184 2581 generic.go:356] "Generic (PLEG): container finished" podID="625b4209-c14c-43de-882f-eab52363748a" containerID="3bb4b74eddece339e018e377f37c447a31741853f8bd2888291a330d865fdfdf" exitCode=0 Jul 23 17:05:34.966342 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:34.966271 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6np7" event={"ID":"625b4209-c14c-43de-882f-eab52363748a","Type":"ContainerDied","Data":"3bb4b74eddece339e018e377f37c447a31741853f8bd2888291a330d865fdfdf"} Jul 23 17:05:34.980162 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:34.980145 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:05:35.005819 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:35.005779 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" podStartSLOduration=8.955542066 podStartE2EDuration="29.005764754s" totalImagesPullingTime="20.050222688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:05:35.005342547 +0000 UTC m=+29.809987476" watchObservedRunningTime="2026-07-23 17:05:35.005764754 +0000 UTC m=+29.810409651" Jul 23 17:05:35.818692 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:35.818652 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:35.818873 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:35.818774 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:35.818873 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:35.818826 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:35.818982 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:35.818955 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:36.816944 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:36.816852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:36.817458 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:36.817057 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:36.972668 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:36.972630 2581 generic.go:356] "Generic (PLEG): container finished" podID="625b4209-c14c-43de-882f-eab52363748a" containerID="58a8fcfe3a4d5a82d8e94bd32277b96b00d21a9384d3e78cffbf150004a3811a" exitCode=0 Jul 23 17:05:36.972822 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:36.972704 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6np7" event={"ID":"625b4209-c14c-43de-882f-eab52363748a","Type":"ContainerDied","Data":"58a8fcfe3a4d5a82d8e94bd32277b96b00d21a9384d3e78cffbf150004a3811a"} Jul 23 17:05:37.817605 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:37.817567 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:37.818037 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:37.817728 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:37.818037 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:37.817770 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:37.818037 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:37.817905 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:38.816874 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:38.816847 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:38.817064 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:38.816955 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:39.356713 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:39.356666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:39.357179 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:39.356825 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:39.357179 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:39.356898 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret podName:143e3a8b-7387-4e40-86c9-455659d49a11 nodeName:}" failed. No retries permitted until 2026-07-23 17:06:11.356880241 +0000 UTC m=+66.161525115 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret") pod "global-pull-secret-syncer-9jkkx" (UID: "143e3a8b-7387-4e40-86c9-455659d49a11") : object "kube-system"/"original-pull-secret" not registered Jul 23 17:05:39.457254 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:39.457219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbsz\" (UniqueName: \"kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz\") pod \"network-check-target-4dhpn\" (UID: \"738de34f-79ac-4451-b70c-4fb110a01fa0\") " pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:39.457254 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:39.457259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:39.457466 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:39.457366 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:39.457466 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:39.457386 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 17:05:39.457466 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:39.457407 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 17:05:39.457466 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:39.457415 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs podName:95a6dc4e-bc5f-40b0-96e4-a57065d23833 nodeName:}" failed. No retries permitted until 2026-07-23 17:06:11.457401683 +0000 UTC m=+66.262046558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs") pod "network-metrics-daemon-pkn2c" (UID: "95a6dc4e-bc5f-40b0-96e4-a57065d23833") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 17:05:39.457466 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:39.457417 2581 projected.go:196] Error preparing data for projected volume kube-api-access-pwbsz for pod openshift-network-diagnostics/network-check-target-4dhpn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:39.457466 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:39.457458 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz podName:738de34f-79ac-4451-b70c-4fb110a01fa0 nodeName:}" failed. No retries permitted until 2026-07-23 17:06:11.457446913 +0000 UTC m=+66.262091788 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwbsz" (UniqueName: "kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz") pod "network-check-target-4dhpn" (UID: "738de34f-79ac-4451-b70c-4fb110a01fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 17:05:39.817527 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:39.817497 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:39.817706 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:39.817631 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:39.817847 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:39.817496 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:39.817989 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:39.817944 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:40.817161 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:40.816942 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:40.817579 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:40.817238 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:41.817201 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:41.817171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:41.817663 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:41.817335 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:41.817663 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:41.817384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:41.817663 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:41.817484 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:41.987476 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:41.987443 2581 generic.go:356] "Generic (PLEG): container finished" podID="625b4209-c14c-43de-882f-eab52363748a" containerID="41428d002728057bafc7a8304261a02cb1666be3172d349f0e9a59fd8c83271e" exitCode=0 Jul 23 17:05:41.987647 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:41.987491 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6np7" event={"ID":"625b4209-c14c-43de-882f-eab52363748a","Type":"ContainerDied","Data":"41428d002728057bafc7a8304261a02cb1666be3172d349f0e9a59fd8c83271e"} Jul 23 17:05:42.816896 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:42.816869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:42.817113 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:42.816989 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:42.992638 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:42.992607 2581 generic.go:356] "Generic (PLEG): container finished" podID="625b4209-c14c-43de-882f-eab52363748a" containerID="e87895d7b68705a12249b701d44e23c1bcfa661cb962c6321dab1959e40d0ade" exitCode=0 Jul 23 17:05:42.993029 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:42.992652 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6np7" event={"ID":"625b4209-c14c-43de-882f-eab52363748a","Type":"ContainerDied","Data":"e87895d7b68705a12249b701d44e23c1bcfa661cb962c6321dab1959e40d0ade"} Jul 23 17:05:43.817275 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:43.817245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:43.817498 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:43.817360 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:43.817498 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:43.817389 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:43.817498 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:43.817446 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:43.998045 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:43.998012 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6np7" event={"ID":"625b4209-c14c-43de-882f-eab52363748a","Type":"ContainerStarted","Data":"e39465df9e8d65a70b945cdc5648d18906a568ddcdfd637d76d9c10bdc90f619"} Jul 23 17:05:44.027066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:44.027017 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d6np7" podStartSLOduration=7.414389111 podStartE2EDuration="38.026999256s" totalImagesPullingTime="30.612610145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:05:44.025609976 +0000 UTC m=+38.830254874" watchObservedRunningTime="2026-07-23 17:05:44.026999256 +0000 UTC m=+38.831644151" Jul 23 17:05:44.817184 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:44.817153 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:44.817359 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:44.817249 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:45.817509 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:45.817481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:45.817890 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:45.817561 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:45.817890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:45.817649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:45.817890 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:45.817731 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:46.817147 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:46.817109 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:46.817346 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:46.817211 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:47.817412 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:47.817374 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:47.817949 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:47.817374 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:47.817949 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:47.817506 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:47.817949 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:47.817557 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:48.817178 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:48.817145 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:48.817359 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:48.817240 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:49.817284 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:49.817252 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:49.817665 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:49.817355 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:49.817665 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:49.817373 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:49.817665 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:49.817473 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:50.817403 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:50.817372 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:50.817803 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:50.817473 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:51.817606 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:51.817575 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:51.818000 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:51.817674 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:51.818000 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:51.817753 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:51.818000 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:51.817838 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:52.816610 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:52.816577 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:52.816787 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:52.816698 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:53.817592 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:53.817558 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:53.817953 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:53.817597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:53.817953 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:53.817688 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:53.817953 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:53.817774 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:54.816860 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:54.816828 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:54.817029 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:54.816935 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:55.818264 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:55.818231 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:55.818633 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:55.818352 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:55.818633 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:55.818426 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:55.818633 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:55.818518 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:56.817146 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:56.817117 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:56.817305 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:56.817208 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:57.817458 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:57.817419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:57.817912 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:57.817419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:57.817912 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:57.817523 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:05:57.817912 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:57.817597 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:58.817347 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:58.817310 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:05:58.817582 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:58.817414 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:05:59.819532 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:59.819506 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:05:59.819877 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:05:59.819546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:05:59.819877 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:59.819627 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:05:59.819877 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:05:59.819739 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:06:00.817529 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:00.817494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:06:00.817720 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:06:00.817616 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:06:01.148417 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:01.148383 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9jkkx"] Jul 23 17:06:01.149199 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:01.148845 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:06:01.149199 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:06:01.148958 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:06:01.150746 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:01.150723 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4dhpn"] Jul 23 17:06:01.150907 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:01.150842 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:06:01.150974 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:06:01.150949 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:06:01.164325 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:01.164298 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pkn2c"] Jul 23 17:06:01.164518 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:01.164446 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:06:01.164587 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:06:01.164569 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:06:02.816762 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:02.816572 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:06:02.817270 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:02.816572 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:06:02.817270 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:06:02.816862 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:06:02.817270 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:02.816598 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:06:02.817270 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:06:02.816911 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:06:02.817270 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:06:02.816994 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:06:04.816927 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:04.816893 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:06:04.816927 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:04.816907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:06:04.816927 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:04.816908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:06:04.817515 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:06:04.817036 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkn2c" podUID="95a6dc4e-bc5f-40b0-96e4-a57065d23833" Jul 23 17:06:04.817515 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:06:04.817134 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dhpn" podUID="738de34f-79ac-4451-b70c-4fb110a01fa0" Jul 23 17:06:04.817515 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:06:04.817192 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9jkkx" podUID="143e3a8b-7387-4e40-86c9-455659d49a11" Jul 23 17:06:05.507378 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.507350 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-26.ec2.internal" event="NodeReady" Jul 23 17:06:05.507525 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.507475 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 17:06:05.577181 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.577111 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f869dc948-xdjdx"] Jul 23 17:06:05.578955 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.578939 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.581685 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.581663 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 17:06:05.581912 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.581894 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wgjfb\"" Jul 23 17:06:05.582021 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.582001 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 17:06:05.582405 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.582389 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 17:06:05.593709 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.593683 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 17:06:05.614946 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.614921 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f869dc948-xdjdx"] Jul 23 17:06:05.622160 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.622133 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mfdms"] Jul 23 17:06:05.624087 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.624067 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mfdms" Jul 23 17:06:05.632725 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.632706 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 17:06:05.632883 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.632868 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 17:06:05.632969 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.632911 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 17:06:05.633032 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.632972 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j8wcn\"" Jul 23 17:06:05.643330 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.643295 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-registry-tls\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.643405 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.643334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-985zp\" (UniqueName: \"kubernetes.io/projected/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-kube-api-access-985zp\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.643405 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.643374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-ca-trust-extracted\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.643405 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.643396 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-installation-pull-secrets\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.643503 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.643443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-trusted-ca\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.643536 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.643502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-image-registry-private-configuration\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.643536 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.643519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-registry-certificates\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.643597 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.643543 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-bound-sa-token\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.670716 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.667536 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6zt2f"] Jul 23 17:06:05.670716 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.670597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.672311 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.672283 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mfdms"] Jul 23 17:06:05.675890 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.675869 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 17:06:05.675999 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.675955 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 17:06:05.676092 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.676075 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 17:06:05.676190 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.676171 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 17:06:05.676296 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.676269 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n8wmv\"" Jul 23 17:06:05.700400 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.700369 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6zt2f"] Jul 23 17:06:05.744738 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.744711 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-image-registry-private-configuration\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.744738 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.744736 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-registry-certificates\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.744948 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.744759 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.744948 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.744777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-crio-socket\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.744948 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.744792 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6kz6\" (UniqueName: \"kubernetes.io/projected/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-kube-api-access-j6kz6\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.744948 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.744815 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-bound-sa-token\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.744948 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.744862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-data-volume\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.744948 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.744886 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-registry-tls\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.744948 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.744905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-985zp\" (UniqueName: \"kubernetes.io/projected/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-kube-api-access-985zp\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.744948 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.744937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk5wk\" (UniqueName: \"kubernetes.io/projected/4d5fa5bc-4728-4daf-8328-4f3c45cf30d1-kube-api-access-pk5wk\") pod \"ingress-canary-mfdms\" (UID: \"4d5fa5bc-4728-4daf-8328-4f3c45cf30d1\") " pod="openshift-ingress-canary/ingress-canary-mfdms" Jul 23 17:06:05.745335 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.744987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d5fa5bc-4728-4daf-8328-4f3c45cf30d1-cert\") pod \"ingress-canary-mfdms\" (UID: \"4d5fa5bc-4728-4daf-8328-4f3c45cf30d1\") " pod="openshift-ingress-canary/ingress-canary-mfdms" Jul 23 17:06:05.745335 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.745015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-ca-trust-extracted\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.745335 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.745040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.745335 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.745069 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-installation-pull-secrets\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.745335 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.745107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-trusted-ca\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.745522 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.745395 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-ca-trust-extracted\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.745677 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.745658 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-registry-certificates\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.745972 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.745950 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-trusted-ca\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.749081 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.749053 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-installation-pull-secrets\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.749190 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.749056 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-image-registry-private-configuration\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.749390 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.749276 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-registry-tls\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.750232 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.750214 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x2tx7"] Jul 23 17:06:05.752534 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.752519 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.760346 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.760332 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 17:06:05.760467 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.760447 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5n9dp\"" Jul 23 17:06:05.760535 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.760473 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 17:06:05.784061 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.784029 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x2tx7"] Jul 23 17:06:05.785163 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.785137 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-bound-sa-token\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.789645 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.789623 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-985zp\" (UniqueName: \"kubernetes.io/projected/90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9-kube-api-access-985zp\") pod \"image-registry-f869dc948-xdjdx\" (UID: \"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9\") " pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.845768 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.845695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-data-volume\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.845768 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.845728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk5wk\" (UniqueName: \"kubernetes.io/projected/4d5fa5bc-4728-4daf-8328-4f3c45cf30d1-kube-api-access-pk5wk\") pod \"ingress-canary-mfdms\" (UID: \"4d5fa5bc-4728-4daf-8328-4f3c45cf30d1\") " pod="openshift-ingress-canary/ingress-canary-mfdms" Jul 23 17:06:05.845768 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.845755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d5fa5bc-4728-4daf-8328-4f3c45cf30d1-cert\") pod \"ingress-canary-mfdms\" (UID: \"4d5fa5bc-4728-4daf-8328-4f3c45cf30d1\") " pod="openshift-ingress-canary/ingress-canary-mfdms" Jul 23 17:06:05.846252 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.845783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.846252 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.845811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-metrics-tls\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.846252 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.845844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-tmp-dir\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.846252 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.845870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tvxf\" (UniqueName: \"kubernetes.io/projected/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-kube-api-access-5tvxf\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.846252 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.845979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.846252 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.846022 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-config-volume\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.846252 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.846072 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-data-volume\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.846252 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.846079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-crio-socket\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.846252 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.846117 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-crio-socket\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.846252 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.846135 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6kz6\" (UniqueName: \"kubernetes.io/projected/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-kube-api-access-j6kz6\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.846765 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.846466 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.848040 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.848016 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.848136 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.848080 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d5fa5bc-4728-4daf-8328-4f3c45cf30d1-cert\") pod \"ingress-canary-mfdms\" (UID: \"4d5fa5bc-4728-4daf-8328-4f3c45cf30d1\") " pod="openshift-ingress-canary/ingress-canary-mfdms" Jul 23 17:06:05.874248 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.874223 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk5wk\" (UniqueName: \"kubernetes.io/projected/4d5fa5bc-4728-4daf-8328-4f3c45cf30d1-kube-api-access-pk5wk\") pod \"ingress-canary-mfdms\" (UID: \"4d5fa5bc-4728-4daf-8328-4f3c45cf30d1\") " pod="openshift-ingress-canary/ingress-canary-mfdms" Jul 23 17:06:05.880558 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.880537 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6kz6\" (UniqueName: \"kubernetes.io/projected/5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b-kube-api-access-j6kz6\") pod \"insights-runtime-extractor-6zt2f\" (UID: \"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b\") " pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.889514 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.889496 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:05.932632 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.932597 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mfdms" Jul 23 17:06:05.947055 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.946991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-metrics-tls\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.947055 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.947023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-tmp-dir\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.947055 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.947050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tvxf\" (UniqueName: \"kubernetes.io/projected/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-kube-api-access-5tvxf\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.947272 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.947079 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-config-volume\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.947504 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.947481 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-tmp-dir\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.947614 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.947509 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-config-volume\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.951018 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.950978 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-metrics-tls\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:05.980831 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.980801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6zt2f" Jul 23 17:06:05.989899 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:05.989874 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tvxf\" (UniqueName: \"kubernetes.io/projected/ea5e9d5e-846a-40df-bf71-b2a3458e3bca-kube-api-access-5tvxf\") pod \"dns-default-x2tx7\" (UID: \"ea5e9d5e-846a-40df-bf71-b2a3458e3bca\") " pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:06.063828 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.063801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:06.072128 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.072108 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f869dc948-xdjdx"] Jul 23 17:06:06.076773 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:06:06.076739 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c6bb0a_cc7f_4c77_aefa_6b2e31f8c6b9.slice/crio-a18972dfc4d1dacb1afdaf8d8b7ef4d6e38bdfa5005cd6c0634d184b3dc20d83 WatchSource:0}: Error finding container a18972dfc4d1dacb1afdaf8d8b7ef4d6e38bdfa5005cd6c0634d184b3dc20d83: Status 404 returned error can't find the container with id a18972dfc4d1dacb1afdaf8d8b7ef4d6e38bdfa5005cd6c0634d184b3dc20d83 Jul 23 17:06:06.102245 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.102160 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mfdms"] Jul 23 17:06:06.106257 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:06:06.106232 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5fa5bc_4728_4daf_8328_4f3c45cf30d1.slice/crio-f4521ae68d47e489a840f4c25ead249fbefc2bc61bd40245206c931fb4ff9050 WatchSource:0}: Error finding container f4521ae68d47e489a840f4c25ead249fbefc2bc61bd40245206c931fb4ff9050: Status 404 returned error can't find the container with id f4521ae68d47e489a840f4c25ead249fbefc2bc61bd40245206c931fb4ff9050 Jul 23 17:06:06.152709 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.152670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6zt2f"] Jul 23 17:06:06.155826 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:06:06.155777 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a22afc1_b1c0_4bda_ac7b_9ccb5cdebf6b.slice/crio-46ba5ef4a849c67b29a5d4fc3bcd49e1940780f1a1b97535e74e22ea625b164a WatchSource:0}: Error finding container 46ba5ef4a849c67b29a5d4fc3bcd49e1940780f1a1b97535e74e22ea625b164a: Status 404 returned error can't find the container with id 46ba5ef4a849c67b29a5d4fc3bcd49e1940780f1a1b97535e74e22ea625b164a Jul 23 17:06:06.243187 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.243150 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x2tx7"] Jul 23 17:06:06.250849 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:06:06.250821 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5e9d5e_846a_40df_bf71_b2a3458e3bca.slice/crio-00dda7017e075af344fb245abda979637aa612f8c937764868383afa03a2b442 WatchSource:0}: Error finding container 00dda7017e075af344fb245abda979637aa612f8c937764868383afa03a2b442: Status 404 returned error can't find the container with id 00dda7017e075af344fb245abda979637aa612f8c937764868383afa03a2b442 Jul 23 17:06:06.817701 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.817660 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:06:06.818135 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.818118 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:06:06.818608 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.818588 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:06:06.823537 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.823496 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 17:06:06.824408 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.824383 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cgv7q\"" Jul 23 17:06:06.824408 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.824409 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 17:06:06.824617 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.824551 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fr6xr\"" Jul 23 17:06:06.824617 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.824612 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 17:06:06.824829 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.824812 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 17:06:06.993161 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:06.991600 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9bc2p" Jul 23 17:06:07.058113 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:07.058072 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f869dc948-xdjdx" event={"ID":"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9","Type":"ContainerStarted","Data":"dcac74d1c4ca4bad5cab054ef4d94d0b1c521056777124f1d1fbd4b1436fbd39"} Jul 23 17:06:07.058291 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:07.058138 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f869dc948-xdjdx" event={"ID":"90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9","Type":"ContainerStarted","Data":"a18972dfc4d1dacb1afdaf8d8b7ef4d6e38bdfa5005cd6c0634d184b3dc20d83"} Jul 23 17:06:07.058291 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:07.058206 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:07.060180 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:07.060151 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2tx7" event={"ID":"ea5e9d5e-846a-40df-bf71-b2a3458e3bca","Type":"ContainerStarted","Data":"00dda7017e075af344fb245abda979637aa612f8c937764868383afa03a2b442"} Jul 23 17:06:07.063797 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:07.062864 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mfdms" event={"ID":"4d5fa5bc-4728-4daf-8328-4f3c45cf30d1","Type":"ContainerStarted","Data":"f4521ae68d47e489a840f4c25ead249fbefc2bc61bd40245206c931fb4ff9050"} Jul 23 17:06:07.065997 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:07.065972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6zt2f" event={"ID":"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b","Type":"ContainerStarted","Data":"46ba5ef4a849c67b29a5d4fc3bcd49e1940780f1a1b97535e74e22ea625b164a"} Jul 23 17:06:11.396478 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:11.396427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:06:11.398671 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:11.398645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/143e3a8b-7387-4e40-86c9-455659d49a11-original-pull-secret\") pod \"global-pull-secret-syncer-9jkkx\" (UID: \"143e3a8b-7387-4e40-86c9-455659d49a11\") " pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:06:11.497703 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:11.497661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwbsz\" (UniqueName: \"kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz\") pod \"network-check-target-4dhpn\" (UID: \"738de34f-79ac-4451-b70c-4fb110a01fa0\") " pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:06:11.497703 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:11.497708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:06:11.500162 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:11.500127 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95a6dc4e-bc5f-40b0-96e4-a57065d23833-metrics-certs\") pod \"network-metrics-daemon-pkn2c\" (UID: \"95a6dc4e-bc5f-40b0-96e4-a57065d23833\") " pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:06:11.500281 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:11.500197 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwbsz\" (UniqueName: \"kubernetes.io/projected/738de34f-79ac-4451-b70c-4fb110a01fa0-kube-api-access-pwbsz\") pod \"network-check-target-4dhpn\" (UID: \"738de34f-79ac-4451-b70c-4fb110a01fa0\") " pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:06:11.636042 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:11.636008 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9jkkx" Jul 23 17:06:11.644196 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:11.644162 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:06:11.651352 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:11.651291 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkn2c" Jul 23 17:06:12.683592 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:12.682942 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f869dc948-xdjdx" podStartSLOduration=12.682917157 podStartE2EDuration="12.682917157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:06:07.089535414 +0000 UTC m=+61.894180343" watchObservedRunningTime="2026-07-23 17:06:12.682917157 +0000 UTC m=+67.487562056" Jul 23 17:06:12.684259 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:12.684203 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4dhpn"] Jul 23 17:06:12.690341 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:06:12.689162 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738de34f_79ac_4451_b70c_4fb110a01fa0.slice/crio-8c40fd2250365cf9bf9b95b21db3487677109cb588df77fd3e4a2da032986f8d WatchSource:0}: Error finding container 8c40fd2250365cf9bf9b95b21db3487677109cb588df77fd3e4a2da032986f8d: Status 404 returned error can't find the container with id 8c40fd2250365cf9bf9b95b21db3487677109cb588df77fd3e4a2da032986f8d Jul 23 17:06:12.702909 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:12.702768 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pkn2c"] Jul 23 17:06:12.713581 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:06:12.713548 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a6dc4e_bc5f_40b0_96e4_a57065d23833.slice/crio-44936f91da9b6da21dfa3443542a1b59ee695fad0c5f8c5daf507006815094bb WatchSource:0}: Error finding container 44936f91da9b6da21dfa3443542a1b59ee695fad0c5f8c5daf507006815094bb: Status 404 returned error can't find the container with id 44936f91da9b6da21dfa3443542a1b59ee695fad0c5f8c5daf507006815094bb Jul 23 17:06:12.730278 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:12.730243 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9jkkx"] Jul 23 17:06:12.740468 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:06:12.740442 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143e3a8b_7387_4e40_86c9_455659d49a11.slice/crio-25595a4eca42ee2021ee05742c096f6be0495739fcffc15cc034815cf98ec8da WatchSource:0}: Error finding container 25595a4eca42ee2021ee05742c096f6be0495739fcffc15cc034815cf98ec8da: Status 404 returned error can't find the container with id 25595a4eca42ee2021ee05742c096f6be0495739fcffc15cc034815cf98ec8da Jul 23 17:06:13.086480 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:13.086436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2tx7" event={"ID":"ea5e9d5e-846a-40df-bf71-b2a3458e3bca","Type":"ContainerStarted","Data":"53a1d471689973f641978880c2f778eb5585b4ad61e6adf3faf9c93c0ebd970a"} Jul 23 17:06:13.086648 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:13.086515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2tx7" event={"ID":"ea5e9d5e-846a-40df-bf71-b2a3458e3bca","Type":"ContainerStarted","Data":"1fb600c158076e499c9d4e0362abf3a406f1ee529d82ffc804fb5627cc67115f"} Jul 23 17:06:13.086648 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:13.086613 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:13.088446 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:13.088402 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mfdms" event={"ID":"4d5fa5bc-4728-4daf-8328-4f3c45cf30d1","Type":"ContainerStarted","Data":"cd8391750c42cf683eb81aa3367d21a25b117dcee6c3347486b6a2df94cd65fa"} Jul 23 17:06:13.090473 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:13.090444 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6zt2f" event={"ID":"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b","Type":"ContainerStarted","Data":"47fb299cd3f5c4f16b5b6c749769d0314d8e3024ff96fd771f622e5b6a7446e7"} Jul 23 17:06:13.091780 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:13.091749 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4dhpn" event={"ID":"738de34f-79ac-4451-b70c-4fb110a01fa0","Type":"ContainerStarted","Data":"8c40fd2250365cf9bf9b95b21db3487677109cb588df77fd3e4a2da032986f8d"} Jul 23 17:06:13.093168 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:13.093139 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9jkkx" event={"ID":"143e3a8b-7387-4e40-86c9-455659d49a11","Type":"ContainerStarted","Data":"25595a4eca42ee2021ee05742c096f6be0495739fcffc15cc034815cf98ec8da"} Jul 23 17:06:13.094843 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:13.094802 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkn2c" event={"ID":"95a6dc4e-bc5f-40b0-96e4-a57065d23833","Type":"ContainerStarted","Data":"44936f91da9b6da21dfa3443542a1b59ee695fad0c5f8c5daf507006815094bb"} Jul 23 17:06:13.106433 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:13.106380 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x2tx7" podStartSLOduration=1.84657958 podStartE2EDuration="8.106365579s" totalImagesPullingTime="6.259785999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:06:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:06:13.105604836 +0000 UTC m=+67.910249733" watchObservedRunningTime="2026-07-23 17:06:13.106365579 +0000 UTC m=+67.911010475" Jul 23 17:06:13.124767 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:13.123884 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mfdms" podStartSLOduration=1.720060622 podStartE2EDuration="8.12386288s" totalImagesPullingTime="6.403802258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:06:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:06:13.12224346 +0000 UTC m=+67.926888359" watchObservedRunningTime="2026-07-23 17:06:13.12386288 +0000 UTC m=+67.928507778" Jul 23 17:06:15.106307 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:15.106267 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkn2c" event={"ID":"95a6dc4e-bc5f-40b0-96e4-a57065d23833","Type":"ContainerStarted","Data":"2e8d5a0fddc9c5232c20621ab9431e5563664c4a278a70c9a32f0cd9bfcaf7e7"} Jul 23 17:06:15.106764 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:15.106351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkn2c" event={"ID":"95a6dc4e-bc5f-40b0-96e4-a57065d23833","Type":"ContainerStarted","Data":"941f8a301c88be1431e9611d3b4b9655dccfccdef01ed01bc8acb28354dd6971"} Jul 23 17:06:15.121735 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:15.121572 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pkn2c" podStartSLOduration=67.757558367 podStartE2EDuration="1m9.121551936s" totalImagesPullingTime="1.363993569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:06:15.121444306 +0000 UTC m=+69.926089214" watchObservedRunningTime="2026-07-23 17:06:15.121551936 +0000 UTC m=+69.926196834" Jul 23 17:06:20.125983 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:20.125940 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6zt2f" event={"ID":"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b","Type":"ContainerStarted","Data":"0a1a5c9da6de005d97f833079c750a7cb38e846264f856158912d75456d08467"} Jul 23 17:06:20.127508 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:20.127475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4dhpn" event={"ID":"738de34f-79ac-4451-b70c-4fb110a01fa0","Type":"ContainerStarted","Data":"868c9c596bf64161ea9c06e794c59567a62e0e75fb6e9691b4715692e02b73c7"} Jul 23 17:06:20.127645 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:20.127556 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:06:20.129052 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:20.129017 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9jkkx" event={"ID":"143e3a8b-7387-4e40-86c9-455659d49a11","Type":"ContainerStarted","Data":"652bb256966c92291e1d152192bd36c6e5ac9afe8bf8c4cb6cc93f3c0e26b58d"} Jul 23 17:06:20.144826 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:20.144781 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4dhpn" podStartSLOduration=67.75349216 podStartE2EDuration="1m14.144765973s" totalImagesPullingTime="6.391273813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:06:20.143823679 +0000 UTC m=+74.948468610" watchObservedRunningTime="2026-07-23 17:06:20.144765973 +0000 UTC m=+74.949410853" Jul 23 17:06:20.164985 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:20.164917 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9jkkx" podStartSLOduration=67.823950342 podStartE2EDuration="1m14.164897533s" totalImagesPullingTime="6.340947191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:06:20.164548724 +0000 UTC m=+74.969193622" watchObservedRunningTime="2026-07-23 17:06:20.164897533 +0000 UTC m=+74.969542431" Jul 23 17:06:22.010818 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.010784 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-56mkr"] Jul 23 17:06:22.016341 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.016300 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fzqkm"] Jul 23 17:06:22.016491 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.016449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.020654 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.019657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.022168 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.022141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 23 17:06:22.022303 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.022184 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 23 17:06:22.022303 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.022196 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 17:06:22.022460 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.022442 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 17:06:22.022664 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.022645 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 17:06:22.022751 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.022683 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 17:06:22.022808 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.022753 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 23 17:06:22.022902 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.022886 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 17:06:22.022976 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.022936 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d5htt\"" Jul 23 17:06:22.022976 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.022960 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hvq9k\"" Jul 23 17:06:22.023188 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.023175 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 17:06:22.033195 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.033169 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-56mkr"] Jul 23 17:06:22.183155 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183121 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.183345 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183165 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.183345 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.183345 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z68cm\" (UniqueName: \"kubernetes.io/projected/621b4bec-4be6-4dae-b3cb-5d25e1279673-kube-api-access-z68cm\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.183345 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-wtmp\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.183345 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/621b4bec-4be6-4dae-b3cb-5d25e1279673-metrics-client-ca\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.183605 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/621b4bec-4be6-4dae-b3cb-5d25e1279673-sys\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.183605 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183395 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.183605 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-textfile\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.183605 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvdn2\" (UniqueName: \"kubernetes.io/projected/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-api-access-cvdn2\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.183605 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/621b4bec-4be6-4dae-b3cb-5d25e1279673-root\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.183605 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-tls\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.183605 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.183937 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.183937 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.183639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.285028 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.284926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.285028 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.285243 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285039 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.285243 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z68cm\" (UniqueName: \"kubernetes.io/projected/621b4bec-4be6-4dae-b3cb-5d25e1279673-kube-api-access-z68cm\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.285243 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-wtmp\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.285243 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/621b4bec-4be6-4dae-b3cb-5d25e1279673-metrics-client-ca\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.285243 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/621b4bec-4be6-4dae-b3cb-5d25e1279673-sys\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.285551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.285551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-textfile\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.285551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvdn2\" (UniqueName: \"kubernetes.io/projected/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-api-access-cvdn2\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.285551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/621b4bec-4be6-4dae-b3cb-5d25e1279673-root\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.285551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-tls\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.285551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.285551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.285551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.285927 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285782 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.285927 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285782 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-textfile\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.285927 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.285911 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-wtmp\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.286520 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.286493 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/621b4bec-4be6-4dae-b3cb-5d25e1279673-metrics-client-ca\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.286640 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.286565 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/621b4bec-4be6-4dae-b3cb-5d25e1279673-sys\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.287666 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.287014 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.287666 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.287572 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.287666 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.287623 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.287666 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.287635 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/621b4bec-4be6-4dae-b3cb-5d25e1279673-root\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.288201 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.288174 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.289194 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.289147 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.289811 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.289787 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/621b4bec-4be6-4dae-b3cb-5d25e1279673-node-exporter-tls\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.290216 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.290193 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.295116 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.295091 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z68cm\" (UniqueName: \"kubernetes.io/projected/621b4bec-4be6-4dae-b3cb-5d25e1279673-kube-api-access-z68cm\") pod \"node-exporter-fzqkm\" (UID: \"621b4bec-4be6-4dae-b3cb-5d25e1279673\") " pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.295246 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.295193 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvdn2\" (UniqueName: \"kubernetes.io/projected/aaa120b8-9ba4-4ba8-82c3-b4d09b544205-kube-api-access-cvdn2\") pod \"kube-state-metrics-56c5594674-56mkr\" (UID: \"aaa120b8-9ba4-4ba8-82c3-b4d09b544205\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.331828 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.331783 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" Jul 23 17:06:22.337908 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.337872 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fzqkm" Jul 23 17:06:22.513240 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:06:22.513208 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621b4bec_4be6_4dae_b3cb_5d25e1279673.slice/crio-901233ddc0db19832e22b9e90553170ff1e134357e38b11803950a669a725daf WatchSource:0}: Error finding container 901233ddc0db19832e22b9e90553170ff1e134357e38b11803950a669a725daf: Status 404 returned error can't find the container with id 901233ddc0db19832e22b9e90553170ff1e134357e38b11803950a669a725daf Jul 23 17:06:22.638696 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:22.638660 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-56mkr"] Jul 23 17:06:22.642423 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:06:22.642393 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa120b8_9ba4_4ba8_82c3_b4d09b544205.slice/crio-3ad25efb5f6e6d44d8d7f6b6bc65ad079a42757e7a68d70679ada798949f6f9f WatchSource:0}: Error finding container 3ad25efb5f6e6d44d8d7f6b6bc65ad079a42757e7a68d70679ada798949f6f9f: Status 404 returned error can't find the container with id 3ad25efb5f6e6d44d8d7f6b6bc65ad079a42757e7a68d70679ada798949f6f9f Jul 23 17:06:23.102834 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:23.102799 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x2tx7" Jul 23 17:06:23.142632 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:23.142592 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" event={"ID":"aaa120b8-9ba4-4ba8-82c3-b4d09b544205","Type":"ContainerStarted","Data":"3ad25efb5f6e6d44d8d7f6b6bc65ad079a42757e7a68d70679ada798949f6f9f"} Jul 23 17:06:23.146146 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:23.146112 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6zt2f" event={"ID":"5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b","Type":"ContainerStarted","Data":"cce64e60962715deb1d849187f8a3b67ab8d93df63f408018b25becb6a6ef943"} Jul 23 17:06:23.147746 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:23.147718 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzqkm" event={"ID":"621b4bec-4be6-4dae-b3cb-5d25e1279673","Type":"ContainerStarted","Data":"901233ddc0db19832e22b9e90553170ff1e134357e38b11803950a669a725daf"} Jul 23 17:06:23.176206 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:23.176152 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6zt2f" podStartSLOduration=1.9517637749999999 podStartE2EDuration="18.176128937s" totalImagesPullingTime="16.224365162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:06:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:06:23.17533408 +0000 UTC m=+77.979978990" watchObservedRunningTime="2026-07-23 17:06:23.176128937 +0000 UTC m=+77.980773835" Jul 23 17:06:24.153299 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:24.153264 2581 generic.go:356] "Generic (PLEG): container finished" podID="621b4bec-4be6-4dae-b3cb-5d25e1279673" containerID="96157eb6281b4fb02e82a7260686174d7250a3d60cb6579f6a5f37238341fb65" exitCode=0 Jul 23 17:06:24.153720 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:24.153362 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzqkm" event={"ID":"621b4bec-4be6-4dae-b3cb-5d25e1279673","Type":"ContainerDied","Data":"96157eb6281b4fb02e82a7260686174d7250a3d60cb6579f6a5f37238341fb65"} Jul 23 17:06:25.159336 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:25.159284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzqkm" event={"ID":"621b4bec-4be6-4dae-b3cb-5d25e1279673","Type":"ContainerStarted","Data":"5489f495a9ce42be64b306ab4a5b5441018b3e7affb3155e0164eca0be2f8a10"} Jul 23 17:06:25.159748 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:25.159389 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzqkm" event={"ID":"621b4bec-4be6-4dae-b3cb-5d25e1279673","Type":"ContainerStarted","Data":"b7e538bd4d9907e85b2de01ff20985907ae15068ffd8eccd9e2d7b903ff80eaa"} Jul 23 17:06:25.161507 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:25.161483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" event={"ID":"aaa120b8-9ba4-4ba8-82c3-b4d09b544205","Type":"ContainerStarted","Data":"def9c752df40a8ea5e16a46f5634d7cbfe34701f9e9a8f8b09e3c5ca538b2229"} Jul 23 17:06:25.161635 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:25.161530 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" event={"ID":"aaa120b8-9ba4-4ba8-82c3-b4d09b544205","Type":"ContainerStarted","Data":"45d0b5641b6cf4b58ac922e9b929b076960870afd2f44dbe041b2e1ffb95af34"} Jul 23 17:06:25.161635 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:25.161559 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" event={"ID":"aaa120b8-9ba4-4ba8-82c3-b4d09b544205","Type":"ContainerStarted","Data":"805c07a1aa26dd5b16afb1b8f50c6c0b4b4d9ef92d63571110c808a5bdfe462e"} Jul 23 17:06:25.208818 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:25.208756 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-56mkr" podStartSLOduration=2.60523728 podStartE2EDuration="4.208723945s" totalImagesPullingTime="1.603486665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:06:25.2081911 +0000 UTC m=+80.012836023" watchObservedRunningTime="2026-07-23 17:06:25.208723945 +0000 UTC m=+80.013368845" Jul 23 17:06:25.209187 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:25.209141 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fzqkm" podStartSLOduration=3.2710236950000002 podStartE2EDuration="4.209127706s" totalImagesPullingTime="866.092476ms" totalInitContainerRuntime="72.011535ms" isStatefulPod=true podCreationTimestamp="2026-07-23 17:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:06:25.181126033 +0000 UTC m=+79.985770949" watchObservedRunningTime="2026-07-23 17:06:25.209127706 +0000 UTC m=+80.013772601" Jul 23 17:06:26.628424 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.628390 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65cb59888b-xdlf8"] Jul 23 17:06:26.631207 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.631184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.635137 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.635094 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 17:06:26.635775 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.635751 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 17:06:26.635775 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.635752 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 17:06:26.635934 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.635782 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 17:06:26.635934 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.635783 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zxx5c\"" Jul 23 17:06:26.635934 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.635862 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 17:06:26.636957 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.636735 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 17:06:26.636957 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.636740 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 17:06:26.644404 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.644378 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 17:06:26.645687 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.645665 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65cb59888b-xdlf8"] Jul 23 17:06:26.721421 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.721377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-serving-cert\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.721585 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.721433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-console-config\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.721585 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.721483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-oauth-config\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.721585 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.721519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-service-ca\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.721585 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.721543 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rrhs\" (UniqueName: \"kubernetes.io/projected/8e326c80-a477-4f7d-b865-59562f756f12-kube-api-access-4rrhs\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.721585 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.721566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-oauth-serving-cert\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.721739 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.721594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-trusted-ca-bundle\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.822439 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.822390 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-service-ca\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.822439 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.822443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rrhs\" (UniqueName: \"kubernetes.io/projected/8e326c80-a477-4f7d-b865-59562f756f12-kube-api-access-4rrhs\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.822641 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.822566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-oauth-serving-cert\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.822641 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.822605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-trusted-ca-bundle\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.822703 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.822671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-serving-cert\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.822746 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.822711 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-console-config\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.822746 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.822740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-oauth-config\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.823266 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.823229 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-oauth-serving-cert\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.823266 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.823251 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-service-ca\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.823467 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.823422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-console-config\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.823609 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.823591 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-trusted-ca-bundle\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.825200 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.825173 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-serving-cert\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.825274 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.825214 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-oauth-config\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.834016 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.833996 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rrhs\" (UniqueName: \"kubernetes.io/projected/8e326c80-a477-4f7d-b865-59562f756f12-kube-api-access-4rrhs\") pod \"console-65cb59888b-xdlf8\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:26.943030 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:26.942946 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:27.073682 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:27.073575 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65cb59888b-xdlf8"] Jul 23 17:06:27.076605 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:06:27.076580 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e326c80_a477_4f7d_b865_59562f756f12.slice/crio-ac9799d4a1fdd79e799511ec00f631a08118a851365098c633eafbc3521ff6e5 WatchSource:0}: Error finding container ac9799d4a1fdd79e799511ec00f631a08118a851365098c633eafbc3521ff6e5: Status 404 returned error can't find the container with id ac9799d4a1fdd79e799511ec00f631a08118a851365098c633eafbc3521ff6e5 Jul 23 17:06:27.170187 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:27.170151 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cb59888b-xdlf8" event={"ID":"8e326c80-a477-4f7d-b865-59562f756f12","Type":"ContainerStarted","Data":"ac9799d4a1fdd79e799511ec00f631a08118a851365098c633eafbc3521ff6e5"} Jul 23 17:06:28.075165 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.075132 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f869dc948-xdjdx" Jul 23 17:06:28.257070 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.257024 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 17:06:28.261469 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.261439 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.265526 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.265496 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 17:06:28.265694 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.265560 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 17:06:28.265876 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.265844 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tsbnp\"" Jul 23 17:06:28.265984 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.265916 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 17:06:28.266034 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.265917 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 17:06:28.266771 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.266530 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 17:06:28.266771 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.266591 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 17:06:28.266771 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.266591 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 17:06:28.267003 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.266799 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 17:06:28.267003 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.266800 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 17:06:28.267003 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.266942 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 17:06:28.267431 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.267188 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-40pfqu9irou1t\"" Jul 23 17:06:28.267431 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.267265 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 17:06:28.267431 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.267278 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 17:06:28.267431 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.267304 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 17:06:28.273017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.272998 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 17:06:28.274744 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.274724 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 17:06:28.292398 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.292367 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 17:06:28.437134 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437134 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437394 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437394 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437394 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437194 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437394 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437394 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437367 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-web-config\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437607 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkbh8\" (UniqueName: \"kubernetes.io/projected/324c34e0-08ea-4777-a97c-fe82d2ce5753-kube-api-access-lkbh8\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437607 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/324c34e0-08ea-4777-a97c-fe82d2ce5753-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437607 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437607 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437550 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437607 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437853 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437648 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437853 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/324c34e0-08ea-4777-a97c-fe82d2ce5753-config-out\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437853 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.437853 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-config\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.438016 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.438016 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437910 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.438016 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.438016 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.437978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.538666 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.538626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkbh8\" (UniqueName: \"kubernetes.io/projected/324c34e0-08ea-4777-a97c-fe82d2ce5753-kube-api-access-lkbh8\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.538666 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.538669 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/324c34e0-08ea-4777-a97c-fe82d2ce5753-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.538886 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.538692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.538886 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.538718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.538886 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.538743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.538886 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.538770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.538886 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.538799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/324c34e0-08ea-4777-a97c-fe82d2ce5753-config-out\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.538886 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.538828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.539690 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.539741 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.539750 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-config\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.539794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.539828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.539854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.539880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.539915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.539953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.539988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540017 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.540021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540666 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.540044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540666 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.540073 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540770 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.540724 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540770 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.540081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.540880 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.540790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-web-config\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.542062 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.542034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.543248 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.542456 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/324c34e0-08ea-4777-a97c-fe82d2ce5753-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.543248 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.542815 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.543248 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.542940 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.543248 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.543081 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.543571 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.543429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.543571 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.543443 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-web-config\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.543847 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.543795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/324c34e0-08ea-4777-a97c-fe82d2ce5753-config-out\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.543847 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.543821 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-config\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.544630 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.544591 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.545490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.545466 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.546111 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.546088 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.546629 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.546607 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.546714 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.546690 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/324c34e0-08ea-4777-a97c-fe82d2ce5753-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.547282 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.547261 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/324c34e0-08ea-4777-a97c-fe82d2ce5753-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.550524 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.550505 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkbh8\" (UniqueName: \"kubernetes.io/projected/324c34e0-08ea-4777-a97c-fe82d2ce5753-kube-api-access-lkbh8\") pod \"prometheus-k8s-0\" (UID: \"324c34e0-08ea-4777-a97c-fe82d2ce5753\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.574422 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.574383 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:28.749102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:28.749015 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 17:06:28.752609 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:06:28.752580 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324c34e0_08ea_4777_a97c_fe82d2ce5753.slice/crio-825e10ecbaa636a0c6e00018755d2275a3ebdad0899ce27805b7918fc8511706 WatchSource:0}: Error finding container 825e10ecbaa636a0c6e00018755d2275a3ebdad0899ce27805b7918fc8511706: Status 404 returned error can't find the container with id 825e10ecbaa636a0c6e00018755d2275a3ebdad0899ce27805b7918fc8511706 Jul 23 17:06:29.180333 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:29.180281 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"324c34e0-08ea-4777-a97c-fe82d2ce5753","Type":"ContainerStarted","Data":"825e10ecbaa636a0c6e00018755d2275a3ebdad0899ce27805b7918fc8511706"} Jul 23 17:06:30.188768 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:30.188672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cb59888b-xdlf8" event={"ID":"8e326c80-a477-4f7d-b865-59562f756f12","Type":"ContainerStarted","Data":"1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6"} Jul 23 17:06:31.195591 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:31.195559 2581 generic.go:356] "Generic (PLEG): container finished" podID="324c34e0-08ea-4777-a97c-fe82d2ce5753" containerID="a326cbf16da3ca389aa2da97635f2d1990e46d1cfd2f89a71f82e25f968b4b1e" exitCode=0 Jul 23 17:06:31.195972 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:31.195650 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"324c34e0-08ea-4777-a97c-fe82d2ce5753","Type":"ContainerDied","Data":"a326cbf16da3ca389aa2da97635f2d1990e46d1cfd2f89a71f82e25f968b4b1e"} Jul 23 17:06:31.244443 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:31.244384 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65cb59888b-xdlf8" podStartSLOduration=2.40203953 podStartE2EDuration="5.24436678s" totalImagesPullingTime="2.84232725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:06:30.212275546 +0000 UTC m=+85.016920446" watchObservedRunningTime="2026-07-23 17:06:31.24436678 +0000 UTC m=+86.049011678" Jul 23 17:06:35.212745 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:35.212713 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"324c34e0-08ea-4777-a97c-fe82d2ce5753","Type":"ContainerStarted","Data":"8480cd2b8132e3505fb93e059a7670733d31eb638ff0af90ddf831010055f6fe"} Jul 23 17:06:35.213108 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:35.212779 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"324c34e0-08ea-4777-a97c-fe82d2ce5753","Type":"ContainerStarted","Data":"23c2316aa192b9d73b0992a111dfed615210c5e169895a82dc78357f6315255c"} Jul 23 17:06:36.943933 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:36.943887 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:36.944393 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:36.943955 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:36.949618 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:36.949590 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:37.226564 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:37.226485 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:06:38.229049 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:38.229009 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"324c34e0-08ea-4777-a97c-fe82d2ce5753","Type":"ContainerStarted","Data":"015d0343bed13cb72541d4d0d1fbb56f2e7ccfcc1e5c3fa5f1170263b87777d7"} Jul 23 17:06:38.229554 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:38.229078 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"324c34e0-08ea-4777-a97c-fe82d2ce5753","Type":"ContainerStarted","Data":"3cb3ca7c5120ce190d7e3e0371dd9650063dad66c4103be5681f169243dd2260"} Jul 23 17:06:38.229554 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:38.229106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"324c34e0-08ea-4777-a97c-fe82d2ce5753","Type":"ContainerStarted","Data":"34750bc0e7aea9f0290e5dd17d270a609effe2beb012e5d4746d4f85333ee065"} Jul 23 17:06:38.229554 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:38.229144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"324c34e0-08ea-4777-a97c-fe82d2ce5753","Type":"ContainerStarted","Data":"efe0c2a5de0c992ed22b42bd1b1b2aaf900fd1a15d2743eb8942440bcc61fa60"} Jul 23 17:06:38.264256 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:38.264193 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.407846558 podStartE2EDuration="10.264168343s" totalImagesPullingTime="7.83784553s" totalInitContainerRuntime="18.476255ms" isStatefulPod=false podCreationTimestamp="2026-07-23 17:06:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:06:38.262353684 +0000 UTC m=+93.066998608" watchObservedRunningTime="2026-07-23 17:06:38.264168343 +0000 UTC m=+93.068813242" Jul 23 17:06:38.574955 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:38.574901 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:06:51.135355 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:06:51.135304 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4dhpn" Jul 23 17:07:28.575244 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:28.575204 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:07:28.594522 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:28.594491 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:07:29.433394 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:29.433366 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 17:07:50.270650 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.270609 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bf49dbb7d-8h2zp"] Jul 23 17:07:50.272737 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.272718 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.283722 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.283692 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-trusted-ca-bundle\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.283906 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.283741 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-console-config\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.283906 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.283818 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-service-ca\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.283906 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.283862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-oauth-serving-cert\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.283906 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.283897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-oauth-config\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.284102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.283931 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-serving-cert\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.284102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.283972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2hr6\" (UniqueName: \"kubernetes.io/projected/9303e50d-181d-468a-8439-68d4a56e11d3-kube-api-access-s2hr6\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.284102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.283977 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf49dbb7d-8h2zp"] Jul 23 17:07:50.384588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.384551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-console-config\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.384588 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.384591 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-service-ca\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.384858 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.384607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-oauth-serving-cert\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.384858 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.384629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-oauth-config\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.384858 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.384649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-serving-cert\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.384858 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.384759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2hr6\" (UniqueName: \"kubernetes.io/projected/9303e50d-181d-468a-8439-68d4a56e11d3-kube-api-access-s2hr6\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.384858 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.384806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-trusted-ca-bundle\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.385420 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.385388 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-oauth-serving-cert\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.385554 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.385506 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-service-ca\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.385554 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.385507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-console-config\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.385667 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.385641 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-trusted-ca-bundle\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.387206 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.387188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-serving-cert\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.387347 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.387309 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-oauth-config\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.393686 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.393664 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2hr6\" (UniqueName: \"kubernetes.io/projected/9303e50d-181d-468a-8439-68d4a56e11d3-kube-api-access-s2hr6\") pod \"console-7bf49dbb7d-8h2zp\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.582044 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.582009 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:07:50.720779 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:50.720745 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf49dbb7d-8h2zp"] Jul 23 17:07:50.723690 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:07:50.723660 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9303e50d_181d_468a_8439_68d4a56e11d3.slice/crio-0eb2ccf9d209e39d5a9c5f30a89a99a8e7d9af36d22cef7b4c252753e271b1b5 WatchSource:0}: Error finding container 0eb2ccf9d209e39d5a9c5f30a89a99a8e7d9af36d22cef7b4c252753e271b1b5: Status 404 returned error can't find the container with id 0eb2ccf9d209e39d5a9c5f30a89a99a8e7d9af36d22cef7b4c252753e271b1b5 Jul 23 17:07:51.493914 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:51.493877 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf49dbb7d-8h2zp" event={"ID":"9303e50d-181d-468a-8439-68d4a56e11d3","Type":"ContainerStarted","Data":"9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af"} Jul 23 17:07:51.494300 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:51.493927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf49dbb7d-8h2zp" event={"ID":"9303e50d-181d-468a-8439-68d4a56e11d3","Type":"ContainerStarted","Data":"0eb2ccf9d209e39d5a9c5f30a89a99a8e7d9af36d22cef7b4c252753e271b1b5"} Jul 23 17:07:51.512952 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:07:51.512897 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bf49dbb7d-8h2zp" podStartSLOduration=1.5128809319999998 podStartE2EDuration="1.512880932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:07:51.511688069 +0000 UTC m=+166.316332967" watchObservedRunningTime="2026-07-23 17:07:51.512880932 +0000 UTC m=+166.317525829" Jul 23 17:08:00.583161 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:00.583126 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:08:00.583638 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:00.583211 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:08:00.587844 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:00.587819 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:08:01.532803 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.532769 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:08:01.596450 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.596412 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65cb59888b-xdlf8"] Jul 23 17:08:01.751813 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.751780 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fbb64996b-zg66k"] Jul 23 17:08:01.753895 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.753874 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.781246 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.781219 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbb64996b-zg66k"] Jul 23 17:08:01.873226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.873187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-oauth-serving-cert\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.873454 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.873234 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-service-ca\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.873454 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.873266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-oauth-config\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.873454 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.873296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-serving-cert\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.873454 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.873371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-console-config\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.873454 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.873422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-trusted-ca-bundle\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.873647 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.873469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phd22\" (UniqueName: \"kubernetes.io/projected/7f81e005-24c9-4d29-a83f-76291d9565a9-kube-api-access-phd22\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.974035 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.973984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-oauth-config\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.974035 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.974041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-serving-cert\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.974265 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.974066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-console-config\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.974265 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.974086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-trusted-ca-bundle\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.974265 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.974104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phd22\" (UniqueName: \"kubernetes.io/projected/7f81e005-24c9-4d29-a83f-76291d9565a9-kube-api-access-phd22\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.974265 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.974155 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-oauth-serving-cert\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.974265 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.974189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-service-ca\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.974985 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.974956 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-service-ca\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.975109 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.975007 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-trusted-ca-bundle\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.975109 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.975026 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-console-config\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.975109 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.975030 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-oauth-serving-cert\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.976433 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.976414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-oauth-config\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.976599 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.976583 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-serving-cert\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:01.984725 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:01.984699 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phd22\" (UniqueName: \"kubernetes.io/projected/7f81e005-24c9-4d29-a83f-76291d9565a9-kube-api-access-phd22\") pod \"console-6fbb64996b-zg66k\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:02.063078 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:02.063041 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:02.187490 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:02.187458 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbb64996b-zg66k"] Jul 23 17:08:02.190779 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:08:02.190753 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f81e005_24c9_4d29_a83f_76291d9565a9.slice/crio-34143ccb4595cdb22b1e4df5971402ef7ee176d0753bd78448269d9bb6a9b3dc WatchSource:0}: Error finding container 34143ccb4595cdb22b1e4df5971402ef7ee176d0753bd78448269d9bb6a9b3dc: Status 404 returned error can't find the container with id 34143ccb4595cdb22b1e4df5971402ef7ee176d0753bd78448269d9bb6a9b3dc Jul 23 17:08:02.538874 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:02.538781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbb64996b-zg66k" event={"ID":"7f81e005-24c9-4d29-a83f-76291d9565a9","Type":"ContainerStarted","Data":"34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786"} Jul 23 17:08:02.538874 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:02.538856 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbb64996b-zg66k" event={"ID":"7f81e005-24c9-4d29-a83f-76291d9565a9","Type":"ContainerStarted","Data":"34143ccb4595cdb22b1e4df5971402ef7ee176d0753bd78448269d9bb6a9b3dc"} Jul 23 17:08:02.559174 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:02.559125 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fbb64996b-zg66k" podStartSLOduration=1.559110931 podStartE2EDuration="1.559110931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:08:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:08:02.557385423 +0000 UTC m=+177.362030339" watchObservedRunningTime="2026-07-23 17:08:02.559110931 +0000 UTC m=+177.363755827" Jul 23 17:08:12.064041 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:12.063990 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:12.064466 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:12.064068 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:12.068819 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:12.068779 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:12.576335 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:12.576301 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:08:12.635837 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:12.635808 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf49dbb7d-8h2zp"] Jul 23 17:08:26.622845 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.622777 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65cb59888b-xdlf8" podUID="8e326c80-a477-4f7d-b865-59562f756f12" containerName="console" containerID="cri-o://1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6" gracePeriod=15 Jul 23 17:08:26.862724 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.862701 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:08:26.990695 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.990598 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-service-ca\") pod \"8e326c80-a477-4f7d-b865-59562f756f12\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " Jul 23 17:08:26.990695 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.990653 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-trusted-ca-bundle\") pod \"8e326c80-a477-4f7d-b865-59562f756f12\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " Jul 23 17:08:26.990695 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.990676 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-oauth-config\") pod \"8e326c80-a477-4f7d-b865-59562f756f12\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " Jul 23 17:08:26.990939 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.990714 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-oauth-serving-cert\") pod \"8e326c80-a477-4f7d-b865-59562f756f12\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " Jul 23 17:08:26.990939 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.990732 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rrhs\" (UniqueName: \"kubernetes.io/projected/8e326c80-a477-4f7d-b865-59562f756f12-kube-api-access-4rrhs\") pod \"8e326c80-a477-4f7d-b865-59562f756f12\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " Jul 23 17:08:26.990939 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.990753 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-console-config\") pod \"8e326c80-a477-4f7d-b865-59562f756f12\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " Jul 23 17:08:26.990939 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.990805 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-serving-cert\") pod \"8e326c80-a477-4f7d-b865-59562f756f12\" (UID: \"8e326c80-a477-4f7d-b865-59562f756f12\") " Jul 23 17:08:26.991198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.991058 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-service-ca" (OuterVolumeSpecName: "service-ca") pod "8e326c80-a477-4f7d-b865-59562f756f12" (UID: "8e326c80-a477-4f7d-b865-59562f756f12"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:08:26.991279 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.991252 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8e326c80-a477-4f7d-b865-59562f756f12" (UID: "8e326c80-a477-4f7d-b865-59562f756f12"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:08:26.991355 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.991286 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-console-config" (OuterVolumeSpecName: "console-config") pod "8e326c80-a477-4f7d-b865-59562f756f12" (UID: "8e326c80-a477-4f7d-b865-59562f756f12"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:08:26.991355 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.991294 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8e326c80-a477-4f7d-b865-59562f756f12" (UID: "8e326c80-a477-4f7d-b865-59562f756f12"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:08:26.993033 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.993001 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8e326c80-a477-4f7d-b865-59562f756f12" (UID: "8e326c80-a477-4f7d-b865-59562f756f12"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 17:08:26.993142 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.993054 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e326c80-a477-4f7d-b865-59562f756f12-kube-api-access-4rrhs" (OuterVolumeSpecName: "kube-api-access-4rrhs") pod "8e326c80-a477-4f7d-b865-59562f756f12" (UID: "8e326c80-a477-4f7d-b865-59562f756f12"). InnerVolumeSpecName "kube-api-access-4rrhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 17:08:26.993142 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:26.993107 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8e326c80-a477-4f7d-b865-59562f756f12" (UID: "8e326c80-a477-4f7d-b865-59562f756f12"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 17:08:27.091614 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.091573 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-trusted-ca-bundle\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:27.091614 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.091604 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-oauth-config\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:27.091614 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.091615 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-oauth-serving-cert\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:27.091614 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.091624 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rrhs\" (UniqueName: \"kubernetes.io/projected/8e326c80-a477-4f7d-b865-59562f756f12-kube-api-access-4rrhs\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:27.091875 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.091634 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-console-config\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:27.091875 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.091645 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e326c80-a477-4f7d-b865-59562f756f12-console-serving-cert\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:27.091875 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.091654 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e326c80-a477-4f7d-b865-59562f756f12-service-ca\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:27.624559 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.624526 2581 generic.go:356] "Generic (PLEG): container finished" podID="8e326c80-a477-4f7d-b865-59562f756f12" containerID="1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6" exitCode=0 Jul 23 17:08:27.624954 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.624573 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cb59888b-xdlf8" Jul 23 17:08:27.624954 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.624596 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cb59888b-xdlf8" event={"ID":"8e326c80-a477-4f7d-b865-59562f756f12","Type":"ContainerDied","Data":"1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6"} Jul 23 17:08:27.624954 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.624664 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cb59888b-xdlf8" event={"ID":"8e326c80-a477-4f7d-b865-59562f756f12","Type":"ContainerDied","Data":"ac9799d4a1fdd79e799511ec00f631a08118a851365098c633eafbc3521ff6e5"} Jul 23 17:08:27.624954 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.624684 2581 scope.go:117] "RemoveContainer" containerID="1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6" Jul 23 17:08:27.633283 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.633262 2581 scope.go:117] "RemoveContainer" containerID="1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6" Jul 23 17:08:27.633619 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:08:27.633596 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6\": container with ID starting with 1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6 not found: ID does not exist" containerID="1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6" Jul 23 17:08:27.633711 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.633631 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6"} err="failed to get container status \"1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6\": rpc error: code = NotFound desc = could not find container \"1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6\": container with ID starting with 1b09e73547cae7977261bd5a189ea5e81a3158d5c96940e7c2dfbbcda4ede7d6 not found: ID does not exist" Jul 23 17:08:27.645586 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.645558 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65cb59888b-xdlf8"] Jul 23 17:08:27.647818 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.647793 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65cb59888b-xdlf8"] Jul 23 17:08:27.821587 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:27.821556 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e326c80-a477-4f7d-b865-59562f756f12" path="/var/lib/kubelet/pods/8e326c80-a477-4f7d-b865-59562f756f12/volumes" Jul 23 17:08:37.656278 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.656214 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bf49dbb7d-8h2zp" podUID="9303e50d-181d-468a-8439-68d4a56e11d3" containerName="console" containerID="cri-o://9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af" gracePeriod=15 Jul 23 17:08:37.890156 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.890134 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:08:37.985683 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.985594 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-service-ca\") pod \"9303e50d-181d-468a-8439-68d4a56e11d3\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " Jul 23 17:08:37.985683 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.985637 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-oauth-config\") pod \"9303e50d-181d-468a-8439-68d4a56e11d3\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " Jul 23 17:08:37.985683 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.985671 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-trusted-ca-bundle\") pod \"9303e50d-181d-468a-8439-68d4a56e11d3\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " Jul 23 17:08:37.985939 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.985696 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-oauth-serving-cert\") pod \"9303e50d-181d-468a-8439-68d4a56e11d3\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " Jul 23 17:08:37.985939 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.985742 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-serving-cert\") pod \"9303e50d-181d-468a-8439-68d4a56e11d3\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " Jul 23 17:08:37.985939 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.985773 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-console-config\") pod \"9303e50d-181d-468a-8439-68d4a56e11d3\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " Jul 23 17:08:37.985939 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.985812 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2hr6\" (UniqueName: \"kubernetes.io/projected/9303e50d-181d-468a-8439-68d4a56e11d3-kube-api-access-s2hr6\") pod \"9303e50d-181d-468a-8439-68d4a56e11d3\" (UID: \"9303e50d-181d-468a-8439-68d4a56e11d3\") " Jul 23 17:08:37.986142 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.986104 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "9303e50d-181d-468a-8439-68d4a56e11d3" (UID: "9303e50d-181d-468a-8439-68d4a56e11d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:08:37.986209 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.986167 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9303e50d-181d-468a-8439-68d4a56e11d3" (UID: "9303e50d-181d-468a-8439-68d4a56e11d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:08:37.986312 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.986282 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9303e50d-181d-468a-8439-68d4a56e11d3" (UID: "9303e50d-181d-468a-8439-68d4a56e11d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:08:37.986312 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.986286 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-console-config" (OuterVolumeSpecName: "console-config") pod "9303e50d-181d-468a-8439-68d4a56e11d3" (UID: "9303e50d-181d-468a-8439-68d4a56e11d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:08:37.987765 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.987743 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9303e50d-181d-468a-8439-68d4a56e11d3" (UID: "9303e50d-181d-468a-8439-68d4a56e11d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 17:08:37.987854 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.987835 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9303e50d-181d-468a-8439-68d4a56e11d3-kube-api-access-s2hr6" (OuterVolumeSpecName: "kube-api-access-s2hr6") pod "9303e50d-181d-468a-8439-68d4a56e11d3" (UID: "9303e50d-181d-468a-8439-68d4a56e11d3"). InnerVolumeSpecName "kube-api-access-s2hr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 17:08:37.987899 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:37.987858 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9303e50d-181d-468a-8439-68d4a56e11d3" (UID: "9303e50d-181d-468a-8439-68d4a56e11d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 17:08:38.087005 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.086971 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2hr6\" (UniqueName: \"kubernetes.io/projected/9303e50d-181d-468a-8439-68d4a56e11d3-kube-api-access-s2hr6\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:38.087005 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.087000 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-service-ca\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:38.087005 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.087009 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-oauth-config\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:38.087207 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.087017 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-trusted-ca-bundle\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:38.087207 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.087026 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-oauth-serving-cert\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:38.087207 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.087034 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9303e50d-181d-468a-8439-68d4a56e11d3-console-serving-cert\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:38.087207 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.087043 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9303e50d-181d-468a-8439-68d4a56e11d3-console-config\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:08:38.665759 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.665722 2581 generic.go:356] "Generic (PLEG): container finished" podID="9303e50d-181d-468a-8439-68d4a56e11d3" containerID="9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af" exitCode=0 Jul 23 17:08:38.666126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.665767 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf49dbb7d-8h2zp" Jul 23 17:08:38.666126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.665805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf49dbb7d-8h2zp" event={"ID":"9303e50d-181d-468a-8439-68d4a56e11d3","Type":"ContainerDied","Data":"9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af"} Jul 23 17:08:38.666126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.665857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf49dbb7d-8h2zp" event={"ID":"9303e50d-181d-468a-8439-68d4a56e11d3","Type":"ContainerDied","Data":"0eb2ccf9d209e39d5a9c5f30a89a99a8e7d9af36d22cef7b4c252753e271b1b5"} Jul 23 17:08:38.666126 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.665877 2581 scope.go:117] "RemoveContainer" containerID="9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af" Jul 23 17:08:38.675577 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.675490 2581 scope.go:117] "RemoveContainer" containerID="9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af" Jul 23 17:08:38.675820 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:08:38.675795 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af\": container with ID starting with 9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af not found: ID does not exist" containerID="9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af" Jul 23 17:08:38.675903 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.675829 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af"} err="failed to get container status \"9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af\": rpc error: code = NotFound desc = could not find container \"9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af\": container with ID starting with 9146dd6510680f72193bfce1432e138e2b41c53fd3174109352536b758b261af not found: ID does not exist" Jul 23 17:08:38.689007 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.688980 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf49dbb7d-8h2zp"] Jul 23 17:08:38.692374 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:38.692350 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bf49dbb7d-8h2zp"] Jul 23 17:08:39.821187 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:08:39.821155 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9303e50d-181d-468a-8439-68d4a56e11d3" path="/var/lib/kubelet/pods/9303e50d-181d-468a-8439-68d4a56e11d3/volumes" Jul 23 17:10:05.572660 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:05.572622 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:10:05.577922 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:05.577899 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 17:10:05.587571 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:05.587546 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:10:16.170696 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.170658 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw"] Jul 23 17:10:16.171219 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.171010 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e326c80-a477-4f7d-b865-59562f756f12" containerName="console" Jul 23 17:10:16.171219 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.171027 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e326c80-a477-4f7d-b865-59562f756f12" containerName="console" Jul 23 17:10:16.171219 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.171041 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9303e50d-181d-468a-8439-68d4a56e11d3" containerName="console" Jul 23 17:10:16.171219 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.171050 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9303e50d-181d-468a-8439-68d4a56e11d3" containerName="console" Jul 23 17:10:16.171219 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.171133 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e326c80-a477-4f7d-b865-59562f756f12" containerName="console" Jul 23 17:10:16.171219 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.171145 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9303e50d-181d-468a-8439-68d4a56e11d3" containerName="console" Jul 23 17:10:16.173990 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.173969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw" Jul 23 17:10:16.176515 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.176495 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 17:10:16.177398 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.177379 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 17:10:16.177461 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.177379 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wmc6b\"" Jul 23 17:10:16.182484 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.182460 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw"] Jul 23 17:10:16.247937 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.247892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/814db887-18d7-4571-b87a-81839e9e3f50-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w84pw\" (UID: \"814db887-18d7-4571-b87a-81839e9e3f50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw" Jul 23 17:10:16.248098 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.247955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z255\" (UniqueName: \"kubernetes.io/projected/814db887-18d7-4571-b87a-81839e9e3f50-kube-api-access-8z255\") pod \"openshift-lws-operator-fd8ccff4c-w84pw\" (UID: \"814db887-18d7-4571-b87a-81839e9e3f50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw" Jul 23 17:10:16.348503 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.348456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z255\" (UniqueName: \"kubernetes.io/projected/814db887-18d7-4571-b87a-81839e9e3f50-kube-api-access-8z255\") pod \"openshift-lws-operator-fd8ccff4c-w84pw\" (UID: \"814db887-18d7-4571-b87a-81839e9e3f50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw" Jul 23 17:10:16.348676 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.348550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/814db887-18d7-4571-b87a-81839e9e3f50-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w84pw\" (UID: \"814db887-18d7-4571-b87a-81839e9e3f50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw" Jul 23 17:10:16.348881 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.348865 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/814db887-18d7-4571-b87a-81839e9e3f50-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w84pw\" (UID: \"814db887-18d7-4571-b87a-81839e9e3f50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw" Jul 23 17:10:16.361791 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.361763 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z255\" (UniqueName: \"kubernetes.io/projected/814db887-18d7-4571-b87a-81839e9e3f50-kube-api-access-8z255\") pod \"openshift-lws-operator-fd8ccff4c-w84pw\" (UID: \"814db887-18d7-4571-b87a-81839e9e3f50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw" Jul 23 17:10:16.490790 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.490701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw" Jul 23 17:10:16.615790 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.615753 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw"] Jul 23 17:10:16.619019 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:10:16.618990 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod814db887_18d7_4571_b87a_81839e9e3f50.slice/crio-42e6eada8f53005a3987ed2f75b47eae7abf5d4e63854ae397c84990d30435e1 WatchSource:0}: Error finding container 42e6eada8f53005a3987ed2f75b47eae7abf5d4e63854ae397c84990d30435e1: Status 404 returned error can't find the container with id 42e6eada8f53005a3987ed2f75b47eae7abf5d4e63854ae397c84990d30435e1 Jul 23 17:10:16.620386 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:16.620370 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 17:10:17.007089 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:17.007055 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw" event={"ID":"814db887-18d7-4571-b87a-81839e9e3f50","Type":"ContainerStarted","Data":"42e6eada8f53005a3987ed2f75b47eae7abf5d4e63854ae397c84990d30435e1"} Jul 23 17:10:20.023116 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:20.023073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw" event={"ID":"814db887-18d7-4571-b87a-81839e9e3f50","Type":"ContainerStarted","Data":"7c9cc6ec9b1f502d38b18f2910a298d842122492cca78446a4c860e4c4e44e3f"} Jul 23 17:10:20.051181 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:20.051122 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w84pw" podStartSLOduration=1.504008868 podStartE2EDuration="4.051106612s" totalImagesPullingTime="2.547097744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:10:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:10:20.050285955 +0000 UTC m=+314.854930851" watchObservedRunningTime="2026-07-23 17:10:20.051106612 +0000 UTC m=+314.855751508" Jul 23 17:10:35.198591 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.198555 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6"] Jul 23 17:10:35.206905 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.206878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.215551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.215524 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 17:10:35.215551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.215549 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 17:10:35.215700 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.215596 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s8fpp\"" Jul 23 17:10:35.215700 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.215642 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 17:10:35.221360 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.221336 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6"] Jul 23 17:10:35.318771 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.318729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkqwg\" (UniqueName: \"kubernetes.io/projected/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-kube-api-access-zkqwg\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.318966 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.318791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-manager-config\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.318966 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.318838 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-cert\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.318966 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.318857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-metrics-cert\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.419656 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.419619 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-cert\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.419854 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.419664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-metrics-cert\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.419854 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.419724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkqwg\" (UniqueName: \"kubernetes.io/projected/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-kube-api-access-zkqwg\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.419854 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.419771 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-manager-config\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.420438 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.420414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-manager-config\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.422125 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.422103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-cert\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.422223 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.422137 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-metrics-cert\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.429254 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.429231 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkqwg\" (UniqueName: \"kubernetes.io/projected/a12c02aa-ff30-4acf-8b4e-2cecfdb00373-kube-api-access-zkqwg\") pod \"lws-controller-manager-65fcfccbcc-grct6\" (UID: \"a12c02aa-ff30-4acf-8b4e-2cecfdb00373\") " pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.516531 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.516446 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:35.646849 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:35.646816 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6"] Jul 23 17:10:35.651089 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:10:35.651062 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda12c02aa_ff30_4acf_8b4e_2cecfdb00373.slice/crio-f1ae85b485d6a555537a6d5ea800e3022365806638a61209eb722967d6b4f18c WatchSource:0}: Error finding container f1ae85b485d6a555537a6d5ea800e3022365806638a61209eb722967d6b4f18c: Status 404 returned error can't find the container with id f1ae85b485d6a555537a6d5ea800e3022365806638a61209eb722967d6b4f18c Jul 23 17:10:36.078043 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.078006 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" event={"ID":"a12c02aa-ff30-4acf-8b4e-2cecfdb00373","Type":"ContainerStarted","Data":"f1ae85b485d6a555537a6d5ea800e3022365806638a61209eb722967d6b4f18c"} Jul 23 17:10:36.401047 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.400942 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq"] Jul 23 17:10:36.406108 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.406085 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.412298 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.412276 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 17:10:36.412709 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.412524 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 17:10:36.412709 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.412644 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 17:10:36.413361 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.413345 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v7d57\"" Jul 23 17:10:36.413425 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.413348 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 17:10:36.446355 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.446226 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq"] Jul 23 17:10:36.531337 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.531284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/921889ac-c420-408d-8d61-378f9bd43cf5-tmp\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.531520 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.531353 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/921889ac-c420-408d-8d61-378f9bd43cf5-manifests\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.531520 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.531417 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/921889ac-c420-408d-8d61-378f9bd43cf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.531623 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.531528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/921889ac-c420-408d-8d61-378f9bd43cf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.531623 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.531567 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cscf9\" (UniqueName: \"kubernetes.io/projected/921889ac-c420-408d-8d61-378f9bd43cf5-kube-api-access-cscf9\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.632486 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.632450 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/921889ac-c420-408d-8d61-378f9bd43cf5-tmp\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.632757 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.632501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/921889ac-c420-408d-8d61-378f9bd43cf5-manifests\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.632757 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.632619 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/921889ac-c420-408d-8d61-378f9bd43cf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.632757 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.632691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/921889ac-c420-408d-8d61-378f9bd43cf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.632757 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.632719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscf9\" (UniqueName: \"kubernetes.io/projected/921889ac-c420-408d-8d61-378f9bd43cf5-kube-api-access-cscf9\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.633178 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.633139 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/921889ac-c420-408d-8d61-378f9bd43cf5-manifests\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.635200 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.635169 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/921889ac-c420-408d-8d61-378f9bd43cf5-tmp\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.635746 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.635704 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/921889ac-c420-408d-8d61-378f9bd43cf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.636140 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.636117 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/921889ac-c420-408d-8d61-378f9bd43cf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.651312 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.651259 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cscf9\" (UniqueName: \"kubernetes.io/projected/921889ac-c420-408d-8d61-378f9bd43cf5-kube-api-access-cscf9\") pod \"opendatahub-operator-controller-manager-f9b469455-r5ccq\" (UID: \"921889ac-c420-408d-8d61-378f9bd43cf5\") " pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.716108 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.716043 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:36.881291 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:36.881257 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq"] Jul 23 17:10:36.884756 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:10:36.884712 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921889ac_c420_408d_8d61_378f9bd43cf5.slice/crio-1b9b77f278d7e42586930f4c1e5d09f465b1e7a7b14cf603a161e0e359307116 WatchSource:0}: Error finding container 1b9b77f278d7e42586930f4c1e5d09f465b1e7a7b14cf603a161e0e359307116: Status 404 returned error can't find the container with id 1b9b77f278d7e42586930f4c1e5d09f465b1e7a7b14cf603a161e0e359307116 Jul 23 17:10:37.083925 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:37.083890 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" event={"ID":"921889ac-c420-408d-8d61-378f9bd43cf5","Type":"ContainerStarted","Data":"1b9b77f278d7e42586930f4c1e5d09f465b1e7a7b14cf603a161e0e359307116"} Jul 23 17:10:38.091419 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:38.091376 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" event={"ID":"a12c02aa-ff30-4acf-8b4e-2cecfdb00373","Type":"ContainerStarted","Data":"10e6c4d86d7f91aaa35a009855f942b2699c34c704daed55836752cae8797038"} Jul 23 17:10:38.091963 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:38.091497 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:38.113036 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:38.112977 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" podStartSLOduration=1.464839325 podStartE2EDuration="3.112956755s" totalImagesPullingTime="1.64811743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:10:38.110843114 +0000 UTC m=+332.915488052" watchObservedRunningTime="2026-07-23 17:10:38.112956755 +0000 UTC m=+332.917601651" Jul 23 17:10:40.103005 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:40.102967 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" event={"ID":"921889ac-c420-408d-8d61-378f9bd43cf5","Type":"ContainerStarted","Data":"4db6d177a4c8140e30f0948d70ad9fd303fc65ccfc29af40e18f8a728e5caafd"} Jul 23 17:10:42.111847 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:42.111814 2581 generic.go:356] "Generic (PLEG): container finished" podID="921889ac-c420-408d-8d61-378f9bd43cf5" containerID="4db6d177a4c8140e30f0948d70ad9fd303fc65ccfc29af40e18f8a728e5caafd" exitCode=0 Jul 23 17:10:42.112219 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:42.111882 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" event={"ID":"921889ac-c420-408d-8d61-378f9bd43cf5","Type":"ContainerDied","Data":"4db6d177a4c8140e30f0948d70ad9fd303fc65ccfc29af40e18f8a728e5caafd"} Jul 23 17:10:43.116903 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:43.116870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" event={"ID":"921889ac-c420-408d-8d61-378f9bd43cf5","Type":"ContainerStarted","Data":"e23f04e67b1d9fb7663eeb8ab93c8cf400e9154cdb55efec8bebaf6f6d96daf7"} Jul 23 17:10:43.117298 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:43.117082 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:43.145816 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:43.145760 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" podStartSLOduration=2.582559558 podStartE2EDuration="7.145744805s" totalImagesPullingTime="3.520586808s" totalInitContainerRuntime="1.042598439s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:10:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:10:43.144540231 +0000 UTC m=+337.949185160" watchObservedRunningTime="2026-07-23 17:10:43.145744805 +0000 UTC m=+337.950389702" Jul 23 17:10:49.098558 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:49.098525 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65fcfccbcc-grct6" Jul 23 17:10:54.123083 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:54.123045 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f9b469455-r5ccq" Jul 23 17:10:56.863850 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.863811 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn"] Jul 23 17:10:56.872531 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.872497 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn"] Jul 23 17:10:56.872699 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.872622 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" Jul 23 17:10:56.879412 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.879385 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 23 17:10:56.879606 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.879567 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 23 17:10:56.880657 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.880630 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 17:10:56.881448 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.881430 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4dvwc\"" Jul 23 17:10:56.881904 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.881884 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 17:10:56.891717 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.891691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn4pl\" (UniqueName: \"kubernetes.io/projected/0f0f1635-65a6-4622-87ee-aa03ad1894b3-kube-api-access-bn4pl\") pod \"kube-auth-proxy-7466c75dcd-ktcgn\" (UID: \"0f0f1635-65a6-4622-87ee-aa03ad1894b3\") " pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" Jul 23 17:10:56.891809 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.891744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f0f1635-65a6-4622-87ee-aa03ad1894b3-tmp\") pod \"kube-auth-proxy-7466c75dcd-ktcgn\" (UID: \"0f0f1635-65a6-4622-87ee-aa03ad1894b3\") " pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" Jul 23 17:10:56.891809 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.891798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0f1635-65a6-4622-87ee-aa03ad1894b3-tls-certs\") pod \"kube-auth-proxy-7466c75dcd-ktcgn\" (UID: \"0f0f1635-65a6-4622-87ee-aa03ad1894b3\") " pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" Jul 23 17:10:56.992255 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.992214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f0f1635-65a6-4622-87ee-aa03ad1894b3-tmp\") pod \"kube-auth-proxy-7466c75dcd-ktcgn\" (UID: \"0f0f1635-65a6-4622-87ee-aa03ad1894b3\") " pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" Jul 23 17:10:56.992255 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.992259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0f1635-65a6-4622-87ee-aa03ad1894b3-tls-certs\") pod \"kube-auth-proxy-7466c75dcd-ktcgn\" (UID: \"0f0f1635-65a6-4622-87ee-aa03ad1894b3\") " pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" Jul 23 17:10:56.992554 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.992300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn4pl\" (UniqueName: \"kubernetes.io/projected/0f0f1635-65a6-4622-87ee-aa03ad1894b3-kube-api-access-bn4pl\") pod \"kube-auth-proxy-7466c75dcd-ktcgn\" (UID: \"0f0f1635-65a6-4622-87ee-aa03ad1894b3\") " pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" Jul 23 17:10:56.994548 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.994517 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f0f1635-65a6-4622-87ee-aa03ad1894b3-tmp\") pod \"kube-auth-proxy-7466c75dcd-ktcgn\" (UID: \"0f0f1635-65a6-4622-87ee-aa03ad1894b3\") " pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" Jul 23 17:10:56.994784 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:56.994763 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f0f1635-65a6-4622-87ee-aa03ad1894b3-tls-certs\") pod \"kube-auth-proxy-7466c75dcd-ktcgn\" (UID: \"0f0f1635-65a6-4622-87ee-aa03ad1894b3\") " pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" Jul 23 17:10:57.032692 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:57.032652 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn4pl\" (UniqueName: \"kubernetes.io/projected/0f0f1635-65a6-4622-87ee-aa03ad1894b3-kube-api-access-bn4pl\") pod \"kube-auth-proxy-7466c75dcd-ktcgn\" (UID: \"0f0f1635-65a6-4622-87ee-aa03ad1894b3\") " pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" Jul 23 17:10:57.182213 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:57.182079 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" Jul 23 17:10:57.338755 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:57.338718 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn"] Jul 23 17:10:58.172492 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:10:58.172453 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" event={"ID":"0f0f1635-65a6-4622-87ee-aa03ad1894b3","Type":"ContainerStarted","Data":"d488a6adcc6e3e0e05f3fbc045b7066c39f2e58400b42869cb1c367e65c8873f"} Jul 23 17:11:00.182833 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:00.182799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" event={"ID":"0f0f1635-65a6-4622-87ee-aa03ad1894b3","Type":"ContainerStarted","Data":"7839cf6e8d83a3bcdb08c6791054f56fc8cd95eaf392f148e6afd1963a5dd82c"} Jul 23 17:11:00.204516 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:00.204466 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7466c75dcd-ktcgn" podStartSLOduration=1.442835437 podStartE2EDuration="4.204451332s" totalImagesPullingTime="2.761615895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:11:00.203864619 +0000 UTC m=+355.008509515" watchObservedRunningTime="2026-07-23 17:11:00.204451332 +0000 UTC m=+355.009096228" Jul 23 17:11:08.553129 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:08.553088 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g"] Jul 23 17:11:08.569125 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:08.569098 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" Jul 23 17:11:08.574284 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:08.574256 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 23 17:11:08.574457 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:08.574365 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-m2spb\"" Jul 23 17:11:08.577278 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:08.577253 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g"] Jul 23 17:11:08.696829 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:08.696788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b184c91-8196-4d3c-89ab-8507c29383cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-ldc7g\" (UID: \"0b184c91-8196-4d3c-89ab-8507c29383cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" Jul 23 17:11:08.696829 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:08.696839 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6lxc\" (UniqueName: \"kubernetes.io/projected/0b184c91-8196-4d3c-89ab-8507c29383cc-kube-api-access-q6lxc\") pod \"kserve-controller-manager-d6f4b65b8-ldc7g\" (UID: \"0b184c91-8196-4d3c-89ab-8507c29383cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" Jul 23 17:11:08.797664 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:08.797622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b184c91-8196-4d3c-89ab-8507c29383cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-ldc7g\" (UID: \"0b184c91-8196-4d3c-89ab-8507c29383cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" Jul 23 17:11:08.797664 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:08.797671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6lxc\" (UniqueName: \"kubernetes.io/projected/0b184c91-8196-4d3c-89ab-8507c29383cc-kube-api-access-q6lxc\") pod \"kserve-controller-manager-d6f4b65b8-ldc7g\" (UID: \"0b184c91-8196-4d3c-89ab-8507c29383cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" Jul 23 17:11:08.797879 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:11:08.797773 2581 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 23 17:11:08.797879 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:11:08.797851 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b184c91-8196-4d3c-89ab-8507c29383cc-cert podName:0b184c91-8196-4d3c-89ab-8507c29383cc nodeName:}" failed. No retries permitted until 2026-07-23 17:11:09.297832298 +0000 UTC m=+364.102477173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0b184c91-8196-4d3c-89ab-8507c29383cc-cert") pod "kserve-controller-manager-d6f4b65b8-ldc7g" (UID: "0b184c91-8196-4d3c-89ab-8507c29383cc") : secret "kserve-webhook-server-cert" not found Jul 23 17:11:08.812903 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:08.812870 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6lxc\" (UniqueName: \"kubernetes.io/projected/0b184c91-8196-4d3c-89ab-8507c29383cc-kube-api-access-q6lxc\") pod \"kserve-controller-manager-d6f4b65b8-ldc7g\" (UID: \"0b184c91-8196-4d3c-89ab-8507c29383cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" Jul 23 17:11:09.302497 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:09.302403 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b184c91-8196-4d3c-89ab-8507c29383cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-ldc7g\" (UID: \"0b184c91-8196-4d3c-89ab-8507c29383cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" Jul 23 17:11:09.304793 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:09.304769 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b184c91-8196-4d3c-89ab-8507c29383cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-ldc7g\" (UID: \"0b184c91-8196-4d3c-89ab-8507c29383cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" Jul 23 17:11:09.482234 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:09.482171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" Jul 23 17:11:09.667391 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:09.667365 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g"] Jul 23 17:11:09.669854 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:11:09.669817 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b184c91_8196_4d3c_89ab_8507c29383cc.slice/crio-7fcdf1e26a4f47a134545561e6b11dec451fcaa23ea784e65ac72da76d921789 WatchSource:0}: Error finding container 7fcdf1e26a4f47a134545561e6b11dec451fcaa23ea784e65ac72da76d921789: Status 404 returned error can't find the container with id 7fcdf1e26a4f47a134545561e6b11dec451fcaa23ea784e65ac72da76d921789 Jul 23 17:11:10.228076 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:10.228041 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" event={"ID":"0b184c91-8196-4d3c-89ab-8507c29383cc","Type":"ContainerStarted","Data":"7fcdf1e26a4f47a134545561e6b11dec451fcaa23ea784e65ac72da76d921789"} Jul 23 17:11:12.238457 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:12.238419 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" event={"ID":"0b184c91-8196-4d3c-89ab-8507c29383cc","Type":"ContainerStarted","Data":"84731906fe2a8bdf5d91d747f70af11d2b2955477d1fcec80dac1eb6f5d2994e"} Jul 23 17:11:12.238857 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:12.238558 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" Jul 23 17:11:12.260453 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:12.260350 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" podStartSLOduration=1.924719796 podStartE2EDuration="4.260310757s" totalImagesPullingTime="2.335590961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:11:12.258971263 +0000 UTC m=+367.063616179" watchObservedRunningTime="2026-07-23 17:11:12.260310757 +0000 UTC m=+367.064955647" Jul 23 17:11:43.248591 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:11:43.248558 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-ldc7g" Jul 23 17:12:48.104542 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.104458 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97"] Jul 23 17:12:48.107646 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.107628 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" Jul 23 17:12:48.110174 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.110149 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qbxzr\"" Jul 23 17:12:48.110509 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.110491 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 17:12:48.111145 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.111127 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 23 17:12:48.111218 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.111201 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 17:12:48.111309 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.111295 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 23 17:12:48.116148 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.116126 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97"] Jul 23 17:12:48.154469 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.154428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n8r97\" (UID: \"c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" Jul 23 17:12:48.154636 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.154565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n8r97\" (UID: \"c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" Jul 23 17:12:48.154636 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.154593 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wljnx\" (UniqueName: \"kubernetes.io/projected/c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e-kube-api-access-wljnx\") pod \"kuadrant-console-plugin-66b5774985-n8r97\" (UID: \"c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" Jul 23 17:12:48.255385 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.255348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wljnx\" (UniqueName: \"kubernetes.io/projected/c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e-kube-api-access-wljnx\") pod \"kuadrant-console-plugin-66b5774985-n8r97\" (UID: \"c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" Jul 23 17:12:48.255573 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.255411 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n8r97\" (UID: \"c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" Jul 23 17:12:48.255573 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.255508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n8r97\" (UID: \"c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" Jul 23 17:12:48.256019 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.255997 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n8r97\" (UID: \"c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" Jul 23 17:12:48.257865 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.257843 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n8r97\" (UID: \"c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" Jul 23 17:12:48.263225 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.263204 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wljnx\" (UniqueName: \"kubernetes.io/projected/c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e-kube-api-access-wljnx\") pod \"kuadrant-console-plugin-66b5774985-n8r97\" (UID: \"c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" Jul 23 17:12:48.418073 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.417983 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" Jul 23 17:12:48.545877 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.545843 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97"] Jul 23 17:12:48.548884 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:12:48.548857 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8fdc4fc_a3cd_47db_af5f_0e8610c0d40e.slice/crio-a59b8330f78d102ede288c399d46e11bc015317a6a8e437a5b222682b2d79350 WatchSource:0}: Error finding container a59b8330f78d102ede288c399d46e11bc015317a6a8e437a5b222682b2d79350: Status 404 returned error can't find the container with id a59b8330f78d102ede288c399d46e11bc015317a6a8e437a5b222682b2d79350 Jul 23 17:12:48.634794 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:12:48.634758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" event={"ID":"c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e","Type":"ContainerStarted","Data":"a59b8330f78d102ede288c399d46e11bc015317a6a8e437a5b222682b2d79350"} Jul 23 17:13:10.742923 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:10.742880 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" event={"ID":"c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e","Type":"ContainerStarted","Data":"82ce643ce9c6e825098e8ef4ec3f663b4ad7d3c4b8970cf6af6ad30147ebcea2"} Jul 23 17:13:10.762191 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:10.762134 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n8r97" podStartSLOduration=1.224264997 podStartE2EDuration="22.762118645s" totalImagesPullingTime="21.537853648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:13:10.761408038 +0000 UTC m=+485.566052953" watchObservedRunningTime="2026-07-23 17:13:10.762118645 +0000 UTC m=+485.566763809" Jul 23 17:13:15.240816 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.240780 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d7c9f6474-wqvt8"] Jul 23 17:13:15.400005 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.399965 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7c9f6474-wqvt8"] Jul 23 17:13:15.400173 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.400089 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.407268 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.407243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-oauth-serving-cert\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.407362 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.407280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-trusted-ca-bundle\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.407362 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.407297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39f33f46-c394-4eb4-97a1-26d8b49c61f0-console-serving-cert\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.407362 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.407336 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5fx2\" (UniqueName: \"kubernetes.io/projected/39f33f46-c394-4eb4-97a1-26d8b49c61f0-kube-api-access-h5fx2\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.407481 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.407398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39f33f46-c394-4eb4-97a1-26d8b49c61f0-console-oauth-config\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.407481 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.407420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-console-config\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.407552 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.407494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-service-ca\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.508578 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.508495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39f33f46-c394-4eb4-97a1-26d8b49c61f0-console-serving-cert\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.508578 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.508537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5fx2\" (UniqueName: \"kubernetes.io/projected/39f33f46-c394-4eb4-97a1-26d8b49c61f0-kube-api-access-h5fx2\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.508578 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.508562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39f33f46-c394-4eb4-97a1-26d8b49c61f0-console-oauth-config\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.508578 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.508577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-console-config\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.508876 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.508622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-service-ca\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.508876 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.508690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-oauth-serving-cert\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.508876 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.508722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-trusted-ca-bundle\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.509451 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.509426 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-console-config\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.509571 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.509538 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-service-ca\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.509571 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.509538 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-oauth-serving-cert\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.510130 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.510112 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f33f46-c394-4eb4-97a1-26d8b49c61f0-trusted-ca-bundle\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.511636 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.511606 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39f33f46-c394-4eb4-97a1-26d8b49c61f0-console-oauth-config\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.511636 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.511626 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39f33f46-c394-4eb4-97a1-26d8b49c61f0-console-serving-cert\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.517332 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.517295 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5fx2\" (UniqueName: \"kubernetes.io/projected/39f33f46-c394-4eb4-97a1-26d8b49c61f0-kube-api-access-h5fx2\") pod \"console-d7c9f6474-wqvt8\" (UID: \"39f33f46-c394-4eb4-97a1-26d8b49c61f0\") " pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.709568 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.709531 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:15.897478 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:15.897441 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7c9f6474-wqvt8"] Jul 23 17:13:15.915155 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:13:15.915121 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f33f46_c394_4eb4_97a1_26d8b49c61f0.slice/crio-48f741f1d6f257cea45b6208c34d879eaa7b0c7f99871051f712a2e4214c19e1 WatchSource:0}: Error finding container 48f741f1d6f257cea45b6208c34d879eaa7b0c7f99871051f712a2e4214c19e1: Status 404 returned error can't find the container with id 48f741f1d6f257cea45b6208c34d879eaa7b0c7f99871051f712a2e4214c19e1 Jul 23 17:13:16.775077 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:16.775038 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7c9f6474-wqvt8" event={"ID":"39f33f46-c394-4eb4-97a1-26d8b49c61f0","Type":"ContainerStarted","Data":"a7b4d013a789830a2b4c8394ab488c36f8050f20769e3c3e60d7909112c340a5"} Jul 23 17:13:16.775467 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:16.775102 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7c9f6474-wqvt8" event={"ID":"39f33f46-c394-4eb4-97a1-26d8b49c61f0","Type":"ContainerStarted","Data":"48f741f1d6f257cea45b6208c34d879eaa7b0c7f99871051f712a2e4214c19e1"} Jul 23 17:13:16.797609 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:16.797557 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d7c9f6474-wqvt8" podStartSLOduration=1.797541404 podStartE2EDuration="1.797541404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:13:16.793842743 +0000 UTC m=+491.598487658" watchObservedRunningTime="2026-07-23 17:13:16.797541404 +0000 UTC m=+491.602186301" Jul 23 17:13:25.709714 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:25.709677 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:25.710197 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:25.709733 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:25.714397 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:25.714378 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:25.815103 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:25.815074 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d7c9f6474-wqvt8" Jul 23 17:13:25.865584 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:25.865553 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbb64996b-zg66k"] Jul 23 17:13:35.366062 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.366020 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:13:35.394877 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.394844 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:13:35.395033 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.394987 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" Jul 23 17:13:35.397632 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.397608 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 23 17:13:35.406258 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.406235 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:13:35.478823 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.478782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hph2\" (UniqueName: \"kubernetes.io/projected/f7c626f0-add6-44c9-9cad-6aafdd84a15a-kube-api-access-8hph2\") pod \"limitador-limitador-54d6d988d5-lsqrb\" (UID: \"f7c626f0-add6-44c9-9cad-6aafdd84a15a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" Jul 23 17:13:35.479022 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.478837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7c626f0-add6-44c9-9cad-6aafdd84a15a-config-file\") pod \"limitador-limitador-54d6d988d5-lsqrb\" (UID: \"f7c626f0-add6-44c9-9cad-6aafdd84a15a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" Jul 23 17:13:35.579554 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.579517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7c626f0-add6-44c9-9cad-6aafdd84a15a-config-file\") pod \"limitador-limitador-54d6d988d5-lsqrb\" (UID: \"f7c626f0-add6-44c9-9cad-6aafdd84a15a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" Jul 23 17:13:35.579713 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.579618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hph2\" (UniqueName: \"kubernetes.io/projected/f7c626f0-add6-44c9-9cad-6aafdd84a15a-kube-api-access-8hph2\") pod \"limitador-limitador-54d6d988d5-lsqrb\" (UID: \"f7c626f0-add6-44c9-9cad-6aafdd84a15a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" Jul 23 17:13:35.580132 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.580112 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f7c626f0-add6-44c9-9cad-6aafdd84a15a-config-file\") pod \"limitador-limitador-54d6d988d5-lsqrb\" (UID: \"f7c626f0-add6-44c9-9cad-6aafdd84a15a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" Jul 23 17:13:35.590414 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.590388 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hph2\" (UniqueName: \"kubernetes.io/projected/f7c626f0-add6-44c9-9cad-6aafdd84a15a-kube-api-access-8hph2\") pod \"limitador-limitador-54d6d988d5-lsqrb\" (UID: \"f7c626f0-add6-44c9-9cad-6aafdd84a15a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" Jul 23 17:13:35.706166 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.706071 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" Jul 23 17:13:35.842762 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.842735 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:13:35.845363 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:13:35.845310 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c626f0_add6_44c9_9cad_6aafdd84a15a.slice/crio-720cfcbfd725b87497f1974d13a876b8596479a9e073304b7a37b0c4bf68199b WatchSource:0}: Error finding container 720cfcbfd725b87497f1974d13a876b8596479a9e073304b7a37b0c4bf68199b: Status 404 returned error can't find the container with id 720cfcbfd725b87497f1974d13a876b8596479a9e073304b7a37b0c4bf68199b Jul 23 17:13:35.852685 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.852651 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" event={"ID":"f7c626f0-add6-44c9-9cad-6aafdd84a15a","Type":"ContainerStarted","Data":"720cfcbfd725b87497f1974d13a876b8596479a9e073304b7a37b0c4bf68199b"} Jul 23 17:13:35.952191 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.952156 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zplxx"] Jul 23 17:13:35.956706 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.956666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zplxx" Jul 23 17:13:35.958909 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.958888 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7gscs\"" Jul 23 17:13:35.964894 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:35.964875 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zplxx"] Jul 23 17:13:36.085047 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:36.085004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-572f5\" (UniqueName: \"kubernetes.io/projected/b692bee4-466b-4900-b4cd-6e1909dd6d2d-kube-api-access-572f5\") pod \"authorino-75d556bd77-zplxx\" (UID: \"b692bee4-466b-4900-b4cd-6e1909dd6d2d\") " pod="kuadrant-system/authorino-75d556bd77-zplxx" Jul 23 17:13:36.186263 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:36.186219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-572f5\" (UniqueName: \"kubernetes.io/projected/b692bee4-466b-4900-b4cd-6e1909dd6d2d-kube-api-access-572f5\") pod \"authorino-75d556bd77-zplxx\" (UID: \"b692bee4-466b-4900-b4cd-6e1909dd6d2d\") " pod="kuadrant-system/authorino-75d556bd77-zplxx" Jul 23 17:13:36.195599 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:36.195568 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-572f5\" (UniqueName: \"kubernetes.io/projected/b692bee4-466b-4900-b4cd-6e1909dd6d2d-kube-api-access-572f5\") pod \"authorino-75d556bd77-zplxx\" (UID: \"b692bee4-466b-4900-b4cd-6e1909dd6d2d\") " pod="kuadrant-system/authorino-75d556bd77-zplxx" Jul 23 17:13:36.266574 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:36.266501 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zplxx" Jul 23 17:13:36.432793 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:36.432721 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zplxx"] Jul 23 17:13:36.437648 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:13:36.437612 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb692bee4_466b_4900_b4cd_6e1909dd6d2d.slice/crio-fb1c0ca16fcafe58846d63c3eb1c08bf0615b0523bba0174b1bf07fc75b0ee82 WatchSource:0}: Error finding container fb1c0ca16fcafe58846d63c3eb1c08bf0615b0523bba0174b1bf07fc75b0ee82: Status 404 returned error can't find the container with id fb1c0ca16fcafe58846d63c3eb1c08bf0615b0523bba0174b1bf07fc75b0ee82 Jul 23 17:13:36.857960 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:36.857923 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zplxx" event={"ID":"b692bee4-466b-4900-b4cd-6e1909dd6d2d","Type":"ContainerStarted","Data":"fb1c0ca16fcafe58846d63c3eb1c08bf0615b0523bba0174b1bf07fc75b0ee82"} Jul 23 17:13:41.884910 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:41.884869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zplxx" event={"ID":"b692bee4-466b-4900-b4cd-6e1909dd6d2d","Type":"ContainerStarted","Data":"0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655"} Jul 23 17:13:41.886389 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:41.886359 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" event={"ID":"f7c626f0-add6-44c9-9cad-6aafdd84a15a","Type":"ContainerStarted","Data":"af4c291843b74e567811ee34050a8149d26dc84b93edd69c2159b45cd54e508f"} Jul 23 17:13:41.886512 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:41.886490 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" Jul 23 17:13:41.900314 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:41.900257 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zplxx" podStartSLOduration=2.310943542 podStartE2EDuration="6.900236112s" totalImagesPullingTime="4.58929257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:13:41.899541196 +0000 UTC m=+516.704186109" watchObservedRunningTime="2026-07-23 17:13:41.900236112 +0000 UTC m=+516.704881010" Jul 23 17:13:41.916408 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:41.916357 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" podStartSLOduration=1.734766123 podStartE2EDuration="6.916340484s" totalImagesPullingTime="5.181574361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:13:41.915038027 +0000 UTC m=+516.719682927" watchObservedRunningTime="2026-07-23 17:13:41.916340484 +0000 UTC m=+516.720985378" Jul 23 17:13:50.890718 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:50.890655 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fbb64996b-zg66k" podUID="7f81e005-24c9-4d29-a83f-76291d9565a9" containerName="console" containerID="cri-o://34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786" gracePeriod=15 Jul 23 17:13:51.142240 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.142176 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:13:51.333537 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.333502 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-oauth-serving-cert\") pod \"7f81e005-24c9-4d29-a83f-76291d9565a9\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " Jul 23 17:13:51.333678 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.333572 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-oauth-config\") pod \"7f81e005-24c9-4d29-a83f-76291d9565a9\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " Jul 23 17:13:51.333678 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.333589 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-trusted-ca-bundle\") pod \"7f81e005-24c9-4d29-a83f-76291d9565a9\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " Jul 23 17:13:51.333817 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.333793 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-console-config\") pod \"7f81e005-24c9-4d29-a83f-76291d9565a9\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " Jul 23 17:13:51.333866 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.333850 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phd22\" (UniqueName: \"kubernetes.io/projected/7f81e005-24c9-4d29-a83f-76291d9565a9-kube-api-access-phd22\") pod \"7f81e005-24c9-4d29-a83f-76291d9565a9\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " Jul 23 17:13:51.333905 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.333876 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7f81e005-24c9-4d29-a83f-76291d9565a9" (UID: "7f81e005-24c9-4d29-a83f-76291d9565a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:13:51.333905 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.333892 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-service-ca\") pod \"7f81e005-24c9-4d29-a83f-76291d9565a9\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " Jul 23 17:13:51.334114 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.333981 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7f81e005-24c9-4d29-a83f-76291d9565a9" (UID: "7f81e005-24c9-4d29-a83f-76291d9565a9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:13:51.334114 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.334102 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-serving-cert\") pod \"7f81e005-24c9-4d29-a83f-76291d9565a9\" (UID: \"7f81e005-24c9-4d29-a83f-76291d9565a9\") " Jul 23 17:13:51.334301 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.334182 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "7f81e005-24c9-4d29-a83f-76291d9565a9" (UID: "7f81e005-24c9-4d29-a83f-76291d9565a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:13:51.334301 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.334158 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-console-config" (OuterVolumeSpecName: "console-config") pod "7f81e005-24c9-4d29-a83f-76291d9565a9" (UID: "7f81e005-24c9-4d29-a83f-76291d9565a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 17:13:51.334433 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.334407 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-trusted-ca-bundle\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:13:51.334433 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.334428 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-console-config\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:13:51.334521 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.334442 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-service-ca\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:13:51.334521 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.334456 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f81e005-24c9-4d29-a83f-76291d9565a9-oauth-serving-cert\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:13:51.335862 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.335842 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7f81e005-24c9-4d29-a83f-76291d9565a9" (UID: "7f81e005-24c9-4d29-a83f-76291d9565a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 17:13:51.335921 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.335877 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7f81e005-24c9-4d29-a83f-76291d9565a9" (UID: "7f81e005-24c9-4d29-a83f-76291d9565a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 17:13:51.335956 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.335924 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f81e005-24c9-4d29-a83f-76291d9565a9-kube-api-access-phd22" (OuterVolumeSpecName: "kube-api-access-phd22") pod "7f81e005-24c9-4d29-a83f-76291d9565a9" (UID: "7f81e005-24c9-4d29-a83f-76291d9565a9"). InnerVolumeSpecName "kube-api-access-phd22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 17:13:51.435152 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.435055 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-oauth-config\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:13:51.435152 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.435099 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phd22\" (UniqueName: \"kubernetes.io/projected/7f81e005-24c9-4d29-a83f-76291d9565a9-kube-api-access-phd22\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:13:51.435152 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.435109 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f81e005-24c9-4d29-a83f-76291d9565a9-console-serving-cert\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:13:51.927417 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.927380 2581 generic.go:356] "Generic (PLEG): container finished" podID="7f81e005-24c9-4d29-a83f-76291d9565a9" containerID="34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786" exitCode=0 Jul 23 17:13:51.927790 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.927447 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbb64996b-zg66k" Jul 23 17:13:51.927790 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.927462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbb64996b-zg66k" event={"ID":"7f81e005-24c9-4d29-a83f-76291d9565a9","Type":"ContainerDied","Data":"34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786"} Jul 23 17:13:51.927790 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.927524 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbb64996b-zg66k" event={"ID":"7f81e005-24c9-4d29-a83f-76291d9565a9","Type":"ContainerDied","Data":"34143ccb4595cdb22b1e4df5971402ef7ee176d0753bd78448269d9bb6a9b3dc"} Jul 23 17:13:51.927790 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.927548 2581 scope.go:117] "RemoveContainer" containerID="34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786" Jul 23 17:13:51.935633 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.935613 2581 scope.go:117] "RemoveContainer" containerID="34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786" Jul 23 17:13:51.935894 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:13:51.935872 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786\": container with ID starting with 34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786 not found: ID does not exist" containerID="34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786" Jul 23 17:13:51.936014 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.935905 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786"} err="failed to get container status \"34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786\": rpc error: code = NotFound desc = could not find container \"34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786\": container with ID starting with 34319da8313b5a7ab6a83e65ce6936f30b6cbe3af9004467056ba5efe4805786 not found: ID does not exist" Jul 23 17:13:51.943172 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.943090 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbb64996b-zg66k"] Jul 23 17:13:51.944879 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:51.944855 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fbb64996b-zg66k"] Jul 23 17:13:52.893820 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:52.893784 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-lsqrb" Jul 23 17:13:53.822641 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:13:53.822608 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f81e005-24c9-4d29-a83f-76291d9565a9" path="/var/lib/kubelet/pods/7f81e005-24c9-4d29-a83f-76291d9565a9/volumes" Jul 23 17:14:11.433594 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:11.433556 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zplxx"] Jul 23 17:14:11.434079 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:11.433751 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zplxx" podUID="b692bee4-466b-4900-b4cd-6e1909dd6d2d" containerName="authorino" containerID="cri-o://0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655" gracePeriod=30 Jul 23 17:14:11.680661 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:11.680634 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zplxx" Jul 23 17:14:11.800929 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:11.800839 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-572f5\" (UniqueName: \"kubernetes.io/projected/b692bee4-466b-4900-b4cd-6e1909dd6d2d-kube-api-access-572f5\") pod \"b692bee4-466b-4900-b4cd-6e1909dd6d2d\" (UID: \"b692bee4-466b-4900-b4cd-6e1909dd6d2d\") " Jul 23 17:14:11.803074 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:11.803039 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b692bee4-466b-4900-b4cd-6e1909dd6d2d-kube-api-access-572f5" (OuterVolumeSpecName: "kube-api-access-572f5") pod "b692bee4-466b-4900-b4cd-6e1909dd6d2d" (UID: "b692bee4-466b-4900-b4cd-6e1909dd6d2d"). InnerVolumeSpecName "kube-api-access-572f5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 17:14:11.901892 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:11.901853 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-572f5\" (UniqueName: \"kubernetes.io/projected/b692bee4-466b-4900-b4cd-6e1909dd6d2d-kube-api-access-572f5\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:14:12.011512 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:12.011477 2581 generic.go:356] "Generic (PLEG): container finished" podID="b692bee4-466b-4900-b4cd-6e1909dd6d2d" containerID="0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655" exitCode=0 Jul 23 17:14:12.011703 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:12.011528 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zplxx" event={"ID":"b692bee4-466b-4900-b4cd-6e1909dd6d2d","Type":"ContainerDied","Data":"0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655"} Jul 23 17:14:12.011703 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:12.011555 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zplxx" event={"ID":"b692bee4-466b-4900-b4cd-6e1909dd6d2d","Type":"ContainerDied","Data":"fb1c0ca16fcafe58846d63c3eb1c08bf0615b0523bba0174b1bf07fc75b0ee82"} Jul 23 17:14:12.011703 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:12.011572 2581 scope.go:117] "RemoveContainer" containerID="0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655" Jul 23 17:14:12.011703 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:12.011530 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zplxx" Jul 23 17:14:12.019470 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:12.019444 2581 scope.go:117] "RemoveContainer" containerID="0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655" Jul 23 17:14:12.019720 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:14:12.019700 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655\": container with ID starting with 0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655 not found: ID does not exist" containerID="0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655" Jul 23 17:14:12.019762 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:12.019727 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655"} err="failed to get container status \"0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655\": rpc error: code = NotFound desc = could not find container \"0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655\": container with ID starting with 0fdec639699dfdea5f34c6e0a4cf46a8bf8181e10c17096131fda331b7f79655 not found: ID does not exist" Jul 23 17:14:12.027798 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:12.027767 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zplxx"] Jul 23 17:14:12.031671 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:12.031648 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zplxx"] Jul 23 17:14:13.822497 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:13.822465 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b692bee4-466b-4900-b4cd-6e1909dd6d2d" path="/var/lib/kubelet/pods/b692bee4-466b-4900-b4cd-6e1909dd6d2d/volumes" Jul 23 17:14:52.805554 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:14:52.805520 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:15:05.597843 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:05.597812 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:15:05.608882 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:05.608858 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:15:10.210291 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:10.210252 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:15:23.402822 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:23.402781 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:15:26.702749 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:26.702708 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:15:44.497997 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.497956 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv"] Jul 23 17:15:44.498576 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.498395 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f81e005-24c9-4d29-a83f-76291d9565a9" containerName="console" Jul 23 17:15:44.498576 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.498415 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f81e005-24c9-4d29-a83f-76291d9565a9" containerName="console" Jul 23 17:15:44.498576 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.498440 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b692bee4-466b-4900-b4cd-6e1909dd6d2d" containerName="authorino" Jul 23 17:15:44.498576 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.498449 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b692bee4-466b-4900-b4cd-6e1909dd6d2d" containerName="authorino" Jul 23 17:15:44.498576 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.498534 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f81e005-24c9-4d29-a83f-76291d9565a9" containerName="console" Jul 23 17:15:44.498576 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.498546 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b692bee4-466b-4900-b4cd-6e1909dd6d2d" containerName="authorino" Jul 23 17:15:44.500643 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.500620 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.503169 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.503149 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 23 17:15:44.504117 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.504099 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 23 17:15:44.504117 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.504112 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4mqfb\"" Jul 23 17:15:44.504259 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.504132 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 23 17:15:44.512258 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.512236 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv"] Jul 23 17:15:44.575597 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.575566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.575743 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.575658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e218acb1-014b-434b-b42e-2ec89cc57262-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.575743 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.575703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.575743 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.575728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.575844 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.575745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.575844 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.575826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grm7j\" (UniqueName: \"kubernetes.io/projected/e218acb1-014b-434b-b42e-2ec89cc57262-kube-api-access-grm7j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.676919 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.676883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.677101 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.676928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.677101 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.676957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.677101 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.676995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grm7j\" (UniqueName: \"kubernetes.io/projected/e218acb1-014b-434b-b42e-2ec89cc57262-kube-api-access-grm7j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.677101 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.677023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.677281 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.677181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e218acb1-014b-434b-b42e-2ec89cc57262-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.677357 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.677303 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.677464 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.677437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.677655 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.677638 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.679188 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.679165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e218acb1-014b-434b-b42e-2ec89cc57262-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.679496 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.679478 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e218acb1-014b-434b-b42e-2ec89cc57262-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.685264 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.685238 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grm7j\" (UniqueName: \"kubernetes.io/projected/e218acb1-014b-434b-b42e-2ec89cc57262-kube-api-access-grm7j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv\" (UID: \"e218acb1-014b-434b-b42e-2ec89cc57262\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.810560 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.810485 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:44.936143 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.936114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv"] Jul 23 17:15:44.938092 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:15:44.938055 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode218acb1_014b_434b_b42e_2ec89cc57262.slice/crio-6ca282238e614ff27caa7b7068012cb5b53d469f3cf9b4744aa4b85da1c40b87 WatchSource:0}: Error finding container 6ca282238e614ff27caa7b7068012cb5b53d469f3cf9b4744aa4b85da1c40b87: Status 404 returned error can't find the container with id 6ca282238e614ff27caa7b7068012cb5b53d469f3cf9b4744aa4b85da1c40b87 Jul 23 17:15:44.939431 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:44.939413 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 17:15:45.391870 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:45.391831 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" event={"ID":"e218acb1-014b-434b-b42e-2ec89cc57262","Type":"ContainerStarted","Data":"6ca282238e614ff27caa7b7068012cb5b53d469f3cf9b4744aa4b85da1c40b87"} Jul 23 17:15:45.932774 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:45.932750 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:15:46.397056 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:46.397020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" event={"ID":"e218acb1-014b-434b-b42e-2ec89cc57262","Type":"ContainerStarted","Data":"97be9164a4dc6d45ba686e6a3c740edf7e3c0ca274f70b308e01fc8afcba6767"} Jul 23 17:15:54.811626 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:54.811580 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:54.812225 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:54.811659 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:54.823904 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:54.823878 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:15:54.849101 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:54.849050 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" podStartSLOduration=9.8617196 podStartE2EDuration="10.849034661s" totalImagesPullingTime="987.315061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:15:46.425358157 +0000 UTC m=+641.230003054" watchObservedRunningTime="2026-07-23 17:15:54.849034661 +0000 UTC m=+649.653679536" Jul 23 17:15:55.444648 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:15:55.444616 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv" Jul 23 17:16:01.205407 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:01.205375 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:16:08.409262 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.409219 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq"] Jul 23 17:16:08.412734 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.412710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.417298 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.417278 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 23 17:16:08.437311 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.437280 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq"] Jul 23 17:16:08.486421 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.486372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.486610 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.486451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.486610 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.486489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cwbc\" (UniqueName: \"kubernetes.io/projected/87b32459-4b30-4b70-beb5-d094f3057597-kube-api-access-6cwbc\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.486610 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.486562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87b32459-4b30-4b70-beb5-d094f3057597-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.486610 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.486595 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.486610 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.486612 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.587466 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.587427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.587466 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.587466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.587684 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.587503 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.587684 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.587538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.587684 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.587575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cwbc\" (UniqueName: \"kubernetes.io/projected/87b32459-4b30-4b70-beb5-d094f3057597-kube-api-access-6cwbc\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.587684 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.587636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87b32459-4b30-4b70-beb5-d094f3057597-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.587964 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.587914 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.588114 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.588085 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.588114 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.588099 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.589700 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.589680 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87b32459-4b30-4b70-beb5-d094f3057597-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.590124 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.590104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87b32459-4b30-4b70-beb5-d094f3057597-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.618055 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.618026 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cwbc\" (UniqueName: \"kubernetes.io/projected/87b32459-4b30-4b70-beb5-d094f3057597-kube-api-access-6cwbc\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-q67dq\" (UID: \"87b32459-4b30-4b70-beb5-d094f3057597\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.721562 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.721477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:08.858737 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:08.858704 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq"] Jul 23 17:16:08.862608 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:16:08.862576 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87b32459_4b30_4b70_beb5_d094f3057597.slice/crio-190bd1d455afbcaaf8bcc4985e171db24b1cbbdc850f0e6ebc2211c4b2dc67f2 WatchSource:0}: Error finding container 190bd1d455afbcaaf8bcc4985e171db24b1cbbdc850f0e6ebc2211c4b2dc67f2: Status 404 returned error can't find the container with id 190bd1d455afbcaaf8bcc4985e171db24b1cbbdc850f0e6ebc2211c4b2dc67f2 Jul 23 17:16:09.496730 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:09.496683 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" event={"ID":"87b32459-4b30-4b70-beb5-d094f3057597","Type":"ContainerStarted","Data":"e178737f5d9ffd18c7fa8c15660c1ef690d9a6ceb5f20ec4a1439ad21b54ffb3"} Jul 23 17:16:09.496730 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:09.496734 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" event={"ID":"87b32459-4b30-4b70-beb5-d094f3057597","Type":"ContainerStarted","Data":"190bd1d455afbcaaf8bcc4985e171db24b1cbbdc850f0e6ebc2211c4b2dc67f2"} Jul 23 17:16:11.298712 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:11.298651 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" podStartSLOduration=3.117557542 podStartE2EDuration="3.298632146s" totalImagesPullingTime="181.074604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:16:09.52589576 +0000 UTC m=+664.330540657" watchObservedRunningTime="2026-07-23 17:16:11.298632146 +0000 UTC m=+666.103277043" Jul 23 17:16:11.299477 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:11.299458 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:16:18.722488 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:18.722448 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:18.722867 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:18.722513 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:18.734748 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:18.734720 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:16:19.547044 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:16:19.547015 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-q67dq" Jul 23 17:17:12.618376 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.618342 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b7bdcf7d8-6sdxl"] Jul 23 17:17:12.620917 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.620896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b7bdcf7d8-6sdxl" Jul 23 17:17:12.623930 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.623910 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 23 17:17:12.624024 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.623911 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7gscs\"" Jul 23 17:17:12.632632 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.632610 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b7bdcf7d8-6sdxl"] Jul 23 17:17:12.664135 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.664114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/830b2d8d-3514-4c9f-8a8c-99d7e5533964-tls-cert\") pod \"authorino-6b7bdcf7d8-6sdxl\" (UID: \"830b2d8d-3514-4c9f-8a8c-99d7e5533964\") " pod="kuadrant-system/authorino-6b7bdcf7d8-6sdxl" Jul 23 17:17:12.664235 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.664145 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhzm9\" (UniqueName: \"kubernetes.io/projected/830b2d8d-3514-4c9f-8a8c-99d7e5533964-kube-api-access-qhzm9\") pod \"authorino-6b7bdcf7d8-6sdxl\" (UID: \"830b2d8d-3514-4c9f-8a8c-99d7e5533964\") " pod="kuadrant-system/authorino-6b7bdcf7d8-6sdxl" Jul 23 17:17:12.764652 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.764617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/830b2d8d-3514-4c9f-8a8c-99d7e5533964-tls-cert\") pod \"authorino-6b7bdcf7d8-6sdxl\" (UID: \"830b2d8d-3514-4c9f-8a8c-99d7e5533964\") " pod="kuadrant-system/authorino-6b7bdcf7d8-6sdxl" Jul 23 17:17:12.764801 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.764659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhzm9\" (UniqueName: \"kubernetes.io/projected/830b2d8d-3514-4c9f-8a8c-99d7e5533964-kube-api-access-qhzm9\") pod \"authorino-6b7bdcf7d8-6sdxl\" (UID: \"830b2d8d-3514-4c9f-8a8c-99d7e5533964\") " pod="kuadrant-system/authorino-6b7bdcf7d8-6sdxl" Jul 23 17:17:12.767173 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.767149 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/830b2d8d-3514-4c9f-8a8c-99d7e5533964-tls-cert\") pod \"authorino-6b7bdcf7d8-6sdxl\" (UID: \"830b2d8d-3514-4c9f-8a8c-99d7e5533964\") " pod="kuadrant-system/authorino-6b7bdcf7d8-6sdxl" Jul 23 17:17:12.772565 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.772540 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhzm9\" (UniqueName: \"kubernetes.io/projected/830b2d8d-3514-4c9f-8a8c-99d7e5533964-kube-api-access-qhzm9\") pod \"authorino-6b7bdcf7d8-6sdxl\" (UID: \"830b2d8d-3514-4c9f-8a8c-99d7e5533964\") " pod="kuadrant-system/authorino-6b7bdcf7d8-6sdxl" Jul 23 17:17:12.929217 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:12.929139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b7bdcf7d8-6sdxl" Jul 23 17:17:13.065418 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:13.065393 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b7bdcf7d8-6sdxl"] Jul 23 17:17:13.067588 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:17:13.067555 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod830b2d8d_3514_4c9f_8a8c_99d7e5533964.slice/crio-63001f160e52382424072b37facc2f9f8b8ef780f4511851dde791f40284a774 WatchSource:0}: Error finding container 63001f160e52382424072b37facc2f9f8b8ef780f4511851dde791f40284a774: Status 404 returned error can't find the container with id 63001f160e52382424072b37facc2f9f8b8ef780f4511851dde791f40284a774 Jul 23 17:17:13.778193 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:13.778155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b7bdcf7d8-6sdxl" event={"ID":"830b2d8d-3514-4c9f-8a8c-99d7e5533964","Type":"ContainerStarted","Data":"e3de4f96cdd629d3bc9afd1c865cb65f6df2372471267a3e8b3944be9155f888"} Jul 23 17:17:13.778538 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:13.778200 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b7bdcf7d8-6sdxl" event={"ID":"830b2d8d-3514-4c9f-8a8c-99d7e5533964","Type":"ContainerStarted","Data":"63001f160e52382424072b37facc2f9f8b8ef780f4511851dde791f40284a774"} Jul 23 17:17:13.799148 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:13.799095 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b7bdcf7d8-6sdxl" podStartSLOduration=1.18961995 podStartE2EDuration="1.799078172s" totalImagesPullingTime="609.458222ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:17:13.796637793 +0000 UTC m=+728.601282711" watchObservedRunningTime="2026-07-23 17:17:13.799078172 +0000 UTC m=+728.603723118" Jul 23 17:17:42.703953 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:42.703886 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:17:54.408978 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:17:54.408935 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:18:04.993380 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:18:04.993347 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:19:44.389387 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:19:44.389347 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:19:55.698198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:19:55.698159 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:20:05.625509 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:20:05.625471 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:20:05.635907 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:20:05.635878 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:20:33.904663 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:20:33.904627 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:20:44.121234 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:20:44.121195 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:20:53.266990 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:20:53.266955 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:21:04.998576 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:21:04.998535 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:21:13.604524 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:21:13.604484 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:21:24.120189 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:21:24.120150 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:21:35.898095 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:21:35.898009 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:21:46.085521 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:21:46.085482 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:22:11.491455 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:22:11.491419 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:22:21.909278 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:22:21.909239 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:22:45.800865 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:22:45.800825 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:22:56.898822 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:22:56.898788 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:23:14.095198 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:23:14.095154 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:23:23.793971 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:23:23.793934 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:23:33.306967 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:23:33.306928 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:23:42.796122 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:23:42.796082 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:23:51.909239 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:23:51.909200 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:25:05.653180 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:25:05.653152 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:25:05.667215 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:25:05.667193 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:25:42.107039 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:25:42.106996 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:25:51.601185 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:25:51.601151 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:26:07.722296 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:26:07.722262 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:26:20.092543 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:26:20.092504 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:26:31.708657 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:26:31.708617 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:26:41.005495 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:26:41.005456 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:26:51.424841 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:26:51.424808 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:27:01.101106 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:27:01.101063 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:27:11.394021 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:27:11.393981 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:27:22.026564 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:27:22.026525 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:27:36.013874 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:27:36.013803 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:27:53.906106 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:27:53.906068 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:28:04.006694 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:28:04.006652 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:28:20.109968 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:28:20.109931 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:28:38.104157 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:28:38.104120 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:29:01.916241 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:29:01.916210 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:29:14.894400 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:29:14.894363 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:29:21.704087 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:29:21.704053 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:29:39.233173 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:29:39.233137 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:29:48.493781 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:29:48.493746 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:29:58.301402 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:29:58.301363 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:30:05.684764 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:30:05.684735 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:30:05.688395 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:30:05.688374 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:30:08.637508 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:30:08.637469 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:30:17.721130 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:30:17.721093 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:30:27.796380 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:30:27.796289 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:30:41.205778 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:30:41.205670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:30:50.256571 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:30:50.256524 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:30:59.513165 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:30:59.513126 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:31:11.792153 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:31:11.792110 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:31:23.630665 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:31:23.630625 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:31:31.952767 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:31:31.952724 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:31:43.546252 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:31:43.546213 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:31:55.803273 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:31:55.803235 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:32:08.325641 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:32:08.325602 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:32:17.216051 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:32:17.216016 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:32:39.649668 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:32:39.649633 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:32:56.204456 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:32:56.204412 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:33:27.896071 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:33:27.895991 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:33:39.294226 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:33:39.294193 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:34:11.601946 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:34:11.598472 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:34:22.689809 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:34:22.689773 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:34:57.694885 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:34:57.694800 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:35:05.710712 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:35:05.710681 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:35:05.711159 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:35:05.711137 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:35:09.495794 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:35:09.495762 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:35:41.292344 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:35:41.292197 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:37:09.898522 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:37:09.898477 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:37:21.852831 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:37:21.852794 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:37:33.597823 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:37:33.597790 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:37:54.605560 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:37:54.605518 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:38:39.908154 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:38:39.908119 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:38:51.600552 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:38:51.600509 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:39:03.544712 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:39:03.544670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:39:26.243547 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:39:26.243504 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:39:34.593283 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:39:34.593195 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:40:05.746687 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:40:05.746654 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:40:05.747701 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:40:05.747679 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:40:26.501041 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:40:26.500994 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:40:36.187625 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:40:36.187583 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:41:28.893777 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:28.893740 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:41:43.421216 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:43.421179 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:41:54.300507 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:54.300466 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:41:56.303737 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.301161 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2"] Jul 23 17:41:56.306528 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.306501 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.309994 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.309969 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7363d9\"/\"test-model-7363d9-kserve-self-signed-certs\"" Jul 23 17:41:56.310132 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.310001 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7363d9\"/\"openshift-service-ca.crt\"" Jul 23 17:41:56.310132 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.309979 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7363d9\"/\"kube-root-ca.crt\"" Jul 23 17:41:56.310132 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.309982 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7363d9\"/\"default-dockercfg-j4qqz\"" Jul 23 17:41:56.315579 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.315561 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2"] Jul 23 17:41:56.415606 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.415574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-home\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.415742 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.415621 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-tmp-dir\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.415742 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.415662 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-model-cache\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.415742 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.415684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lxrb\" (UniqueName: \"kubernetes.io/projected/2c679ab5-8802-4364-b376-759911a2f322-kube-api-access-6lxrb\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.415742 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.415712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-dshm\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.415872 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.415766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c679ab5-8802-4364-b376-759911a2f322-tls-certs\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.516339 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.516290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-model-cache\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.516339 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.516341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lxrb\" (UniqueName: \"kubernetes.io/projected/2c679ab5-8802-4364-b376-759911a2f322-kube-api-access-6lxrb\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.516582 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.516521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-dshm\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.516582 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.516570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c679ab5-8802-4364-b376-759911a2f322-tls-certs\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.516790 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.516615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-home\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.516790 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.516677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-tmp-dir\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.516790 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.516730 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-model-cache\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.517096 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.517049 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-home\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.517224 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.517100 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-tmp-dir\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.518762 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.518741 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-dshm\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.519010 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.518995 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c679ab5-8802-4364-b376-759911a2f322-tls-certs\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.525614 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.525592 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lxrb\" (UniqueName: \"kubernetes.io/projected/2c679ab5-8802-4364-b376-759911a2f322-kube-api-access-6lxrb\") pod \"test-model-7363d9-kserve-f78bf7c7c-5dgb2\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.617591 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.617555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:41:56.752983 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:56.752954 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2"] Jul 23 17:41:56.755410 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:41:56.755382 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c679ab5_8802_4364_b376_759911a2f322.slice/crio-aed6022a6ea44fc2cc8a87db59c983318d2b55780c1345867cd64ea03bec9bc3 WatchSource:0}: Error finding container aed6022a6ea44fc2cc8a87db59c983318d2b55780c1345867cd64ea03bec9bc3: Status 404 returned error can't find the container with id aed6022a6ea44fc2cc8a87db59c983318d2b55780c1345867cd64ea03bec9bc3 Jul 23 17:41:57.046547 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:57.046440 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" event={"ID":"2c679ab5-8802-4364-b376-759911a2f322","Type":"ContainerStarted","Data":"001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48"} Jul 23 17:41:57.046547 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:57.046507 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" event={"ID":"2c679ab5-8802-4364-b376-759911a2f322","Type":"ContainerStarted","Data":"aed6022a6ea44fc2cc8a87db59c983318d2b55780c1345867cd64ea03bec9bc3"} Jul 23 17:41:57.073157 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:41:57.073058 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" podStartSLOduration=1.073034321 podStartE2EDuration="1.073034321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:41:57.071768922 +0000 UTC m=+2211.876413818" watchObservedRunningTime="2026-07-23 17:41:57.073034321 +0000 UTC m=+2211.877679252" Jul 23 17:42:06.618376 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:06.618303 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:42:06.618376 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:06.618389 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:42:06.630762 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:06.630737 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:42:07.098626 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:07.098598 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:42:07.293007 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:07.292971 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:42:38.692900 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:38.692863 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2"] Jul 23 17:42:42.209522 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:42.209483 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:42:53.712228 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:53.712168 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" podUID="2c679ab5-8802-4364-b376-759911a2f322" containerName="main" containerID="cri-o://001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48" gracePeriod=45 Jul 23 17:42:53.958948 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:53.958925 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:42:54.102448 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.102419 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-tmp-dir\") pod \"2c679ab5-8802-4364-b376-759911a2f322\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " Jul 23 17:42:54.102607 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.102467 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lxrb\" (UniqueName: \"kubernetes.io/projected/2c679ab5-8802-4364-b376-759911a2f322-kube-api-access-6lxrb\") pod \"2c679ab5-8802-4364-b376-759911a2f322\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " Jul 23 17:42:54.102607 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.102515 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-dshm\") pod \"2c679ab5-8802-4364-b376-759911a2f322\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " Jul 23 17:42:54.102607 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.102538 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c679ab5-8802-4364-b376-759911a2f322-tls-certs\") pod \"2c679ab5-8802-4364-b376-759911a2f322\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " Jul 23 17:42:54.102607 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.102563 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-model-cache\") pod \"2c679ab5-8802-4364-b376-759911a2f322\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " Jul 23 17:42:54.102607 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.102599 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-home\") pod \"2c679ab5-8802-4364-b376-759911a2f322\" (UID: \"2c679ab5-8802-4364-b376-759911a2f322\") " Jul 23 17:42:54.102855 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.102726 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c679ab5-8802-4364-b376-759911a2f322" (UID: "2c679ab5-8802-4364-b376-759911a2f322"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:42:54.102855 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.102841 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-tmp-dir\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:42:54.102944 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.102864 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c679ab5-8802-4364-b376-759911a2f322" (UID: "2c679ab5-8802-4364-b376-759911a2f322"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:42:54.102944 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.102897 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-home" (OuterVolumeSpecName: "home") pod "2c679ab5-8802-4364-b376-759911a2f322" (UID: "2c679ab5-8802-4364-b376-759911a2f322"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:42:54.104742 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.104720 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-dshm" (OuterVolumeSpecName: "dshm") pod "2c679ab5-8802-4364-b376-759911a2f322" (UID: "2c679ab5-8802-4364-b376-759911a2f322"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:42:54.104847 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.104764 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c679ab5-8802-4364-b376-759911a2f322-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c679ab5-8802-4364-b376-759911a2f322" (UID: "2c679ab5-8802-4364-b376-759911a2f322"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 17:42:54.104847 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.104787 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c679ab5-8802-4364-b376-759911a2f322-kube-api-access-6lxrb" (OuterVolumeSpecName: "kube-api-access-6lxrb") pod "2c679ab5-8802-4364-b376-759911a2f322" (UID: "2c679ab5-8802-4364-b376-759911a2f322"). InnerVolumeSpecName "kube-api-access-6lxrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 17:42:54.204083 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.204051 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-dshm\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:42:54.204083 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.204077 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c679ab5-8802-4364-b376-759911a2f322-tls-certs\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:42:54.204083 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.204088 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-model-cache\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:42:54.204083 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.204096 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c679ab5-8802-4364-b376-759911a2f322-home\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:42:54.204342 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.204104 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lxrb\" (UniqueName: \"kubernetes.io/projected/2c679ab5-8802-4364-b376-759911a2f322-kube-api-access-6lxrb\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:42:54.285612 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.285582 2581 generic.go:356] "Generic (PLEG): container finished" podID="2c679ab5-8802-4364-b376-759911a2f322" containerID="001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48" exitCode=0 Jul 23 17:42:54.285750 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.285629 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" Jul 23 17:42:54.285750 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.285670 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" event={"ID":"2c679ab5-8802-4364-b376-759911a2f322","Type":"ContainerDied","Data":"001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48"} Jul 23 17:42:54.285750 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.285715 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2" event={"ID":"2c679ab5-8802-4364-b376-759911a2f322","Type":"ContainerDied","Data":"aed6022a6ea44fc2cc8a87db59c983318d2b55780c1345867cd64ea03bec9bc3"} Jul 23 17:42:54.285750 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.285733 2581 scope.go:117] "RemoveContainer" containerID="001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48" Jul 23 17:42:54.294205 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.294189 2581 scope.go:117] "RemoveContainer" containerID="001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48" Jul 23 17:42:54.294494 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:42:54.294476 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48\": container with ID starting with 001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48 not found: ID does not exist" containerID="001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48" Jul 23 17:42:54.294552 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.294503 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48"} err="failed to get container status \"001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48\": rpc error: code = NotFound desc = could not find container \"001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48\": container with ID starting with 001e47e81fbfa7294bd837b85efa2ee2a93fa84f8a516c7e25b2c15e45dcfc48 not found: ID does not exist" Jul 23 17:42:54.308131 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.308112 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2"] Jul 23 17:42:54.311937 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:54.311917 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-7363d9/test-model-7363d9-kserve-f78bf7c7c-5dgb2"] Jul 23 17:42:55.216571 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:55.216535 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:42:55.822741 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:42:55.822708 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c679ab5-8802-4364-b376-759911a2f322" path="/var/lib/kubelet/pods/2c679ab5-8802-4364-b376-759911a2f322/volumes" Jul 23 17:43:16.009510 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:43:16.009467 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:43:35.955660 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:43:35.955629 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:43:48.708467 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:43:48.708428 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:44:09.085125 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:44:09.085085 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:44:38.996456 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:44:38.996419 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:44:58.096764 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:44:58.096728 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:45:05.771983 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:05.771953 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:45:05.774247 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:05.774223 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:45:09.292249 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:09.292212 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:45:11.289631 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.289598 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm"] Jul 23 17:45:11.289969 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.289895 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c679ab5-8802-4364-b376-759911a2f322" containerName="main" Jul 23 17:45:11.289969 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.289906 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c679ab5-8802-4364-b376-759911a2f322" containerName="main" Jul 23 17:45:11.289969 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.289955 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c679ab5-8802-4364-b376-759911a2f322" containerName="main" Jul 23 17:45:11.292783 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.292762 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.295269 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.295249 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b9d590\"/\"openshift-service-ca.crt\"" Jul 23 17:45:11.296196 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.296172 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b9d590\"/\"default-dockercfg-d2fpk\"" Jul 23 17:45:11.296328 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.296219 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b9d590\"/\"auth-test-model-b9d590-kserve-self-signed-certs\"" Jul 23 17:45:11.296403 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.296347 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b9d590\"/\"kube-root-ca.crt\"" Jul 23 17:45:11.303041 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.303020 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm"] Jul 23 17:45:11.381859 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.381832 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-tmp-dir\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.381971 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.381870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7vzk\" (UniqueName: \"kubernetes.io/projected/2a4283e1-11de-449d-8350-75e1877b3cdc-kube-api-access-j7vzk\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.381971 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.381892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-home\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.382043 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.381970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a4283e1-11de-449d-8350-75e1877b3cdc-tls-certs\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.382043 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.381992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-model-cache\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.382043 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.382017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-dshm\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.483009 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.482976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a4283e1-11de-449d-8350-75e1877b3cdc-tls-certs\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.483141 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.483022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-model-cache\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.483228 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.483207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-dshm\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.483266 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.483255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-tmp-dir\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.483305 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.483293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7vzk\" (UniqueName: \"kubernetes.io/projected/2a4283e1-11de-449d-8350-75e1877b3cdc-kube-api-access-j7vzk\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.483441 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.483335 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-home\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.483497 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.483478 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-model-cache\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.483677 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.483657 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-home\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.483742 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.483673 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-tmp-dir\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.485428 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.485403 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-dshm\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.485627 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.485609 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a4283e1-11de-449d-8350-75e1877b3cdc-tls-certs\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.491551 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.491530 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7vzk\" (UniqueName: \"kubernetes.io/projected/2a4283e1-11de-449d-8350-75e1877b3cdc-kube-api-access-j7vzk\") pod \"auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.602410 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.602390 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:11.726663 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.726636 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm"] Jul 23 17:45:11.728567 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:45:11.728542 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a4283e1_11de_449d_8350_75e1877b3cdc.slice/crio-2335f7fb24bd28cd801163745d208a3cefbc90ec8493ede708a2a8793b0d98dc WatchSource:0}: Error finding container 2335f7fb24bd28cd801163745d208a3cefbc90ec8493ede708a2a8793b0d98dc: Status 404 returned error can't find the container with id 2335f7fb24bd28cd801163745d208a3cefbc90ec8493ede708a2a8793b0d98dc Jul 23 17:45:11.854731 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.854670 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" event={"ID":"2a4283e1-11de-449d-8350-75e1877b3cdc","Type":"ContainerStarted","Data":"9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af"} Jul 23 17:45:11.854731 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.854714 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" event={"ID":"2a4283e1-11de-449d-8350-75e1877b3cdc","Type":"ContainerStarted","Data":"2335f7fb24bd28cd801163745d208a3cefbc90ec8493ede708a2a8793b0d98dc"} Jul 23 17:45:11.879807 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:11.879756 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" podStartSLOduration=0.879740202 podStartE2EDuration="879.740202ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:45:11.87901734 +0000 UTC m=+2406.683662236" watchObservedRunningTime="2026-07-23 17:45:11.879740202 +0000 UTC m=+2406.684385109" Jul 23 17:45:21.298545 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:21.298511 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:45:21.602608 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:21.602576 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:21.602608 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:21.602616 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:21.614578 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:21.614554 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:21.908523 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:21.908438 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:45:51.305544 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:45:51.305511 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:46:05.792334 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:46:05.792290 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:46:22.498336 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:46:22.498285 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:46:40.593302 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:46:40.593268 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:46:53.890272 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:46:53.890222 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:47:12.398184 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:47:12.398150 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:47:31.697428 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:47:31.697390 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:47:50.906921 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:47:50.906880 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:48:01.521240 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:01.521196 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm"] Jul 23 17:48:05.894712 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:05.894678 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:48:16.540741 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.540693 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" podUID="2a4283e1-11de-449d-8350-75e1877b3cdc" containerName="main" containerID="cri-o://9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af" gracePeriod=45 Jul 23 17:48:16.777498 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.777470 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:48:16.886667 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.886627 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a4283e1-11de-449d-8350-75e1877b3cdc-tls-certs\") pod \"2a4283e1-11de-449d-8350-75e1877b3cdc\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " Jul 23 17:48:16.886862 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.886677 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7vzk\" (UniqueName: \"kubernetes.io/projected/2a4283e1-11de-449d-8350-75e1877b3cdc-kube-api-access-j7vzk\") pod \"2a4283e1-11de-449d-8350-75e1877b3cdc\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " Jul 23 17:48:16.886862 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.886717 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-tmp-dir\") pod \"2a4283e1-11de-449d-8350-75e1877b3cdc\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " Jul 23 17:48:16.886862 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.886759 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-dshm\") pod \"2a4283e1-11de-449d-8350-75e1877b3cdc\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " Jul 23 17:48:16.886862 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.886797 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-home\") pod \"2a4283e1-11de-449d-8350-75e1877b3cdc\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " Jul 23 17:48:16.886862 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.886859 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-model-cache\") pod \"2a4283e1-11de-449d-8350-75e1877b3cdc\" (UID: \"2a4283e1-11de-449d-8350-75e1877b3cdc\") " Jul 23 17:48:16.887104 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.887016 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a4283e1-11de-449d-8350-75e1877b3cdc" (UID: "2a4283e1-11de-449d-8350-75e1877b3cdc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:48:16.887154 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.887121 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-home" (OuterVolumeSpecName: "home") pod "2a4283e1-11de-449d-8350-75e1877b3cdc" (UID: "2a4283e1-11de-449d-8350-75e1877b3cdc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:48:16.887223 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.887160 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-tmp-dir\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:48:16.887223 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.887203 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a4283e1-11de-449d-8350-75e1877b3cdc" (UID: "2a4283e1-11de-449d-8350-75e1877b3cdc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:48:16.889047 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.889005 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-dshm" (OuterVolumeSpecName: "dshm") pod "2a4283e1-11de-449d-8350-75e1877b3cdc" (UID: "2a4283e1-11de-449d-8350-75e1877b3cdc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:48:16.889047 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.889025 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a4283e1-11de-449d-8350-75e1877b3cdc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a4283e1-11de-449d-8350-75e1877b3cdc" (UID: "2a4283e1-11de-449d-8350-75e1877b3cdc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 17:48:16.889195 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.889025 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a4283e1-11de-449d-8350-75e1877b3cdc-kube-api-access-j7vzk" (OuterVolumeSpecName: "kube-api-access-j7vzk") pod "2a4283e1-11de-449d-8350-75e1877b3cdc" (UID: "2a4283e1-11de-449d-8350-75e1877b3cdc"). InnerVolumeSpecName "kube-api-access-j7vzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 17:48:16.987678 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.987637 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-home\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:48:16.987678 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.987675 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-model-cache\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:48:16.987864 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.987689 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a4283e1-11de-449d-8350-75e1877b3cdc-tls-certs\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:48:16.987864 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.987702 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7vzk\" (UniqueName: \"kubernetes.io/projected/2a4283e1-11de-449d-8350-75e1877b3cdc-kube-api-access-j7vzk\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:48:16.987864 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:16.987793 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a4283e1-11de-449d-8350-75e1877b3cdc-dshm\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:48:17.628046 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:17.628010 2581 generic.go:356] "Generic (PLEG): container finished" podID="2a4283e1-11de-449d-8350-75e1877b3cdc" containerID="9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af" exitCode=0 Jul 23 17:48:17.628046 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:17.628048 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" Jul 23 17:48:17.628515 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:17.628087 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" event={"ID":"2a4283e1-11de-449d-8350-75e1877b3cdc","Type":"ContainerDied","Data":"9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af"} Jul 23 17:48:17.628515 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:17.628131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm" event={"ID":"2a4283e1-11de-449d-8350-75e1877b3cdc","Type":"ContainerDied","Data":"2335f7fb24bd28cd801163745d208a3cefbc90ec8493ede708a2a8793b0d98dc"} Jul 23 17:48:17.628515 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:17.628151 2581 scope.go:117] "RemoveContainer" containerID="9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af" Jul 23 17:48:17.638467 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:17.638415 2581 scope.go:117] "RemoveContainer" containerID="9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af" Jul 23 17:48:17.638701 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:48:17.638684 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af\": container with ID starting with 9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af not found: ID does not exist" containerID="9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af" Jul 23 17:48:17.638745 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:17.638708 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af"} err="failed to get container status \"9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af\": rpc error: code = NotFound desc = could not find container \"9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af\": container with ID starting with 9d4eec88bc20bb63a5925a6f884ecf0b2e7ec5cedc5d3c576420e3fba45974af not found: ID does not exist" Jul 23 17:48:17.649975 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:17.649954 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm"] Jul 23 17:48:17.654381 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:17.654361 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-b9d590/auth-test-model-b9d590-kserve-6fd6d849cf-7dbnm"] Jul 23 17:48:17.822066 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:17.822035 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a4283e1-11de-449d-8350-75e1877b3cdc" path="/var/lib/kubelet/pods/2a4283e1-11de-449d-8350-75e1877b3cdc/volumes" Jul 23 17:48:23.200353 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:23.200301 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:48:41.791975 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.791894 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9"] Jul 23 17:48:41.792368 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.792242 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a4283e1-11de-449d-8350-75e1877b3cdc" containerName="main" Jul 23 17:48:41.792368 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.792256 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a4283e1-11de-449d-8350-75e1877b3cdc" containerName="main" Jul 23 17:48:41.792368 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.792332 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a4283e1-11de-449d-8350-75e1877b3cdc" containerName="main" Jul 23 17:48:41.796688 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.796666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:41.799610 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.799587 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9c4020\"/\"kube-root-ca.crt\"" Jul 23 17:48:41.800494 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.800473 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9c4020\"/\"default-dockercfg-hvqd9\"" Jul 23 17:48:41.800593 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.800571 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9c4020\"/\"sub-test-model-9c4020-kserve-self-signed-certs\"" Jul 23 17:48:41.800593 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.800585 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9c4020\"/\"openshift-service-ca.crt\"" Jul 23 17:48:41.805694 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.805671 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9"] Jul 23 17:48:41.902424 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.902391 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-tmp-dir\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:41.902424 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.902428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-home\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:41.902651 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.902465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-dshm\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:41.902651 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.902507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76wmp\" (UniqueName: \"kubernetes.io/projected/0a9a6c00-c056-4f6f-a40c-71179c95301a-kube-api-access-76wmp\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:41.902651 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.902531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-model-cache\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:41.902790 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:41.902704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9a6c00-c056-4f6f-a40c-71179c95301a-tls-certs\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.003839 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.003804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9a6c00-c056-4f6f-a40c-71179c95301a-tls-certs\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.004040 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.003853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-tmp-dir\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.004040 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.003873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-home\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.004040 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.003889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-dshm\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.004040 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.003910 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76wmp\" (UniqueName: \"kubernetes.io/projected/0a9a6c00-c056-4f6f-a40c-71179c95301a-kube-api-access-76wmp\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.004040 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.003939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-model-cache\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.004305 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.004268 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-home\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.004386 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.004346 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-tmp-dir\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.004430 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.004411 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-model-cache\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.006105 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.006083 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-dshm\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.006476 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.006459 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9a6c00-c056-4f6f-a40c-71179c95301a-tls-certs\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.011900 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.011878 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76wmp\" (UniqueName: \"kubernetes.io/projected/0a9a6c00-c056-4f6f-a40c-71179c95301a-kube-api-access-76wmp\") pod \"sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.106997 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.106961 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:42.232425 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.232335 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9"] Jul 23 17:48:42.234669 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:48:42.234643 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a9a6c00_c056_4f6f_a40c_71179c95301a.slice/crio-ef6de43642d8a0283a8698b085faaec2534061d78274a4fc3d12b3351a742f9a WatchSource:0}: Error finding container ef6de43642d8a0283a8698b085faaec2534061d78274a4fc3d12b3351a742f9a: Status 404 returned error can't find the container with id ef6de43642d8a0283a8698b085faaec2534061d78274a4fc3d12b3351a742f9a Jul 23 17:48:42.737733 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.737700 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" event={"ID":"0a9a6c00-c056-4f6f-a40c-71179c95301a","Type":"ContainerStarted","Data":"f1177cfdb8a972cf26d9f5d2331b14db8db4a45e11da4e445416546a17ded3ea"} Jul 23 17:48:42.737911 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.737743 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" event={"ID":"0a9a6c00-c056-4f6f-a40c-71179c95301a","Type":"ContainerStarted","Data":"ef6de43642d8a0283a8698b085faaec2534061d78274a4fc3d12b3351a742f9a"} Jul 23 17:48:42.755833 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:42.755789 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" podStartSLOduration=1.7557735719999998 podStartE2EDuration="1.755773572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:48:42.75442679 +0000 UTC m=+2617.559071691" watchObservedRunningTime="2026-07-23 17:48:42.755773572 +0000 UTC m=+2617.560418468" Jul 23 17:48:45.996255 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:45.996226 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:48:52.107574 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:52.107537 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:52.107574 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:52.107585 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:52.120108 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:52.120079 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:52.791423 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:52.791391 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:48:59.904214 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:48:59.904176 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:49:20.517102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:20.517066 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:49:27.808980 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:27.808948 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9"] Jul 23 17:49:38.498381 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:38.498340 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:49:42.829793 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:42.829730 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" podUID="0a9a6c00-c056-4f6f-a40c-71179c95301a" containerName="main" containerID="cri-o://f1177cfdb8a972cf26d9f5d2331b14db8db4a45e11da4e445416546a17ded3ea" gracePeriod=45 Jul 23 17:49:42.992850 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:42.992812 2581 generic.go:356] "Generic (PLEG): container finished" podID="0a9a6c00-c056-4f6f-a40c-71179c95301a" containerID="f1177cfdb8a972cf26d9f5d2331b14db8db4a45e11da4e445416546a17ded3ea" exitCode=0 Jul 23 17:49:42.992994 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:42.992874 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" event={"ID":"0a9a6c00-c056-4f6f-a40c-71179c95301a","Type":"ContainerDied","Data":"f1177cfdb8a972cf26d9f5d2331b14db8db4a45e11da4e445416546a17ded3ea"} Jul 23 17:49:43.079205 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.079182 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:49:43.245305 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.245218 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-dshm\") pod \"0a9a6c00-c056-4f6f-a40c-71179c95301a\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " Jul 23 17:49:43.245305 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.245251 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-home\") pod \"0a9a6c00-c056-4f6f-a40c-71179c95301a\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " Jul 23 17:49:43.245305 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.245270 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9a6c00-c056-4f6f-a40c-71179c95301a-tls-certs\") pod \"0a9a6c00-c056-4f6f-a40c-71179c95301a\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " Jul 23 17:49:43.245594 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.245336 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-tmp-dir\") pod \"0a9a6c00-c056-4f6f-a40c-71179c95301a\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " Jul 23 17:49:43.245594 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.245378 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76wmp\" (UniqueName: \"kubernetes.io/projected/0a9a6c00-c056-4f6f-a40c-71179c95301a-kube-api-access-76wmp\") pod \"0a9a6c00-c056-4f6f-a40c-71179c95301a\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " Jul 23 17:49:43.245594 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.245424 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-model-cache\") pod \"0a9a6c00-c056-4f6f-a40c-71179c95301a\" (UID: \"0a9a6c00-c056-4f6f-a40c-71179c95301a\") " Jul 23 17:49:43.245594 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.245547 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-home" (OuterVolumeSpecName: "home") pod "0a9a6c00-c056-4f6f-a40c-71179c95301a" (UID: "0a9a6c00-c056-4f6f-a40c-71179c95301a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:49:43.245811 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.245653 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0a9a6c00-c056-4f6f-a40c-71179c95301a" (UID: "0a9a6c00-c056-4f6f-a40c-71179c95301a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:49:43.245811 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.245737 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-home\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:49:43.245811 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.245753 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-model-cache" (OuterVolumeSpecName: "model-cache") pod "0a9a6c00-c056-4f6f-a40c-71179c95301a" (UID: "0a9a6c00-c056-4f6f-a40c-71179c95301a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:49:43.247625 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.247598 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9a6c00-c056-4f6f-a40c-71179c95301a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0a9a6c00-c056-4f6f-a40c-71179c95301a" (UID: "0a9a6c00-c056-4f6f-a40c-71179c95301a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 17:49:43.247625 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.247615 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a9a6c00-c056-4f6f-a40c-71179c95301a-kube-api-access-76wmp" (OuterVolumeSpecName: "kube-api-access-76wmp") pod "0a9a6c00-c056-4f6f-a40c-71179c95301a" (UID: "0a9a6c00-c056-4f6f-a40c-71179c95301a"). InnerVolumeSpecName "kube-api-access-76wmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 17:49:43.247807 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.247601 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-dshm" (OuterVolumeSpecName: "dshm") pod "0a9a6c00-c056-4f6f-a40c-71179c95301a" (UID: "0a9a6c00-c056-4f6f-a40c-71179c95301a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:49:43.346180 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.346142 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-tmp-dir\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:49:43.346180 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.346173 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76wmp\" (UniqueName: \"kubernetes.io/projected/0a9a6c00-c056-4f6f-a40c-71179c95301a-kube-api-access-76wmp\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:49:43.346180 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.346184 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-model-cache\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:49:43.346458 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.346192 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a9a6c00-c056-4f6f-a40c-71179c95301a-dshm\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:49:43.346458 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.346200 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a9a6c00-c056-4f6f-a40c-71179c95301a-tls-certs\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:49:43.997952 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.997923 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" Jul 23 17:49:43.997952 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.997950 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9" event={"ID":"0a9a6c00-c056-4f6f-a40c-71179c95301a","Type":"ContainerDied","Data":"ef6de43642d8a0283a8698b085faaec2534061d78274a4fc3d12b3351a742f9a"} Jul 23 17:49:43.998407 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:43.998000 2581 scope.go:117] "RemoveContainer" containerID="f1177cfdb8a972cf26d9f5d2331b14db8db4a45e11da4e445416546a17ded3ea" Jul 23 17:49:44.015098 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:44.015069 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9"] Jul 23 17:49:44.018691 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:44.018667 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/sub-test-model-9c4020-kserve-7dcb5ff467-8n8n9"] Jul 23 17:49:45.822583 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:45.822549 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a9a6c00-c056-4f6f-a40c-71179c95301a" path="/var/lib/kubelet/pods/0a9a6c00-c056-4f6f-a40c-71179c95301a/volumes" Jul 23 17:49:48.089965 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:49:48.089932 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:50:03.632562 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.632524 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh"] Jul 23 17:50:03.632932 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.632816 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9a6c00-c056-4f6f-a40c-71179c95301a" containerName="main" Jul 23 17:50:03.632932 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.632827 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9a6c00-c056-4f6f-a40c-71179c95301a" containerName="main" Jul 23 17:50:03.632932 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.632880 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9a6c00-c056-4f6f-a40c-71179c95301a" containerName="main" Jul 23 17:50:03.637293 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.637274 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.640812 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.640794 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9c4020\"/\"kube-root-ca.crt\"" Jul 23 17:50:03.641910 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.641893 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9c4020\"/\"openshift-service-ca.crt\"" Jul 23 17:50:03.641999 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.641897 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9c4020\"/\"rate-test-model-9c4020-kserve-self-signed-certs\"" Jul 23 17:50:03.641999 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.641897 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9c4020\"/\"default-dockercfg-hvqd9\"" Jul 23 17:50:03.666956 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.666933 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh"] Jul 23 17:50:03.707911 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.707882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-model-cache\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.708030 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.707922 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-home\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.708030 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.707939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-dshm\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.708030 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.708020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186b3dec-b33f-48c7-9706-c8fe7ce33026-tls-certs\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.708134 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.708099 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-748k2\" (UniqueName: \"kubernetes.io/projected/186b3dec-b33f-48c7-9706-c8fe7ce33026-kube-api-access-748k2\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.708168 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.708128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-tmp-dir\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.808623 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.808589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-748k2\" (UniqueName: \"kubernetes.io/projected/186b3dec-b33f-48c7-9706-c8fe7ce33026-kube-api-access-748k2\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.808754 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.808634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-tmp-dir\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.808814 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.808747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-model-cache\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.808814 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.808807 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-home\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.808911 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.808835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-dshm\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.808911 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.808886 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186b3dec-b33f-48c7-9706-c8fe7ce33026-tls-certs\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.809142 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.809124 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-tmp-dir\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.809216 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.809160 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-home\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.809255 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.809236 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-model-cache\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.811074 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.811057 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-dshm\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.811487 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.811468 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186b3dec-b33f-48c7-9706-c8fe7ce33026-tls-certs\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.820407 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.820384 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-748k2\" (UniqueName: \"kubernetes.io/projected/186b3dec-b33f-48c7-9706-c8fe7ce33026-kube-api-access-748k2\") pod \"rate-test-model-9c4020-kserve-6c56dcc595-tv8lh\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:03.946148 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:03.946062 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:04.074910 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:04.074864 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh"] Jul 23 17:50:04.077475 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:50:04.077445 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod186b3dec_b33f_48c7_9706_c8fe7ce33026.slice/crio-4e6a5ff4f6703f60fbb93399165066bc30981427ec53a94bcdcd71aea031a0c0 WatchSource:0}: Error finding container 4e6a5ff4f6703f60fbb93399165066bc30981427ec53a94bcdcd71aea031a0c0: Status 404 returned error can't find the container with id 4e6a5ff4f6703f60fbb93399165066bc30981427ec53a94bcdcd71aea031a0c0 Jul 23 17:50:04.084677 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:04.084654 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" event={"ID":"186b3dec-b33f-48c7-9706-c8fe7ce33026","Type":"ContainerStarted","Data":"4e6a5ff4f6703f60fbb93399165066bc30981427ec53a94bcdcd71aea031a0c0"} Jul 23 17:50:05.090913 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:05.090878 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" event={"ID":"186b3dec-b33f-48c7-9706-c8fe7ce33026","Type":"ContainerStarted","Data":"6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb"} Jul 23 17:50:05.109274 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:05.109227 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" podStartSLOduration=2.109212487 podStartE2EDuration="2.109212487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:50:05.107816926 +0000 UTC m=+2699.912461860" watchObservedRunningTime="2026-07-23 17:50:05.109212487 +0000 UTC m=+2699.913857384" Jul 23 17:50:05.796102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:05.796072 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:50:05.797660 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:05.797640 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9bc2p_068419c3-d512-409e-9d03-7cd312f55176/ovn-acl-logging/0.log" Jul 23 17:50:07.301651 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:07.301610 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:50:13.947111 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:13.947071 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:13.947584 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:13.947134 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:13.959453 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:13.959428 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:14.138737 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:14.138710 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:19.000682 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:19.000645 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:50:36.590042 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:36.590002 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:50:41.846299 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:41.846263 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh"] Jul 23 17:50:51.794619 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:51.794585 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:50:56.865423 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:56.865373 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" podUID="186b3dec-b33f-48c7-9706-c8fe7ce33026" containerName="main" containerID="cri-o://6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb" gracePeriod=45 Jul 23 17:50:57.102994 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.102967 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:57.174569 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174512 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-tmp-dir\") pod \"186b3dec-b33f-48c7-9706-c8fe7ce33026\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " Jul 23 17:50:57.174569 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174548 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-748k2\" (UniqueName: \"kubernetes.io/projected/186b3dec-b33f-48c7-9706-c8fe7ce33026-kube-api-access-748k2\") pod \"186b3dec-b33f-48c7-9706-c8fe7ce33026\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " Jul 23 17:50:57.174736 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174586 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-model-cache\") pod \"186b3dec-b33f-48c7-9706-c8fe7ce33026\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " Jul 23 17:50:57.174736 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174634 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-home\") pod \"186b3dec-b33f-48c7-9706-c8fe7ce33026\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " Jul 23 17:50:57.174736 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174663 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186b3dec-b33f-48c7-9706-c8fe7ce33026-tls-certs\") pod \"186b3dec-b33f-48c7-9706-c8fe7ce33026\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " Jul 23 17:50:57.174736 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174701 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-dshm\") pod \"186b3dec-b33f-48c7-9706-c8fe7ce33026\" (UID: \"186b3dec-b33f-48c7-9706-c8fe7ce33026\") " Jul 23 17:50:57.174959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174804 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "186b3dec-b33f-48c7-9706-c8fe7ce33026" (UID: "186b3dec-b33f-48c7-9706-c8fe7ce33026"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:50:57.174959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174831 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-model-cache" (OuterVolumeSpecName: "model-cache") pod "186b3dec-b33f-48c7-9706-c8fe7ce33026" (UID: "186b3dec-b33f-48c7-9706-c8fe7ce33026"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:50:57.174959 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174903 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-home" (OuterVolumeSpecName: "home") pod "186b3dec-b33f-48c7-9706-c8fe7ce33026" (UID: "186b3dec-b33f-48c7-9706-c8fe7ce33026"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:50:57.175102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174970 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-tmp-dir\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:50:57.175102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174984 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-model-cache\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:50:57.175102 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.174995 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-home\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:50:57.176535 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.176509 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186b3dec-b33f-48c7-9706-c8fe7ce33026-kube-api-access-748k2" (OuterVolumeSpecName: "kube-api-access-748k2") pod "186b3dec-b33f-48c7-9706-c8fe7ce33026" (UID: "186b3dec-b33f-48c7-9706-c8fe7ce33026"). InnerVolumeSpecName "kube-api-access-748k2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 17:50:57.176671 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.176655 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-dshm" (OuterVolumeSpecName: "dshm") pod "186b3dec-b33f-48c7-9706-c8fe7ce33026" (UID: "186b3dec-b33f-48c7-9706-c8fe7ce33026"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 17:50:57.176719 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.176704 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/186b3dec-b33f-48c7-9706-c8fe7ce33026-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "186b3dec-b33f-48c7-9706-c8fe7ce33026" (UID: "186b3dec-b33f-48c7-9706-c8fe7ce33026"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 17:50:57.275700 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.275666 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186b3dec-b33f-48c7-9706-c8fe7ce33026-tls-certs\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:50:57.275700 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.275694 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186b3dec-b33f-48c7-9706-c8fe7ce33026-dshm\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:50:57.275700 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.275703 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-748k2\" (UniqueName: \"kubernetes.io/projected/186b3dec-b33f-48c7-9706-c8fe7ce33026-kube-api-access-748k2\") on node \"ip-10-0-133-26.ec2.internal\" DevicePath \"\"" Jul 23 17:50:57.312724 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.312695 2581 generic.go:356] "Generic (PLEG): container finished" podID="186b3dec-b33f-48c7-9706-c8fe7ce33026" containerID="6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb" exitCode=0 Jul 23 17:50:57.312835 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.312737 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" Jul 23 17:50:57.312835 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.312763 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" event={"ID":"186b3dec-b33f-48c7-9706-c8fe7ce33026","Type":"ContainerDied","Data":"6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb"} Jul 23 17:50:57.312835 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.312793 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh" event={"ID":"186b3dec-b33f-48c7-9706-c8fe7ce33026","Type":"ContainerDied","Data":"4e6a5ff4f6703f60fbb93399165066bc30981427ec53a94bcdcd71aea031a0c0"} Jul 23 17:50:57.312835 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.312808 2581 scope.go:117] "RemoveContainer" containerID="6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb" Jul 23 17:50:57.321501 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.321482 2581 scope.go:117] "RemoveContainer" containerID="6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb" Jul 23 17:50:57.321747 ip-10-0-133-26 kubenswrapper[2581]: E0723 17:50:57.321729 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb\": container with ID starting with 6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb not found: ID does not exist" containerID="6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb" Jul 23 17:50:57.321802 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.321755 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb"} err="failed to get container status \"6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb\": rpc error: code = NotFound desc = could not find container \"6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb\": container with ID starting with 6bc838caf34c9d4994a3c16c5b943fa6ec61428e26d92abb7146cc3b6a0540cb not found: ID does not exist" Jul 23 17:50:57.336489 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.336466 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh"] Jul 23 17:50:57.341010 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.340982 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-9c4020/rate-test-model-9c4020-kserve-6c56dcc595-tv8lh"] Jul 23 17:50:57.822688 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:50:57.822657 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="186b3dec-b33f-48c7-9706-c8fe7ce33026" path="/var/lib/kubelet/pods/186b3dec-b33f-48c7-9706-c8fe7ce33026/volumes" Jul 23 17:51:15.227359 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:15.227310 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:51:37.511744 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:37.511713 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-lsqrb"] Jul 23 17:51:46.810200 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:46.810169 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b7bdcf7d8-6sdxl_830b2d8d-3514-4c9f-8a8c-99d7e5533964/authorino/0.log" Jul 23 17:51:52.410938 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:52.410902 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ldc7g_0b184c91-8196-4d3c-89ab-8507c29383cc/manager/0.log" Jul 23 17:51:53.282028 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:53.281998 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9b469455-r5ccq_921889ac-c420-408d-8d61-378f9bd43cf5/copy-manifests/0.log" Jul 23 17:51:53.289918 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:53.289894 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9b469455-r5ccq_921889ac-c420-408d-8d61-378f9bd43cf5/manager/0.log" Jul 23 17:51:55.404733 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:55.404706 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b7bdcf7d8-6sdxl_830b2d8d-3514-4c9f-8a8c-99d7e5533964/authorino/0.log" Jul 23 17:51:55.795720 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:55.795642 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n8r97_c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e/kuadrant-console-plugin/0.log" Jul 23 17:51:56.160218 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:56.160189 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lsqrb_f7c626f0-add6-44c9-9cad-6aafdd84a15a/limitador/0.log" Jul 23 17:51:57.023706 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:57.023680 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7466c75dcd-ktcgn_0f0f1635-65a6-4622-87ee-aa03ad1894b3/kube-auth-proxy/0.log" Jul 23 17:51:58.241715 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:58.241687 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fllmwv_e218acb1-014b-434b-b42e-2ec89cc57262/main/0.log" Jul 23 17:51:58.484249 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:51:58.484224 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-q67dq_87b32459-4b30-4b70-beb5-d094f3057597/main/0.log" Jul 23 17:52:07.583383 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:07.583348 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9jkkx_143e3a8b-7387-4e40-86c9-455659d49a11/global-pull-secret-syncer/0.log" Jul 23 17:52:07.770868 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:07.770839 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wrj4r_cf506efa-b074-4b87-b481-a44b1638de43/konnectivity-agent/0.log" Jul 23 17:52:07.825027 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:07.824988 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-26.ec2.internal_cd213ca292eddf0c2794f6b5c3faa4a3/haproxy/0.log" Jul 23 17:52:12.452868 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:12.452839 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b7bdcf7d8-6sdxl_830b2d8d-3514-4c9f-8a8c-99d7e5533964/authorino/0.log" Jul 23 17:52:12.573077 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:12.573025 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n8r97_c8fdc4fc-a3cd-47db-af5f-0e8610c0d40e/kuadrant-console-plugin/0.log" Jul 23 17:52:12.875825 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:12.875800 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-lsqrb_f7c626f0-add6-44c9-9cad-6aafdd84a15a/limitador/0.log" Jul 23 17:52:15.016122 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.016086 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-56mkr_aaa120b8-9ba4-4ba8-82c3-b4d09b544205/kube-state-metrics/0.log" Jul 23 17:52:15.046451 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.046424 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-56mkr_aaa120b8-9ba4-4ba8-82c3-b4d09b544205/kube-rbac-proxy-main/0.log" Jul 23 17:52:15.075708 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.075645 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-56mkr_aaa120b8-9ba4-4ba8-82c3-b4d09b544205/kube-rbac-proxy-self/0.log" Jul 23 17:52:15.324211 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.324184 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzqkm_621b4bec-4be6-4dae-b3cb-5d25e1279673/node-exporter/0.log" Jul 23 17:52:15.351147 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.351085 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzqkm_621b4bec-4be6-4dae-b3cb-5d25e1279673/kube-rbac-proxy/0.log" Jul 23 17:52:15.380541 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.380519 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzqkm_621b4bec-4be6-4dae-b3cb-5d25e1279673/init-textfile/0.log" Jul 23 17:52:15.653578 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.653504 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_324c34e0-08ea-4777-a97c-fe82d2ce5753/prometheus/0.log" Jul 23 17:52:15.704693 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.704665 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_324c34e0-08ea-4777-a97c-fe82d2ce5753/config-reloader/0.log" Jul 23 17:52:15.753516 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.753471 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_324c34e0-08ea-4777-a97c-fe82d2ce5753/thanos-sidecar/0.log" Jul 23 17:52:15.809262 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.809237 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_324c34e0-08ea-4777-a97c-fe82d2ce5753/kube-rbac-proxy-web/0.log" Jul 23 17:52:15.835626 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.835601 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_324c34e0-08ea-4777-a97c-fe82d2ce5753/kube-rbac-proxy/0.log" Jul 23 17:52:15.861670 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.861651 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_324c34e0-08ea-4777-a97c-fe82d2ce5753/kube-rbac-proxy-thanos/0.log" Jul 23 17:52:15.890595 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:15.890576 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_324c34e0-08ea-4777-a97c-fe82d2ce5753/init-config-reloader/0.log" Jul 23 17:52:17.450156 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.450126 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4"] Jul 23 17:52:17.450555 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.450525 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="186b3dec-b33f-48c7-9706-c8fe7ce33026" containerName="main" Jul 23 17:52:17.450555 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.450539 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="186b3dec-b33f-48c7-9706-c8fe7ce33026" containerName="main" Jul 23 17:52:17.450623 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.450596 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="186b3dec-b33f-48c7-9706-c8fe7ce33026" containerName="main" Jul 23 17:52:17.453575 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.453555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.456111 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.456096 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5mz8v\"/\"openshift-service-ca.crt\"" Jul 23 17:52:17.457103 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.457087 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5mz8v\"/\"default-dockercfg-htj2r\"" Jul 23 17:52:17.457222 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.457132 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5mz8v\"/\"kube-root-ca.crt\"" Jul 23 17:52:17.465092 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.465072 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4"] Jul 23 17:52:17.535844 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.535805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-proc\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.536019 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.535861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-podres\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.536019 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.535936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-sys\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.536019 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.535963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-lib-modules\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.536019 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.535996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dbtr\" (UniqueName: \"kubernetes.io/projected/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-kube-api-access-6dbtr\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.636942 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.636902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dbtr\" (UniqueName: \"kubernetes.io/projected/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-kube-api-access-6dbtr\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.637153 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.636953 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-proc\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.637153 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.637011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-podres\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.637153 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.637044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-sys\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.637153 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.637084 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-lib-modules\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.637153 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.637121 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-proc\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.637153 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.637144 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-sys\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.637425 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.637174 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-podres\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.637425 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.637206 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-lib-modules\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.645358 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.645307 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dbtr\" (UniqueName: \"kubernetes.io/projected/d055a21f-f5d9-4705-8f09-8f9a66fa80f1-kube-api-access-6dbtr\") pod \"perf-node-gather-daemonset-2k4b4\" (UID: \"d055a21f-f5d9-4705-8f09-8f9a66fa80f1\") " pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.763741 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.763662 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:17.888552 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:17.888519 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4"] Jul 23 17:52:17.892041 ip-10-0-133-26 kubenswrapper[2581]: W0723 17:52:17.892012 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd055a21f_f5d9_4705_8f09_8f9a66fa80f1.slice/crio-cb9d4827a71b5e9e4d9247da9ffeccd7e14f4ec26746230c8a4cba88a5519625 WatchSource:0}: Error finding container cb9d4827a71b5e9e4d9247da9ffeccd7e14f4ec26746230c8a4cba88a5519625: Status 404 returned error can't find the container with id cb9d4827a71b5e9e4d9247da9ffeccd7e14f4ec26746230c8a4cba88a5519625 Jul 23 17:52:18.656190 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:18.656154 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" event={"ID":"d055a21f-f5d9-4705-8f09-8f9a66fa80f1","Type":"ContainerStarted","Data":"3d34a72a694cb05debb81b05fb11b440ef940c786c71eb9e27e77dc2ec10904b"} Jul 23 17:52:18.656542 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:18.656207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" event={"ID":"d055a21f-f5d9-4705-8f09-8f9a66fa80f1","Type":"ContainerStarted","Data":"cb9d4827a71b5e9e4d9247da9ffeccd7e14f4ec26746230c8a4cba88a5519625"} Jul 23 17:52:18.656542 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:18.656252 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:18.674358 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:18.674280 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" podStartSLOduration=1.6742587869999999 podStartE2EDuration="1.674258787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:52:18.672274323 +0000 UTC m=+2833.476919238" watchObservedRunningTime="2026-07-23 17:52:18.674258787 +0000 UTC m=+2833.478903684" Jul 23 17:52:18.790058 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:18.790029 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d7c9f6474-wqvt8_39f33f46-c394-4eb4-97a1-26d8b49c61f0/console/0.log" Jul 23 17:52:20.740357 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:20.740306 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x2tx7_ea5e9d5e-846a-40df-bf71-b2a3458e3bca/dns/0.log" Jul 23 17:52:20.763662 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:20.763637 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x2tx7_ea5e9d5e-846a-40df-bf71-b2a3458e3bca/kube-rbac-proxy/0.log" Jul 23 17:52:20.814647 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:20.814621 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m2wrn_51ab9b9c-f852-4682-8b4b-15c8660427fc/dns-node-resolver/0.log" Jul 23 17:52:21.495293 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:21.495263 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f869dc948-xdjdx_90c6bb0a-cc7f-4c77-aefa-6b2e31f8c6b9/registry/0.log" Jul 23 17:52:21.520953 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:21.520924 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2x4jv_59f02c49-1ffd-40ec-b7d4-9f038b855d9d/node-ca/0.log" Jul 23 17:52:22.816916 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:22.816888 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7466c75dcd-ktcgn_0f0f1635-65a6-4622-87ee-aa03ad1894b3/kube-auth-proxy/0.log" Jul 23 17:52:23.771732 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:23.771695 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mfdms_4d5fa5bc-4728-4daf-8328-4f3c45cf30d1/serve-healthcheck-canary/0.log" Jul 23 17:52:24.409367 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:24.409336 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6zt2f_5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b/kube-rbac-proxy/0.log" Jul 23 17:52:24.432425 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:24.432402 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6zt2f_5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b/exporter/0.log" Jul 23 17:52:24.456837 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:24.456811 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6zt2f_5a22afc1-b1c0-4bda-ac7b-9ccb5cdebf6b/extractor/0.log" Jul 23 17:52:24.669939 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:24.669866 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5mz8v/perf-node-gather-daemonset-2k4b4" Jul 23 17:52:26.924921 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:26.924890 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-ldc7g_0b184c91-8196-4d3c-89ab-8507c29383cc/manager/0.log" Jul 23 17:52:27.692795 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:27.692763 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9b469455-r5ccq_921889ac-c420-408d-8d61-378f9bd43cf5/manager/0.log" Jul 23 17:52:27.719463 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:27.719437 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9b469455-r5ccq_921889ac-c420-408d-8d61-378f9bd43cf5/copy-manifests/0.log" Jul 23 17:52:27.984513 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:27.984481 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7466c75dcd-ktcgn_0f0f1635-65a6-4622-87ee-aa03ad1894b3/kube-auth-proxy/0.log" Jul 23 17:52:29.064395 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:29.064367 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65fcfccbcc-grct6_a12c02aa-ff30-4acf-8b4e-2cecfdb00373/manager/0.log" Jul 23 17:52:29.107725 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:29.107699 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-w84pw_814db887-18d7-4571-b87a-81839e9e3f50/openshift-lws-operator/0.log" Jul 23 17:52:29.550364 ip-10-0-133-26 kubenswrapper[2581]: I0723 17:52:29.550313 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7466c75dcd-ktcgn_0f0f1635-65a6-4622-87ee-aa03ad1894b3/kube-auth-proxy/0.log"